mirror of
https://github.com/github/awesome-copilot.git
synced 2026-10-14 15:51:45 +00:00
feat(review): assess knowledge uplift in content reviews
Centralize the knowledge-uplift test in the code-review skill and require evidence-backed classifications in the PR Review board. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 9082818f-c7db-42c7-add6-c337afb05fdb
This commit is contained in:
co-authored by
Copilot App
parent
9861787546
commit
17ffd2e23b
@@ -25,7 +25,11 @@ export const REVIEW_FIELDS_SCHEMA = {
|
||||
summary: { type: "string", description: "What the pull request actually changes." },
|
||||
repoFit: { type: "string", description: "Repository fit and meaningful value for Copilot users." },
|
||||
compliance: { type: "string", description: "Deterministic checks: frontmatter, naming, README regeneration, manifests." },
|
||||
differentiation: { type: "string", description: "How it differs from existing resources and native model capability." },
|
||||
differentiation: {
|
||||
type: "string",
|
||||
description:
|
||||
"Knowledge-uplift verdict (high / partial / none) with the specific content a capable model would not produce unprompted, plus overlap with existing resources.",
|
||||
},
|
||||
risks: { type: "string", description: "Correctness, security, licensing, or harmful-content concerns." },
|
||||
validation: { type: "string", description: "Evidence the contributor tested or validated the change." },
|
||||
confidence: { type: "string", enum: ["low", "medium", "high"], description: "Confidence in the recommendation." },
|
||||
@@ -60,6 +64,16 @@ function sharedRules(repo, guidancePath) {
|
||||
" - `gh pr diff <number> -R " + repo + "` for the actual change (use `--name-only` first if the diff is large).",
|
||||
" - `gh pr checks <number> -R " + repo + "` when checks are failing, to see which ones and why.",
|
||||
"Judge the submitted result, not assumptions about the tool that produced it. A title ending in 🤖🤖🤖 is a disclosure, not a defect.",
|
||||
"",
|
||||
knowledgeUpliftRules(),
|
||||
].join("\n");
|
||||
}
|
||||
|
||||
function knowledgeUpliftRules() {
|
||||
return [
|
||||
"Knowledge uplift — apply the \"Knowledge uplift\" test from the code-review skill to every agent, instruction, skill, prompt, hook, or workflow the PR adds or substantially changes. It is the criterion most often under-applied, so do not skip it for well-formatted PRs:",
|
||||
" - Always start the `differentiation` field with the `high` / `partial` / `none` classification and the quoted lines that justify it, then note any overlap with existing resources.",
|
||||
" - `none` must not be `approve`: use `needs-insight`, or `close` when it is also a near-duplicate. `partial` is usually `request-changes`; name the generic sections to cut in `suggestedComment`.",
|
||||
].join("\n");
|
||||
}
|
||||
|
||||
|
||||
@@ -45,6 +45,10 @@ For every pull request:
|
||||
reason for `request-changes`.
|
||||
- **Duplication** — search the repo for an existing agent/instruction/skill covering the
|
||||
same ground. Near-duplicates are `needs-insight` unless the overlap is total.
|
||||
- **Knowledge uplift** — the most common way a well-formatted PR still fails. Apply the
|
||||
"Knowledge uplift" test from `.github/skills/code-review/SKILL.md` to every content
|
||||
resource. `none` is never `approve` (use `needs-insight`, or `close` if it is also a
|
||||
near-duplicate); `partial` is usually `request-changes`.
|
||||
- **Provenance** — content copied from elsewhere without attribution, or obviously
|
||||
machine-generated filler with no evidence it was tested, is `needs-insight` at best.
|
||||
- **Checks and conflicts** — failing CI or a conflicting branch is `request-changes`,
|
||||
@@ -57,7 +61,9 @@ For every pull request:
|
||||
- `rationale` is one sentence shown on the card. Lead with the deciding factor.
|
||||
- `summary` describes what the PR actually changes, in the reviewer's own words.
|
||||
- `repoFit`, `compliance`, `differentiation`, `risks`, and `validation` map to the
|
||||
SKILL.md criteria — fill in the ones that mattered, leave the rest out.
|
||||
SKILL.md criteria — fill in the ones that mattered, leave the rest out. The exception
|
||||
is `differentiation`: always fill it for content PRs, leading with the knowledge-uplift
|
||||
classification and its evidence.
|
||||
- `checkNext` is for the maintainer: the one thing to verify before acting.
|
||||
- `suggestedComment` is prefilled into the board's comment box, so write it as a comment
|
||||
addressed to the contributor. Be specific, name files and line numbers, and keep the
|
||||
|
||||
Reference in New Issue
Block a user