AI-Assisted Analysis Harness by iRaindrop · Pull Request #386 · cncf/techdocs

iRaindrop · 2026-10-21T20:02:40Z

Provides the directory structure and guidance under .github in the project's doc website repo for conducting an AI-assisted analysis using Copilot GitHub Enterprise.

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

netlify · 2026-10-21T20:02:49Z

✅ Deploy Preview for cncf-techdocs ready!

Name	Link
🔨 Latest commit	`b9af4c1`
🔍 Latest deploy log	https://app.netlify.com/projects/cncf-techdocs/deploys/6ae5444e27c51a49a4c29216
😎 Deploy Preview	https://deploy-preview-386--cncf-techdocs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop

Reviewed the harness against the KubeVirt .github folder it was copied from. The structure copied cleanly (all content diffs are Prettier line-wrapping). The comments below cover what is still KubeVirt-specific and what would make the harness complete end-to-end for the next project.

Suggestions not tied to a specific line:

Add a /rank-recommendations prompt that produces input/ai-ranked-recommendations.csv. For KubeVirt this ranking step was ad hoc; codifying it closes the only manual gap in the pipeline.
Reference (or add) the upload process. The issue prompts say "a process will upload" the files, but the harness does not say where that script or workflow lives.
Record the validated toolchain in ai-harness.md: Copilot CLI version, model, and that the prompt files rely on mode: agent and ${input:title}.
Add a pre-flight checklist: required labels exist in the target repo (help wanted, the three priority labels), the project's analysis.md is scaffolded from the techdocs template, and .github has no conflicting prompt files.
Consider an examples/kubevirt/ folder holding the KubeVirt "Current Repository" section and issue template, so the generic files stay generic but a worked example is still available.

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop

Second pass over the harness at a834e7d. All earlier threads are addressed, CI is green, and the structure is consistent end to end (criteria → wrappers → engines → issue prompts → upload process). The remaining edits are small; only the first one affects a data contract (the CSV Section value), the rest are wording and clarity. None block the merge; they can land in a follow-up if preferred.

- Align section and area display names with the copilot-instructions tables (Website & Infrastructure; Information Architecture; SEO, Analytics, and Site Search; Usability, Accessibility and Devices) - Fix typo (Precede) in comment engine - Tell section-comment engine how to fill the Other Metrics table - Move the umbrella template example into the HTML comment - Clarify per-answer paragraph length in answers engine - Drop stray period in index.md toolchain list - Sync the KubeVirt example's No commits wording with the template Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop · 2026-10-25T00:48:43Z

Ready to merge

Note: This commit fixes a link issue from 404s in older Analyses files, currently preventing the other open PRs from merging:

6a4ef0e

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

chalin

@iRaindrop @nate-double-u - Why hide the template files under _github from the site deploy?

kmkhz

Hi Bruce,

I think I only got about an inch deep with this review, but it's long. So I'll submit it now and take a fresh look on Monday.

Thanks,
Kristen

kmkhz · 2026-10-30T16:36:46Z

+   the umbrella's sub-issue list resolves.
+
+For KubeVirt this was done with a `gh issue create` script run by the writer;
+the script is not part of the harness yet. Until it is added here, write the


the script is not part of the harness yet. Until it is added here

What prevented this script from being added to the harness? What are the next steps here?

Issue workflow details tbd

kmkhz · 2026-10-30T22:13:31Z

+  `.github/templates/umbrella-issue.md` template: an `## Umbrella Issue`
+  overview and a `## Sub-issues` list that links to the sub-issue files. The
+  umbrella does not contain the sub-issue content.
+- Copilot is at liberty to create subheadings in the issue files as needed to


Do we want to limit the heading level depth? I'd recommend 4 or fewer levels of heading.

Removed that bullet - not needed

kmkhz · 2026-10-30T23:03:56Z

+  - Set `repo` to the issues repository URL from the "Current Repository"
+    section.
+
+  ```yaml


The .github/output/issues/ MD file acts as both a staging artifact and a final payload for issue creation, which conflates local workflow metadata with the final issue payload schema. I think we need to define the issue creation workflow better to resolve this.

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

created basic harness layout

bc3ab22

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop added 3 commits October 21, 2026 13:26

ran prettier

c4d692b

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

added missing H1s

5e33820

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

format edits

785c922

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop commented Oct 22, 2026

View reviewed changes

format fixes

adf6eb7

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop requested a review from nate-double-u October 22, 2026 02:31

trigger build

b194e54

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

nate-double-u self-assigned this Oct 22, 2026

iRaindrop added 12 commits October 23, 2026 13:36

claude-fable updates and additions

1bdb2a9

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

line length fix

f5d8e84

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

added old analyses < 2024 to IgnoreDirs

6a4ef0e

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

typo fix

ee912af

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Added new area: AI Agent Readiness

1dc8f22

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

misc fixes

0d629c5

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

ran prettier

a2a7eac

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

ran prettier

6b2b505

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

noted claude fable 5.1 was used

807f79d

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

ran prettier

0e12477

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

trigger build - no edits

0e25ef2

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

trigger build - 503 retry

a834e7d

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop commented Oct 24, 2026

View reviewed changes

iRaindrop and others added 4 commits October 24, 2026 13:21

trigger build - no edits

1f41efc

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

trigger build - no edits

b88df41

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

trigger build - no edits

f21cba1

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

iRaindrop added 2 commits October 24, 2026 20:03

removed private .github - not needed for harness

8928b35

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

changed mode:agent to agent:agent in prompt files

9991152

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

nate-double-u mentioned this pull request Oct 27, 2026

Skip link checks on pre-2024 analyses and refresh the link cache #387

Merged

iRaindrop and others added 4 commits October 26, 2026 23:09

Merge branch 'main' into ai-harness

9f340f7

trigger build - no edits

6570667

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

trigger build - no edits

2ba709c

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Merge branch 'main' into ai-harness

97cec53

chalin reviewed Oct 28, 2026

View reviewed changes

kmkhz reviewed Oct 30, 2026

View reviewed changes

iRaindrop and others added 8 commits October 30, 2026 16:17

Update docs/analysis/ai-harness/index.md

26f74f0

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Update docs/analysis/ai-harness/index.md

b912091

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Update docs/analysis/ai-harness/_github/copilot-instructions.md

53d4974

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Update docs/analysis/ai-harness/_github/copilot-instructions.md

82d6640

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Update docs/analysis/ai-harness/_github/copilot-instructions.md

f6472b1

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Update docs/analysis/ai-harness/_github/copilot-instructions.md

27a265f

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Update docs/analysis/ai-harness/_github/copilot-instructions.md

9ba63fb

Co-authored-by: Kristen K <kmkelle.mail@gmail.com> Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

formatting - minor edit

b9af4c1

Signed-off-by: Bruce Hamilton <scarlettbernique@gmail.com>

Conversation

iRaindrop commented Oct 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

netlify Bot commented Oct 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Deploy Preview for cncf-techdocs ready!

Uh oh!

iRaindrop left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

iRaindrop left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

iRaindrop commented Oct 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

chalin left a comment

Choose a reason for hiding this comment

Uh oh!

kmkhz left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

kmkhz Oct 30, 2026

Choose a reason for hiding this comment

Uh oh!

iRaindrop Oct 30, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

kmkhz Oct 30, 2026

Choose a reason for hiding this comment

Uh oh!

iRaindrop Oct 31, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kmkhz Oct 30, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

iRaindrop commented Oct 21, 2026 •

edited

Loading

netlify Bot commented Oct 21, 2026 •

edited

Loading

iRaindrop commented Oct 25, 2026 •

edited

Loading