pyro-mcp/docs/roadmap/llm-chat-ergonomics/4.9.0-real-repo-qualification-smokes.md

4.9.0 Real-Repo Qualification Smokes

Status: Planned

Goal

Replace fixture-only confidence with guest-backed proof that the chat-host path works against messy local repos and clean-clone startup sources.

Public API Changes

No new runtime surface is required in this milestone. The main additions are qualification smokes and their supporting fixtures.

The new coverage should prove:

• repo-root startup from a local Git checkout with ignored, generated, and unreadable files
• --repo-url clean-clone startup
• a realistic install, test, patch, rerun, and export loop
• at least one nontrivial service-start or readiness loop

Implementation Boundaries

• keep the smoke pack guest-backed and deterministic enough to use as a release gate
• focus on realistic repo-shape and project-loop problems, not synthetic micro-feature assertions
• prefer a small number of representative project fixtures over a large matrix of toy repos

Non-Goals

• no promise to qualify every language ecosystem in one milestone
• no cloud or remote execution qualification layer
• no broad benchmark suite beyond what is needed to prove readiness

Acceptance Scenarios

• the repo has one clear smoke target for real-repo qualification
• at least one local-checkout smoke proves the new Git-tracked startup behavior
• at least one clean-clone smoke proves the --repo-url path
• failures in these smokes clearly separate project-source issues from runtime or host issues

Required Repo Updates

• new guest-backed smoke targets and any supporting fixtures
• roadmap, use-case docs, and release/readiness docs updated to point at the new qualification path
• troubleshooting updated with the distinction between shaped use-case smokes and real-repo qualification smokes