Skip to content

Harden telemetry provenance and hybrid retrieval isolation#1

Open
nstranquist wants to merge 1 commit into
mainfrom
agent/telemetry-embedding-team-pilot
Open

Harden telemetry provenance and hybrid retrieval isolation#1
nstranquist wants to merge 1 commit into
mainfrom
agent/telemetry-embedding-team-pilot

Conversation

@nstranquist

@nstranquist nstranquist commented Jul 13, 2026

Copy link
Copy Markdown
Owner

What changed

  • add query client/run-context provenance, real/synthetic/unknown traffic classification, a telemetry summary, and real-traffic-only fixture export by default
  • prune deleted or renamed whole-document embeddings before rebuilding the flat sidecar
  • preserve --source isolation in both the mmap flat-vector path and the SQLite hybrid fallback before top-K selection
  • publish version-contract capabilities for the new guarantees
  • add a public, explicitly pre-launch Hosted Team design-partner offer and structured intake issue

Why

The local dogfood audit found three integrity gaps: roughly 33k legacy query rows could not distinguish eval traffic from adoption, the embedding cache contained 21,857 rows for a 17,208-document corpus because stale paths accumulated, and a source-scoped refs eval admitted global Nicos-stack candidates during hybrid retrieval. These changes make each boundary explicit and testable.

User impact

Integrations can label searches without rewriting history; fixture curation no longer silently promotes automated traffic. Embedding refreshes reconcile deleted paths, and source-scoped hybrid searches stay within the requested corpus. The OSS CLI remains local-first; optional provider calls remain opt-in. The Team offer is a recruiting pilot, not a SaaS-launch or revenue claim.

Validation

  • go build -tags sqlite_fts5 ./...
  • go vet -tags sqlite_fts5 ./...
  • go test -race -tags sqlite_fts5 ./...
  • issue-template YAML parse
  • live corpus reconciliation: 4,680 stale vectors pruned; 19,399 current vectors for 19,430 documents; corpus/FTS/embedding checks green
  • targeted source-scoped refs eval returned only refs-dissections/* candidates after the fix
  • GitHub CI green

This PR is ready for independent review and remains intentionally unmerged.

@nstranquist
nstranquist marked this pull request as ready for review July 14, 2026 00:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant