Documented result90% Recall@5100-query retrieval evaluation (local research; completed): Recall@5 for hybrid retrieval. 100 diagnostic queries; 20 service manuals; approximately 4,500 document chunks. Recall@5: 90%. Hybrid retrieval over 100 diagnostic queries; profile-supported, evaluation artifacts pending. Indexed document chunks: ~4,500. Approximate corpus size: 20 service manuals. Service manuals: 20. Indexed automotive service manuals. Decision-support POC, not a substitute for a certified technician. Recall describes the 100-query retrieval evaluation, not field diagnostic accuracy. Separate lexical/dense scores and scenario pass rates are not supplied.
Documented resultSix-node agentic workflowDiagnostic scenario validation (unspecified; completed): Scenario testing; detailed outcomes not supplied. 40 vehicle-diagnostic scenarios; 1,000 PostgreSQL service-history records. Diagnostic scenarios tested: 40. Count of tested scenarios, not a scenario success rate. Service-history records: 1,000. PostgreSQL service-history dataset size; not number of successful diagnoses. Decision-support POC, not a substitute for a certified technician. Recall describes the 100-query retrieval evaluation, not field diagnostic accuracy. Separate lexical/dense scores and scenario pass rates are not supplied.
supporting evidenceEngineering decision
Combine BM25 lexical search with dense semantic retrieval.
Documented resultWhy hybrid retrieval?100-query retrieval evaluation (local research; completed): Recall@5 for hybrid retrieval. 100 diagnostic queries; 20 service manuals; approximately 4,500 document chunks. Recall@5: 90%. Hybrid retrieval over 100 diagnostic queries; profile-supported, evaluation artifacts pending. Decision-support POC, not a substitute for a certified technician. Recall describes the 100-query retrieval evaluation, not field diagnostic accuracy. Separate lexical/dense scores and scenario pass rates are not supplied.
100-query retrieval evaluation: completed. 100 diagnostic queries; 20 service manuals; approximately 4,500 document chunks. Diagnostic scenario validation: completed. 40 vehicle-diagnostic scenarios; 1,000 PostgreSQL service-history records.
05
Reliability & deployment
A documented safety and scope boundary.
Dedicated safety-validation stage; diagnostic decision support does not replace certified technicians. Decision-support POC, not a substitute for a certified technician. Recall describes the 100-query retrieval evaluation, not field diagnostic accuracy. Separate lexical/dense scores and scenario pass rates are not supplied.