Make quality, speed and resource trade-offs inspectable.
Approach
Use a unified VectorStore interface for ANN and exact-search comparisons.
Trade-off / scope
Local results require benchmark context; no production service performance is implied.
04
Evaluation, in context.
direct evidenceRetrieval benchmark
7,641 chunks and 76 queries; recall, throughput, build time and reported memory overhead.
Documented result7,641 chunks · 76 queriesANN / exact retrieval benchmark (local research; completed): Unified VectorStore comparisons across ANN and exact/Flat approaches; RAGAS end-to-end quality evaluation is documented without supplied numerical scores. arXiv document corpus: 7,641 chunks, 76 queries. Document chunks: 7,641. Benchmark corpus size. Benchmark queries: 76. Number of retrieval benchmark queries. HNSW recall: ≥0.998. Local HNSW retrieval benchmark; recall cutoff and aggregation not supplied. HNSW retrieval throughput: ~1,439 QPS. Local retrieval queries per second, not application request latency or production throughput. FAISS-Flat index build time: 0.002 s. Local index construction time; not request latency. FAISS-Flat reported memory overhead: 0.09 MB. Reported local benchmark memory overhead; measurement definition not supplied. Local research application and retrieval benchmark, not a production service benchmark. QPS and index build time are not application request latency. Benchmark hardware, query distribution, recall cutoff and full per-backend outputs are not supplied.
Local research application and retrieval benchmark, not a production service benchmark. QPS and index build time are not application request latency. Benchmark hardware, query distribution, recall cutoff and full per-backend outputs are not supplied.