A grounded question-answering system for Armada’s internal Customer Support team, searching runbooks, help-center content and vendor documentation.
Sole owner, from discussions with the support team and an empty repository through production integration.
An on-device RAG application designed for document question answering on Armada edge hardware without internet access.
Sole engineering owner across document ingestion, local model serving, retrieval and cited question answering.
Engine-independent predictions of KV-cache capacity, latency, throughput and serving cost from spec sheets, with optional GPU-profile calibration.
Built the planner and used its predictions to choose serving configurations, then deployed them. Spec-sheet KV-cache capacity predictions were exact on 25/25 dense and MoE configurations.
With brief GPU profiling, dense mean error falls from 15.9% to 3.6% for TTFT (n=174) and 13.8% to 5.2% for batched TPOT (n=242). Errors are mean absolute percentages; profiled results are partly in-sample.
Contributions to an inherited RAG application, distinct from the Support Agent I later owned.
Contributor. Redesigned the LangGraph workflow and improved context preparation, retrieval and metadata handling.