U.S. Bank
|GenAI Engineer / AI ML Engineer
New York, NY, US
Summary
Led the development and deployment of a RAG-based search tool and advanced agent workflows to significantly enhance risk and compliance processes for policy and regulatory documents.
Highlights
Engineered a RAG-based search tool, enabling risk and compliance analysts to query policy and regulatory documents directly, significantly reducing manual review time.
Developed robust document ingestion pipelines, including parsing, chunking, embedding generation, and metadata storage, to facilitate precise filtering by policy type and date.
Implemented advanced LangGraph agent workflows for multi-step queries, integrating internal tools and prioritizing high-risk answers for expedited reviewer attention.
Designed and deployed FastAPI and Spring Boot services with comprehensive input validation and logging, ensuring seamless integration with bank applications and streamlining production issue resolution.
Established a critical prompt versioning system and comprehensive test suite with expected answers, ensuring rigorous validation before any prompt or model changes are deployed.
Fine-tuned small open-source models using SFT and DPO for accurate classification of compliance query intent, deploying them efficiently with VLLM.
Developed and maintained the React frontend for the search and policy Q&A tool, consistently delivering updates through agile sprints in collaboration with product, architecture, and QA teams.