Senior AI Engineer

Job Description

Become a key player in building cutting-edge AI systems at Jeeves, a dynamic financial operating system startup. As a Senior AI Engineer, you'll spearhead the design, development, and maintenance of production-grade LLM integration pipelines, focusing on retrieval-augmented generation (RAG), prompt engineering, output parsing, and chain orchestration. Your role will involve developing and operating AI features within Jeeves's core financial products, including spend categorization, document extraction, anomaly detection, financial Q&A, and automated reconciliation. You will implement structured output validation, fallback handling, and confidence scoring to ensure AI decisions meet the highest reliability standards for financial use cases. You'll also be responsible for evaluating and integrating AI frameworks and tools such as LangChain, LlamaIndex, OpenAI API, Anthropic API, HuggingFace, and vector databases, advocating for the best tool for each task. Establishing prompt versioning and evaluation practices will be crucial to maintaining the accuracy and consistency of AI outputs as models and data evolve. Design and maintain vector search pipelines using databases like Pinecone, Weaviate, or pgvector to power semantic search and RAG-based features. Build document ingestion and chunking pipelines for Jeeves's financial data, processing invoices, receipts, policy documents, and transaction records. Optimize retrieval quality through embedding model selection, chunk strategy, metadata filtering, and re-ranking techniques. Collaborate closely with data scientists to transition trained ML models from experimental notebooks to production-serving infrastructure. You will build and maintain model-serving endpoints with appropriate latency SLOs, input validation, and output monitoring. Implement model performance monitoring and data drift detection to ensure production models remain accurate over time. Support model retraining workflows by designing clean data pipelines and feature engineering that can be continuously updated. Integrate AI services seamlessly with Jeeves's backend microservices, designing clear API contracts, circuit breakers, and graceful degradation patterns. Write high-quality, testable backend code in Python or Go/Node.js to power AI-integrated features. Instrument AI components with structured logging, distributed tracing, latency dashboards, and alerting to ensure operational visibility. Build human-in-the-loop review workflows for AI decisions that require oversight, particularly for high-value financial actions. Partner with Product, Backend Engineering, and Data Science teams to define the AI roadmap and translate requirements into reliable systems, driving innovation and reliability in Jeeves's AI capabilities.

Qualifications

1. Bachelor's degree in Computer Science, Engineering, or a related field — or equivalent practical experience. 2. 5+ years of professional software engineering experience, with at least 3 years focused on AI/ML systems in production. 3. Hands-on experience building and deploying LLM-powered applications using APIs such as OpenAI, Anthropic, or Cohere in a production environment. 4. Experience designing and operating RAG pipelines, including chunking strategies, embedding models, and vector database integration (Pinecone, Weaviate, pgvector, or similar). 5. Strong proficiency in Python for AI/ML workloads; familiarity with at least one AI orchestration framework (LangChain, LlamaIndex, or equivalent). 6. Experience with ML model serving infrastructure: REST or gRPC inference endpoints, input/output validation, latency budgeting, and monitoring. 7. Solid backend engineering fundamentals: REST APIs, relational databases (PostgreSQL preferred), async patterns, and cloud infrastructure (AWS, GCP, or Azure). 8. Experience with observability tooling: structured logging, distributed tracing, and building dashboards for AI system health. 9. Experience in fintech, financial services, or any regulated industry where AI reliability and auditability are critical.

Benefits

- Remote work options. Join our team and enjoy the flexibility of working remotely.