Distinguished AI Engineer
Not Disclosed•Full-TimeOn-site
location_onFairfax County Fire Station Number 1, McLean, 1455, Laughlin Avenue, Bryn Mawr, McLean, Fairfax County, Virginia, 22101, United States
About the Team
At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, we have been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent position us to be at the forefront of enterprises leveraging AI.
The Intelligent Foundations and Experiences (IFX) team is at the center of bringing this vision to life. We work hand-in-hand with partners across the company to advance the state of the art in science and AI engineering. We build and deploy proprietary solutions that are central to our business, empowering teams across Capital One to enhance their products with the transformative power of AI in responsible and scalable ways.
Work location
Work model: On-site
Fairfax County Fire Station Number 1, McLean, 1455, Laughlin Avenue, Bryn Mawr, McLean, Fairfax County, Virginia, 22101, United States
McLean, Virginia
Key Responsibilities
- check_circleDesign, develop, test, deploy, and support AI software components including foundation model training and LLM inference
- check_circlePartner with cross-functional teams to deliver AI-powered products that enhance customer and associate experiences
- check_circleInvent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput
- check_circleLeverage Open Source and SaaS AI technologies such as AWS, Huggingface, VectorDBs, and PyTorch
- check_circleImplement model evaluation, experimentation, governance, and observability for production AI systems
- check_circleContribute to the technical vision and long-term roadmap of foundational AI systems
Requirements
- verifiedBachelor's degree in CS, AI, EE, or related fields plus 8 years AI/ML experience OR Master's degree plus 6 years
- verified8+ years programming in Python, Go, Scala, or Java
- verified8+ years deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure)
- verifiedExperience with LLM Inference, Similarity Search, VectorDBs, Guardrails
- verifiedExperience optimizing training and inference software for hardware utilization, latency, throughput, and cost
- verifiedWillingness to accept employment authorization sponsorship
Nice to Have
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud); Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems; Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level; Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang; Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost; Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production; Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers
Benefits & Perks
check_circleEligible for performance-based incentive compensation including cash bonuses and/or long-term incentivescheck_circleComprehensive, competitive, and inclusive set of health, financial, and other benefits
Similar Job Opportunities
Lead AI Engineer (FM Hosting, LLM Inference)
Capital One • New York, New York
$197k-246karrow_forward
Lead AI Engineer (FM Hosting, LLM Inference)
Capital One • New York, New York
$197k-246karrow_forward
Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)
Capital One • New York, New York
$197k-246karrow_forward
Skills, education and keywords
Skills: Machine Learning, Ai, Aws, Huggingface, Vectordbs, Nemo Guardrails, Pytorch, LLM Inference, Similarity Search, Python.
Education: Bachelor's degree in CS, AI, EE, CE, or related fields with 8+ years experience; Master's degree in CS, AI, EE, CE, or related fields with 6+ years experience.
Frequently asked questions about Distinguished AI Engineer at Capital One
What does a Distinguished AI Engineer at Capital One do?expand_more
A Distinguished AI Engineer at Capital One is responsible for the following: Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference; Partner with cross-functional teams to deliver AI-powered products that enhance customer and associate experiences; Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput; and Leverage Open Source and SaaS AI technologies such as AWS, Huggingface, VectorDBs, and PyTorch.
What are the requirements for this Distinguished AI Engineer role?expand_more
Capital One is looking for candidates who meet the following requirements: Bachelor's degree in CS, AI, EE, or related fields plus 8 years AI/ML experience OR Master's degree plus 6 years; 8+ years programming in Python, Go, Scala, or Java; 8+ years deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure); Experience with LLM Inference, Similarity Search, VectorDBs, Guardrails; Experience optimizing training and inference software for hardware utilization, latency, throughput, and cost; and Willingness to accept employment authorization sponsorship.
Where is the Distinguished AI Engineer role at Capital One located?expand_more
Distinguished AI Engineer at Capital One is based in Fairfax County Fire Station Number 1, McLean, 1455, Laughlin Avenue, Bryn Mawr, McLean, Fairfax County, Virginia, 22101, United States. This is a on-site role.
Is this Distinguished AI Engineer job remote, hybrid, or on-site?expand_more
Capital One has listed this Distinguished AI Engineer role as on-site.
How much experience is required for this Distinguished AI Engineer role?expand_more
Distinguished AI Engineer at Capital One typically requires 6+ years of relevant experience at the lead level.
What skills do you need for the Distinguished AI Engineer role at Capital One?expand_more
Key skills for Distinguished AI Engineer at Capital One include Machine Learning; Ai; Aws; Huggingface; Vectordbs; Nemo Guardrails; Pytorch; and LLM Inference.
What education is required for Distinguished AI Engineer at Capital One?expand_more
Educational requirements for this role: Bachelor's degree in CS, AI, EE, CE, or related fields with 8+ years experience; and Master's degree in CS, AI, EE, CE, or related fields with 6+ years experience.
What category does the Distinguished AI Engineer role belong to?expand_more
Distinguished AI Engineer at Capital One is part of the it job category on Recrutus.