Lead AI Engineer
Not Disclosed•Full-TimeOn-site
location_onNYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States
About the Mission
At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, we have been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking.
About the Team
The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work hand-in-hand with partners across the company to advance the state of the art in science and AI engineering. We build and deploy proprietary solutions that are central to our business and deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with the transformative power of AI in responsible and scalable ways for the highest leverage impact.
About the Role
In this role, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses. You will partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One.
You will be a resilient trailblazer who loves to build systems and take pride in the quality of your work. You will thrive on bringing clarity to big, undefined problems, digging deep to uncover root causes, and articulating findings with clarity. You will have the courage to share new ideas even when they are unproven, contributing to the technical vision and long-term roadmap of foundational AI systems at Capital One.
Hiring Process
This role is expected to accept applications for a minimum of 5 business days. No agencies please. If you have visited our website in search of information on employment opportunities or to apply for a position and require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com.
Equal Opportunity
Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. We promote a drug-free workplace and will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws. Capital One Financial is made up of several different entities; please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe, and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Work location
Work model: On-site
NYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States
New York, New York
Key Responsibilities
- check_circleDesign, develop, test, deploy, and support AI software components including foundation model training and LLM inference
- check_circlePartner with cross-functional teams to deliver AI-powered products that enhance customer and associate experiences
- check_circleInvent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput
- check_circleLeverage Open Source and SaaS AI technologies such as AWS, Huggingface, VectorDBs, and PyTorch
- check_circleImplement model evaluation, experimentation, governance, and observability for production AI systems
- check_circleContribute to the technical vision and long-term roadmap of foundational AI systems
Requirements
- verifiedBachelor's degree in CS, AI, EE, or related fields plus 4 years AI/ML experience
- verifiedMaster's degree in CS, AI, EE, or related fields plus 2 years AI/ML experience
- verified4+ years experience programming with Python, Go, Scala, or Java
- verified6 years experience deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure)
- verifiedExperience designing and supporting AI services
- verifiedExperience developing AI/ML algorithms (LLM Inference, VectorDBs, Guardrails)
- verifiedExperience optimizing training and inference software for hardware utilization, latency, throughput, and cost
Nice to Have
6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud). Experience designing, developing, delivering, and supporting AI services. Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang. Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost. Passion for staying abreast of the latest AI research and AI systems, and judiciously applying novel techniques in production.
Benefits & Perks
check_circleEligible for performance-based incentive compensation including cash bonuses and/or long-term incentives
Similar Job Opportunities
Lead AI Engineer (FM Hosting, LLM Inference)
Capital One • New York, New York
$197k-246karrow_forward
Lead AI Engineer (FM Hosting, LLM Inference)
Capital One • New York, New York
$197k-246karrow_forward
Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)
Capital One • New York, New York
$197k-246karrow_forward
Skills, education and keywords
Skills: Machine Learning, Ai, Aws, Huggingface, Vectordbs, Nemo Guardrails, Pytorch, LLM Inference, Similarity Search, Python.
Education: Bachelor's degree in CS, AI, EE, or CE with 4+ years experience; Master's degree in CS, AI, EE, or CE with 2+ years experience.
Frequently asked questions about Lead AI Engineer at Capital One
What does a Lead AI Engineer at Capital One do?expand_more
A Lead AI Engineer at Capital One is responsible for the following: Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference; Partner with cross-functional teams to deliver AI-powered products that enhance customer and associate experiences; Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput; and Leverage Open Source and SaaS AI technologies such as AWS, Huggingface, VectorDBs, and PyTorch.
What are the requirements for this Lead AI Engineer role?expand_more
Capital One is looking for candidates who meet the following requirements: Bachelor's degree in CS, AI, EE, or related fields plus 4 years AI/ML experience; Master's degree in CS, AI, EE, or related fields plus 2 years AI/ML experience; 4+ years experience programming with Python, Go, Scala, or Java; 6 years experience deploying scalable AI solutions on cloud platforms (AWS, GCP, Azure); Experience designing and supporting AI services; and Experience developing AI/ML algorithms (LLM Inference, VectorDBs, Guardrails).
Where is the Lead AI Engineer role at Capital One located?expand_more
Lead AI Engineer at Capital One is based in NYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States. This is a on-site role.
Is this Lead AI Engineer job remote, hybrid, or on-site?expand_more
Capital One has listed this Lead AI Engineer role as on-site.
How much experience is required for this Lead AI Engineer role?expand_more
Lead AI Engineer at Capital One typically requires 4+ years of relevant experience at the lead level.
What skills do you need for the Lead AI Engineer role at Capital One?expand_more
Key skills for Lead AI Engineer at Capital One include Machine Learning; Ai; Aws; Huggingface; Vectordbs; Nemo Guardrails; Pytorch; and LLM Inference.
What education is required for Lead AI Engineer at Capital One?expand_more
Educational requirements for this role: Bachelor's degree in CS, AI, EE, or CE with 4+ years experience; and Master's degree in CS, AI, EE, or CE with 2+ years experience.
What category does the Lead AI Engineer role belong to?expand_more
Lead AI Engineer at Capital One is part of the it job category on Recrutus.