Distinguished AI Engineer
Not Disclosed•Full-TimeOn-site
location_onNYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States
About the Mission
At Capital One, we are creating responsible and reliable AI systems to change banking for good. For years, we have been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent, combined with deep experience in machine learning, position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking.
We are committed to continuing to build world-class applied science and engineering teams to deliver industry-leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. In this role, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and the businesses that have come to love the products and services we build.
About the Team
The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work hand-in-hand with partners across the company to advance the state of the art in science and AI engineering. We build and deploy proprietary solutions that are central to our business and deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with the transformative power of AI in responsible and scalable ways for the highest leverage impact.
The Role Experience
As a Distinguished AI Engineer, you will partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One. You will design, develop, test, deploy, and support AI software components, ranging from foundation model training and large language model inference to similarity search, guardrails, model evaluation, experimentation, governance, and observability.
You will be expected to invent and introduce state-of-the-art LLM optimization techniques to improve the performance, scalability, cost, latency, and throughput of large-scale production AI systems. Beyond execution, you will contribute to the technical vision and the long-term roadmap of foundational AI systems at Capital One. This role is for those who love to build systems, take pride in the quality of their work, and share a passion for doing the right thing. You will thrive on bringing clarity to big, undefined problems, digging deep to uncover root causes, and articulating findings with clarity. As a resilient trailblazer, you will forge new paths to achieve business goals when the route is unknown, sharing new ideas even when they are unproven.
Hiring Process & Application
Capital One is committed to a fair and inclusive hiring process. We consider qualified applicants regardless of background. If you require an accommodation to apply for a position, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.
This role is expected to accept applications for a minimum of 5 business days. No agencies please. For technical support or questions about the recruiting process, please send an email to Careers@capitalone.com.
Equal Opportunity & Culture
Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. We promote a drug-free workplace and will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws. Capital One Financial is made up of several different entities; please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe, and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Work location
Work model: On-site
NYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States
New York, New York
Key Responsibilities
- check_circleDesign, develop, test, deploy, and support AI software components including foundation model training and LLM inference
- check_circlePartner with cross-functional teams to deliver AI-powered products that enhance customer and associate experiences
- check_circleInvent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput
- check_circleLeverage Open Source and SaaS AI technologies such as AWS, Huggingface, VectorDBs, and PyTorch
- check_circleImplement model evaluation, experimentation, governance, and observability for production AI systems
- check_circleContribute to the technical vision and long-term roadmap of foundational AI systems
Requirements
- verifiedBachelor's degree in CS, AI, EE, or related fields plus 8 years AI/ML experience
- verifiedMaster's degree in CS, AI, EE, or related fields plus 6 years AI/ML experience
- verified8+ years experience with Python, Go, Scala, or Java
- verified8+ years experience deploying scalable AI solutions on cloud platforms
- verifiedWork authorization sponsorship available
Nice to Have
8 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud); Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems; Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level; Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang; Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost; Passion for staying abreast of the latest AI research and AI systems, and judiciously applying novel techniques in production; Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.
Benefits & Perks
check_circleEligible for performance-based incentive compensation including cash bonuses and/or long-term incentivescheck_circleComprehensive, competitive, and inclusive set of health, financial, and other benefits
Similar Job Opportunities
Lead AI Engineer (FM Hosting, LLM Inference)
Capital One • New York, New York
$197k-246karrow_forward
Lead AI Engineer (FM Hosting, LLM Inference)
Capital One • New York, New York
$197k-246karrow_forward
Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)
Capital One • New York, New York
$197k-246karrow_forward
Skills, education and keywords
Skills: Machine Learning, Ai, Aws, Huggingface, Vectordbs, Nemo Guardrails, Pytorch, LLM Inference, Similarity Search, Python.
Education: Bachelor's degree in CS, AI, EE, CE, or related fields with 8+ years experience; Master's degree in CS, AI, EE, CE, or related fields with 6+ years experience.
Frequently asked questions about Distinguished AI Engineer at Capital One
What does a Distinguished AI Engineer at Capital One do?expand_more
Day-to-day, the Distinguished AI Engineer at Capital One will design, develop, test, deploy, and support ai software components including foundation model training and llm inference; partner with cross-functional teams to deliver ai-powered products that enhance customer and associate experiences; invent and introduce state-of-the-art llm optimization techniques to improve scalability, cost, latency, and throughput; and leverage open source and saas ai technologies such as aws, huggingface, vectordbs, and pytorch.
What are the requirements for this Distinguished AI Engineer role?expand_more
To qualify for the Distinguished AI Engineer at Capital One position, applicants should have: Bachelor's degree in CS, AI, EE, or related fields plus 8 years AI/ML experience; Master's degree in CS, AI, EE, or related fields plus 6 years AI/ML experience; 8+ years experience with Python, Go, Scala, or Java; 8+ years experience deploying scalable AI solutions on cloud platforms; and Work authorization sponsorship available.
Where is the Distinguished AI Engineer role at Capital One located?expand_more
Distinguished AI Engineer at Capital One is based in NYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States. This is a on-site role.
Is this Distinguished AI Engineer job remote, hybrid, or on-site?expand_more
Capital One has listed this Distinguished AI Engineer role as on-site.
How much experience is required for this Distinguished AI Engineer role?expand_more
Distinguished AI Engineer at Capital One typically requires 6+ years of relevant experience at the lead level.
What skills do you need for the Distinguished AI Engineer role at Capital One?expand_more
Key skills for Distinguished AI Engineer at Capital One include Machine Learning; Ai; Aws; Huggingface; Vectordbs; Nemo Guardrails; Pytorch; and LLM Inference.
What education is required for Distinguished AI Engineer at Capital One?expand_more
Educational requirements for this role: Bachelor's degree in CS, AI, EE, CE, or related fields with 8+ years experience; and Master's degree in CS, AI, EE, CE, or related fields with 6+ years experience.
What category does the Distinguished AI Engineer role belong to?expand_more
Distinguished AI Engineer at Capital One is part of the it job category on Recrutus.