Jobs
Locationsexpand_more
All locations
Jobs in TexasJobs in CaliforniaJobs in New YorkJobs in FloridaJobs in North CarolinaJobs in Ohio
Categoriesexpand_more
All categories
Healthcare & NursingLogistics & WarehouseEngineeringITSalesHospitality & Catering
SkillsCompaniesCareer GuidesBlogSalary
JobsLocationsCategoriesCompaniesCareer GuidesBlogSalary

Top states

TexasCaliforniaNew YorkFloridaNorth CarolinaOhio

Top categories

Healthcare & NursingLogistics & WarehouseEngineeringITSalesHospitality & Catering
Recrutus

Curating the world's most innovative career opportunities. We bridge the gap between visionary talent and industry-leading companies.

Search roles by city, category, skill, or job type — explore verified US employers, salary benchmarks, and remote-friendly teams hiring nationwide.

publiclanguageshare
Job seekers
Browse jobsCompanies hiringRemote jobsJobs by locationJobs by cityJobs by categoryJobs by skillCareer guidesCareer blogSalary insights
Job types
Contractor jobsFull-Time jobsIntern jobsOther jobsPart-Time jobsPer-Diem jobsTemporary jobsVolunteer jobs
Top states
Jobs in TexasJobs in CaliforniaJobs in New YorkJobs in FloridaJobs in North CarolinaJobs in OhioAll states →
Top categories
Healthcare & Nursing jobsLogistics & Warehouse jobsEngineering jobsIT jobsSales jobsHospitality & Catering jobsAccounting & Finance jobs
Popular skills
CDL-A jobsExcel jobsEnglish jobsMicrosoft Office jobs
Featured employers
Company
About usFAQContactPrivacy policyUS privacy noticeAccessibility

Recrutus helps candidates discover roles that match their skills and helps teams reach qualified applicants faster. Browse by metro, discipline, or work style — from internships to senior leadership.

© 2026 Recrutus. All rights reserved.
Terms of serviceCookie policyAcceptable useDMCA policyEmployer termsCandidate terms
Jobs
Locationsexpand_more
All locations
Jobs in TexasJobs in CaliforniaJobs in New YorkJobs in FloridaJobs in North CarolinaJobs in Ohio
Categoriesexpand_more
All categories
Healthcare & NursingLogistics & WarehouseEngineeringITSalesHospitality & Catering
SkillsCompaniesCareer GuidesBlogSalary
JobsLocationsCategoriesCompaniesCareer GuidesBlogSalary

Top states

TexasCaliforniaNew YorkFloridaNorth CarolinaOhio

Top categories

Healthcare & NursingLogistics & WarehouseEngineeringITSalesHospitality & Catering
Recrutus

Curating the world's most innovative career opportunities. We bridge the gap between visionary talent and industry-leading companies.

Search roles by city, category, skill, or job type — explore verified US employers, salary benchmarks, and remote-friendly teams hiring nationwide.

publiclanguageshare
Job seekers
Browse jobsCompanies hiringRemote jobsJobs by locationJobs by cityJobs by categoryJobs by skillCareer guidesCareer blogSalary insights
Job types
Contractor jobsFull-Time jobsIntern jobsOther jobsPart-Time jobsPer-Diem jobsTemporary jobsVolunteer jobs
Top states
Jobs in TexasJobs in CaliforniaJobs in New YorkJobs in FloridaJobs in North CarolinaJobs in OhioAll states →
Top categories
Healthcare & Nursing jobsLogistics & Warehouse jobsEngineering jobsIT jobsSales jobsHospitality & Catering jobsAccounting & Finance jobs
Popular skills
CDL-A jobsExcel jobsEnglish jobsMicrosoft Office jobs
Featured employers
Company
About usFAQContactPrivacy policyUS privacy noticeAccessibility

Recrutus helps candidates discover roles that match their skills and helps teams reach qualified applicants faster. Browse by metro, discipline, or work style — from internships to senior leadership.

© 2026 Recrutus. All rights reserved.
Terms of serviceCookie policyAcceptable useDMCA policyEmployer termsCandidate terms
Jobs
Locationsexpand_more
All locations
Jobs in TexasJobs in CaliforniaJobs in New YorkJobs in FloridaJobs in North CarolinaJobs in Ohio
Categoriesexpand_more
All categories
Healthcare & NursingLogistics & WarehouseEngineeringITSalesHospitality & Catering
SkillsCompaniesCareer GuidesBlogSalary
JobsLocationsCategoriesCompaniesCareer GuidesBlogSalary

Top states

TexasCaliforniaNew YorkFloridaNorth CarolinaOhio

Top categories

Healthcare & NursingLogistics & WarehouseEngineeringITSalesHospitality & Catering
  1. Home
  2. chevron_right
  3. it
  4. chevron_right
  5. Lead AI Engineer (FM Hosting, LLM Inference)
Capital One logo

Lead AI Engineer (FM Hosting, LLM Inference)

Not Disclosed•Full-TimeOn-site

location_onNYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States

Apply Now

About Capital One and AI

At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, we have been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking.

We are committed to building world-class applied science and engineering teams to deliver industry-leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. In this role, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses.

About the Team

The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work hand-in-hand with partners across the company to advance the state of the art in science and AI engineering. We build and deploy proprietary solutions that are central to our business and deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with the transformative power of AI in responsible and scalable ways for the highest leverage impact.

The Role

As a Lead AI Engineer, you will partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One. You will design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

You will invent and introduce state-of-the-art LLM optimization techniques to improve the performance, scalability, cost, latency, and throughput of large-scale production AI systems. Additionally, you will contribute to the technical vision and the long-term roadmap of foundational AI systems at Capital One.

Who You Are

You love to build systems, take pride in the quality of your work, and share our passion to do the right thing. You want to work on problems that will help change banking for good. You have a passion for staying abreast of the latest research and an ability to intuitively understand scientific publications, judiciously applying novel techniques in production.

You adapt quickly and thrive on bringing clarity to big, undefined problems. You love asking questions and digging deep to uncover the root of problems, articulating your findings concisely with clarity. You have the courage to share new ideas even when they are unproven. You are deeply technical, possessing a strong foundation in engineering and mathematics, with expertise in hardware, software, and AI that enables you to see and exploit optimization opportunities that others miss. You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown.

Hiring Process

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The role is expected to accept applications for a minimum of 5 business days. No agencies please.

Equal Opportunity

Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace and will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws. If you require an accommodation to apply, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com.

Work location

Work model: On-site

location_on

NYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States

New York, New York

Key Responsibilities

  • check_circleDesign, develop, test, deploy, and support AI software components including foundation model training and LLM inference
  • check_circlePartner with cross-functional teams to deliver AI-powered products that enhance customer and associate experiences
  • check_circleInvent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput
  • check_circleLeverage Open Source and SaaS AI technologies such as AWS, Huggingface, VectorDBs, and PyTorch
  • check_circleImplement AI governance, model evaluation, experimentation, and observability systems
  • check_circleContribute to the technical vision and long-term roadmap of foundational AI systems

Requirements

  • verifiedBachelor's degree in CS, AI, EE, or related field plus 4 years AI/ML experience
  • verifiedMaster's degree in CS, AI, EE, or related field plus 2 years AI/ML experience
  • verified4+ years experience programming with Python, Go, Scala, or Java
  • verifiedWork authorization sponsorship available

Nice to Have

6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud). Experience designing, developing, delivering, and supporting AI services. Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang. Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost. Passion for staying abreast of the latest AI research and AI systems, and judiciously applying novel techniques in production.

Benefits & Perks

check_circleEligible to earn performance based incentive compensation including cash bonuses and/or long term incentives
Capital One logo
Company

Capital One

Industry

it

View company profilearrow_forwardlanguageWebsite
Quick Overview

Experience

4+ yrs (Lead)

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Job Type

Full-Time

Skills Required

Similar Job Opportunities

Capital One logo

Lead AI Engineer (FM Hosting, LLM Inference)

Capital One • New York, New York

$197k-246karrow_forward
Capital One logo

Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)

Capital One • New York, New York

$197k-246karrow_forward
Capital One logo

Lead AI Engineer (GenAI Platform, AI Foundations, LLM Core and Agentic AI)

Capital One • New York, New York

$179k-246karrow_forward

Skills, education and keywords

Skills: Machine Learning, Aws, Huggingface, Vectordbs, Nemo Guardrails, Pytorch, LLM Inference, Similarity Search, Python, Go.

Education: Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields; Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.

Frequently asked questions about Lead AI Engineer (FM Hosting, LLM Inference) at Capital One

What does a Lead AI Engineer (FM Hosting, LLM Inference) at Capital One do?expand_more
Day-to-day, the Lead AI Engineer (FM Hosting, LLM Inference) at Capital One will design, develop, test, deploy, and support ai software components including foundation model training and llm inference; partner with cross-functional teams to deliver ai-powered products that enhance customer and associate experiences; invent and introduce state-of-the-art llm optimization techniques to improve scalability, cost, latency, and throughput; and leverage open source and saas ai technologies such as aws, huggingface, vectordbs, and pytorch.
What are the requirements for this Lead AI Engineer (FM Hosting, LLM Inference) role?expand_more
To qualify for the Lead AI Engineer (FM Hosting, LLM Inference) at Capital One position, applicants should have: Bachelor's degree in CS, AI, EE, or related field plus 4 years AI/ML experience; Master's degree in CS, AI, EE, or related field plus 2 years AI/ML experience; 4+ years experience programming with Python, Go, Scala, or Java; and Work authorization sponsorship available.
Where is the Lead AI Engineer (FM Hosting, LLM Inference) role at Capital One located?expand_more
Lead AI Engineer (FM Hosting, LLM Inference) at Capital One is based in NYU Paulson Center, 181, Mercer Street, University Village, Manhattan, New York County, New York, 10012, United States. This is a on-site role.
Is this Lead AI Engineer (FM Hosting, LLM Inference) job remote, hybrid, or on-site?expand_more
Capital One has listed this Lead AI Engineer (FM Hosting, LLM Inference) role as on-site.
How much experience is required for this Lead AI Engineer (FM Hosting, LLM Inference) role?expand_more
Lead AI Engineer (FM Hosting, LLM Inference) at Capital One typically requires 4+ years of relevant experience at the lead level.
What skills do you need for the Lead AI Engineer (FM Hosting, LLM Inference) role at Capital One?expand_more
Key skills for Lead AI Engineer (FM Hosting, LLM Inference) at Capital One include Machine Learning; Aws; Huggingface; Vectordbs; Nemo Guardrails; Pytorch; LLM Inference; and Similarity Search.
What education is required for Lead AI Engineer (FM Hosting, LLM Inference) at Capital One?expand_more
Educational requirements for this role: Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields; and Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.
What category does the Lead AI Engineer (FM Hosting, LLM Inference) role belong to?expand_more
Lead AI Engineer (FM Hosting, LLM Inference) at Capital One is part of the it job category on Recrutus.
Recrutus

Curating the world's most innovative career opportunities. We bridge the gap between visionary talent and industry-leading companies.

Search roles by city, category, skill, or job type — explore verified US employers, salary benchmarks, and remote-friendly teams hiring nationwide.

publiclanguageshare
Job seekers
Browse jobsCompanies hiringRemote jobsJobs by locationJobs by cityJobs by categoryJobs by skillCareer guidesCareer blogSalary insights
Job types
Contractor jobsFull-Time jobsIntern jobsOther jobsPart-Time jobsPer-Diem jobsTemporary jobsVolunteer jobs
Top states
Jobs in TexasJobs in CaliforniaJobs in New YorkJobs in FloridaJobs in North CarolinaJobs in OhioAll states →
Top categories
Healthcare & Nursing jobsLogistics & Warehouse jobsEngineering jobsIT jobsSales jobsHospitality & Catering jobsAccounting & Finance jobs
Popular skills
CDL-A jobsExcel jobsEnglish jobsMicrosoft Office jobs
Featured employers
Company
About usFAQContactPrivacy policy

Recrutus helps candidates discover roles that match their skills and helps teams reach qualified applicants faster. Browse by metro, discipline, or work style — from internships to senior leadership.

© 2026 Recrutus. All rights reserved.
Terms of serviceCookie policyAcceptable useDMCA policyEmployer termsCandidate terms
Machine LearningAwsHuggingfaceVectordbsNemo GuardrailsPytorchLLM InferenceSimilarity SearchPythonGo
US privacy notice
Accessibility