Senior AI Engineer - Agentic Systems
Not Disclosed•Full-TimeOn-site
location_on9, East 45th Street, Midtown, Manhattan Community Board 5, Manhattan, New York County, New York, 10017, United States
About IBM Consulting
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact.
At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
About the Role
We are seeking a skilled AI Engineer to join an active enterprise AI engagement in a hands-on, client-facing capacity. This is a senior individual contributor role requiring deep technical proficiency in Agentic AI. You will be expected to operate independently, interact directly with the client, and deliver with minimal oversight.
In this role, you will build, fine-tune, and operationalize AI solutions on Azure, with a specific focus on agentic workflows, prompt engineering, RAG pipelines, and production-grade model deployment. The client expects a high-caliber engineer who can perform from day one. You will design and deploy multi-agent systems, optimize prompt strategies, and establish monitoring and evaluation loops to ensure ongoing model performance and reliability in production.
Equal Opportunity
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Work location
Work model: On-site
9, East 45th Street, Midtown, Manhattan Community Board 5, Manhattan, New York County, New York, 10017, United States
New York, New York
Key Responsibilities
- check_circleDesign and deploy agentic AI workflows and multi-agent systems using Azure OpenAI
- check_circleDevelop and optimize prompt engineering strategies to maximize model performance
- check_circleBuild and maintain Retrieval-Augmented Generation (RAG) pipelines for context-aware responses
- check_circleImplement agent orchestration patterns including tool calling and memory management
- check_circleEngage directly with client stakeholders to gather requirements and demo technical solutions
- check_circleDeploy and manage AI models using Azure ML and Azure AI Studio services
- check_circleIntegrate AI capabilities into enterprise applications via APIs and microservices
- check_circleEstablish monitoring and evaluation loops to ensure ongoing model reliability in production
Requirements
- verified7+ years designing, developing, and deploying scalable AI applications leveraging LLMs, RAG architectures, and agentic AI workflows
- verifiedExperience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI
- verifiedFamiliarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations
- verifiedKnowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management
- verifiedExperience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms
Nice to Have
Experience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI. Familiarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations. Knowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management. Experience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms.
Similar Job Opportunities
Frequently asked questions about Senior AI Engineer - Agentic Systems at IBM
What does a Senior AI Engineer - Agentic Systems at IBM do?expand_more
A Senior AI Engineer - Agentic Systems at IBM is responsible for the following: Design and deploy agentic AI workflows and multi-agent systems using Azure OpenAI; Develop and optimize prompt engineering strategies to maximize model performance; Build and maintain Retrieval-Augmented Generation (RAG) pipelines for context-aware responses; and Implement agent orchestration patterns including tool calling and memory management.
What are the requirements for this Senior AI Engineer - Agentic Systems role?expand_more
To qualify for the Senior AI Engineer - Agentic Systems at IBM position, applicants should have: 7+ years designing, developing, and deploying scalable AI applications leveraging LLMs, RAG architectures, and agentic AI workflows; Experience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI; Familiarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations; Knowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management; and Experience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms.
Where is the Senior AI Engineer - Agentic Systems role at IBM located?expand_more
Senior AI Engineer - Agentic Systems at IBM is based in 9, East 45th Street, Midtown, Manhattan Community Board 5, Manhattan, New York County, New York, 10017, United States. This is a on-site role.
Is this Senior AI Engineer - Agentic Systems job remote, hybrid, or on-site?expand_more
IBM has listed this Senior AI Engineer - Agentic Systems role as on-site.
How much experience is required for this Senior AI Engineer - Agentic Systems role?expand_more
Senior AI Engineer - Agentic Systems at IBM typically requires 7+ years of relevant experience at the senior level.
What skills do you need for the Senior AI Engineer - Agentic Systems role at IBM?expand_more
Key skills for Senior AI Engineer - Agentic Systems at IBM include Agentic Ai; Azure; Azure Openai; Prompt Engineering; Rag; Azure ML; Azure Ai Studio; and Langchain.
What category does the Senior AI Engineer - Agentic Systems role belong to?expand_more
Senior AI Engineer - Agentic Systems at IBM is part of the it job category on Recrutus.