Senior AI Engineer - Agentic Systems
Not Disclosed•Full-TimeOn-site
location_onOutpatient Care Center, 1801, West Taylor Street, Illinois Medical District, Near West Side, Chicago, West Chicago Township, Cook County, Illinois, 60612, United States
About IBM Consulting
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact.
At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
About the Role
We are seeking a skilled AI Engineer to join an active enterprise AI engagement in a hands-on, client-facing capacity. This is a senior individual contributor role requiring deep technical proficiency in Agentic AI. You will be expected to operate independently, interact directly with the client, and deliver with minimal oversight.
In this role, you will build, fine-tune, and operationalize AI solutions on Azure, with a specific focus on agentic workflows, prompt engineering, RAG pipelines, and production-grade model deployment. The client expects a high-caliber engineer who can perform from day one. You will design and deploy agentic AI workflows and multi-agent systems, optimizing prompt engineering strategies to maximize model performance. Your work will involve building Retrieval-Augmented Generation (RAG) pipelines that enable grounded, context-aware AI responses and implementing agent orchestration patterns including tool calling, memory management, and human-in-the-loop workflows.
Beyond technical execution, you will engage directly with client stakeholders to gather requirements, demo capabilities, and walk through technical solutions. You will communicate clearly on progress, blockers, and technical tradeoffs, collaborating with architects, data engineers, and business teams to ensure seamless end-to-end integration.
Equal Opportunity
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Work location
Work model: On-site
Outpatient Care Center, 1801, West Taylor Street, Illinois Medical District, Near West Side, Chicago, West Chicago Township, Cook County, Illinois, 60612, United States
Chicago, Illinois
Key Responsibilities
- check_circleDesign and deploy agentic AI workflows and multi-agent systems using Azure OpenAI
- check_circleDevelop and optimize prompt engineering strategies to maximize model performance
- check_circleBuild and maintain Retrieval-Augmented Generation (RAG) pipelines for context-aware responses
- check_circleImplement agent orchestration patterns including tool calling and memory management
- check_circleEngage directly with client stakeholders to gather requirements and demo technical solutions
- check_circleDeploy and manage AI models using Azure ML and Azure AI Studio services
- check_circleIntegrate AI capabilities into enterprise applications via APIs and microservices
- check_circleEstablish monitoring and evaluation loops to ensure ongoing model reliability in production
Requirements
- verified7+ years designing, developing, and deploying scalable AI applications leveraging LLMs, RAG architectures, and agentic AI workflows
- verifiedExperience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI
- verifiedFamiliarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations
- verifiedKnowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management
- verifiedExperience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms
Nice to Have
Experience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI. Familiarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations. Knowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management. Experience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms.
Similar Job Opportunities
Frequently asked questions about Senior AI Engineer - Agentic Systems at IBM
What does a Senior AI Engineer - Agentic Systems at IBM do?expand_more
Day-to-day, the Senior AI Engineer - Agentic Systems at IBM will design and deploy agentic ai workflows and multi-agent systems using azure openai; develop and optimize prompt engineering strategies to maximize model performance; build and maintain retrieval-augmented generation (rag) pipelines for context-aware responses; and implement agent orchestration patterns including tool calling and memory management.
What are the requirements for this Senior AI Engineer - Agentic Systems role?expand_more
IBM is looking for candidates who meet the following requirements: 7+ years designing, developing, and deploying scalable AI applications leveraging LLMs, RAG architectures, and agentic AI workflows; Experience with agentic frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or CrewAI; Familiarity with vector databases (e.g., Azure AI Search, Pinecone, Weaviate) for RAG implementations; Knowledge of MLOps practices and CI/CD pipelines for AI model deployment and lifecycle management; and Experience with enterprise integration patterns and connecting AI solutions to CRMs, ERPs, or data platforms.
Where is the Senior AI Engineer - Agentic Systems role at IBM located?expand_more
Senior AI Engineer - Agentic Systems at IBM is based in Outpatient Care Center, 1801, West Taylor Street, Illinois Medical District, Near West Side, Chicago, West Chicago Township, Cook County, Illinois, 60612, United States. This is a on-site role.
Is this Senior AI Engineer - Agentic Systems job remote, hybrid, or on-site?expand_more
IBM has listed this Senior AI Engineer - Agentic Systems role as on-site.
How much experience is required for this Senior AI Engineer - Agentic Systems role?expand_more
Senior AI Engineer - Agentic Systems at IBM typically requires 7+ years of relevant experience at the senior level.
What skills do you need for the Senior AI Engineer - Agentic Systems role at IBM?expand_more
Key skills for Senior AI Engineer - Agentic Systems at IBM include Agentic Ai; Azure; Azure Openai; Prompt Engineering; Rag; Azure ML; Azure Ai Studio; and Langchain.
What category does the Senior AI Engineer - Agentic Systems role belong to?expand_more
Senior AI Engineer - Agentic Systems at IBM is part of the it job category on Recrutus.