Senior Data Engineer — Charlotte, NC at Smart Caliber

About the Team

We are a growing Data & AI team dedicated to transforming how our enterprise leverages information. Our mission is to build scalable, reliable data infrastructure that serves as the foundation for advanced AI and agentic systems. We operate with a focus on financial domain expertise, ensuring that our data governance and quality standards meet the rigorous demands of the industry while driving innovation in autonomous reasoning and planning.

About the Role

As a Senior Data Engineer specializing in GenAI and Agentic AI, you will bridge the gap between traditional data engineering and the cutting edge of artificial intelligence. This role exists to evolve our enterprise data platform from a passive repository into an active, intelligent engine. You will design and maintain the pipelines that feed autonomous agents, enabling them to reason, plan, and execute complex tasks with high reliability.

In this position, you will not only architect robust data models and real-time processing streams but also integrate Large Language Models (LLMs) directly into our workflows. Your day-to-day involves orchestrating multi-agent systems, managing memory and feedback loops for AI agents, and ensuring that our vector databases and RAG architectures are optimized for performance. You will collaborate closely with Data Science and Machine Learning teams to productionize solutions that leverage self-refinement mechanisms and intelligent automation.

Location & Work Model

This is an onsite role based in Charlotte, NC. Being part of the team in person fosters the close collaboration necessary for complex system design and rapid iteration on agentic workflows.

Hiring Process

Initial Screening: A 30-minute conversation to discuss your background in data engineering and interest in GenAI.
Technical Deep-Dive: A detailed review of your experience with distributed processing frameworks (Spark/Databricks) and AI integration patterns.
System Design & Fit: A session focused on designing data solutions for agentic systems and assessing team alignment.
Offer: Finalization of the offer for the successful candidate.

Equal Opportunity Employer

We are committed to building a diverse and inclusive team. We consider qualified applicants regardless of race, color, religion, sex, national origin, age, disability, veteran status, or any other protected characteristic.

Work location

Work model: On-site

129 West Trade, 129, West Trade Street, Uptown, Charlotte, Mecklenburg County, North Carolina, 28202, United States

Charlotte, North Carolina

Key Responsibilities

check_circleDesign and maintain scalable data pipelines for batch and real-time processing
check_circleBuild robust data models, schemas, and transformations for analytics and AI workloads
check_circleEnsure data quality, reliability, lineage, observability, and governance across the ecosystem
check_circleImplement tool integration, memory management, and self-refinement mechanisms for AI agents
check_circleArchitect and manage multi-agent workflows, orchestration frameworks, and task decomposition strategies
check_circleIntegrate Large Language Models into data pipelines for intelligent reasoning and automation
check_circleDevelop AI architectures leveraging RAG, vector embeddings, and prompt engineering
check_circlePartner with Data Science and ML teams to productionize agent-driven solutions
check_circle

Requirements

verified4+ years of experience in Data Engineering, Data Platforms, or a related field
verifiedStrong proficiency in SQL and Python
verifiedHands-on experience with Apache Spark and/or Databricks
verifiedExperience working with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP)
verifiedFamiliarity with Large Language Models (LLMs), vector databases, AI/ML pipelines, and modern AI ecosystems

Nice to Have

Experience building Agentic AI or Multi-Agent AI systems. Knowledge of RAG architectures, vector embeddings, prompt engineering, and LLM application development. Experience with AI orchestration frameworks such as LangChain, LlamaIndex, CrewAI, AutoGen, or similar technologies. Exposure to MLOps, AI deployment pipelines, and production AI systems.

Company

Smart Caliber Technology

Industry

Staffing and Recruiting

Headquarters

Naperville, Illinois

Truth Lies in Heart

Smart Caliber Technology operates as a global Information Technology sourcing and services firm headquartered in Naperville, Illinois. The organization delivers comprehensive solutions across the full IT spectrum, utilizing onsite, offsite, and offshore delivery models to support enterprises of varying sizes. Its core offerings include software solutions, professional services, and outsourcing capabilities tailored to diverse business domains and technological requirements. The company specializes in staffing services, leveraging a team of experienced technical recruiters available around the clock to address urgent client needs. Key operational strengths include rapid response times, cost-effective pricing structures, and flexible engagement durations ranging from weeks to years. All placed professionals undergo rigorous pre-screening for technical and communication abilities, followed by thorough background checks that include reference and drug use verifications. A two-week performance guarantee is provided to ensure client satisfaction. Smart Caliber Technology maintains a robust database of thousands of pre-screened consultants, with a significant presence in North America. These skilled professionals are prepared for immediate deployment to locations worldwide and are willing to relocate for reasonable assignment periods. The firm prioritizes structured hiring and onboarding processes, including continuous skill upgrades to improve employee retention and maintain high performance standards across all service lines.

Frequently asked questions about Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology

What does a Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology do?expand_more

A Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology is responsible for the following: Design and maintain scalable data pipelines for batch and real-time processing; Build robust data models, schemas, and transformations for analytics and AI workloads; Ensure data quality, reliability, lineage, observability, and governance across the ecosystem; and Implement tool integration, memory management, and self-refinement mechanisms for AI agents.

What are the requirements for this Senior Data Engineer GenAI & Agentic AI With Financial Domain role?expand_more

Smart Caliber Technology is looking for candidates who meet the following requirements: 4+ years of experience in Data Engineering, Data Platforms, or a related field; Strong proficiency in SQL and Python; Hands-on experience with Apache Spark and/or Databricks; Experience working with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP); and Familiarity with Large Language Models (LLMs), vector databases, AI/ML pipelines, and modern AI ecosystems.

Where is the Senior Data Engineer GenAI & Agentic AI With Financial Domain role at Smart Caliber Technology located?expand_more

Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology is based in 129 West Trade, 129, West Trade Street, Uptown, Charlotte, Mecklenburg County, North Carolina, 28202, United States. This is a on-site role.

Is this Senior Data Engineer GenAI & Agentic AI With Financial Domain job remote, hybrid, or on-site?expand_more

Smart Caliber Technology has listed this Senior Data Engineer GenAI & Agentic AI With Financial Domain role as on-site.

How much experience is required for this Senior Data Engineer GenAI & Agentic AI With Financial Domain role?expand_more

Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology typically requires 4+ years of relevant experience at the senior level.

What skills do you need for the Senior Data Engineer GenAI & Agentic AI With Financial Domain role at Smart Caliber Technology?expand_more

Key skills for Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology include SQL; Python; Apache Spark; Databricks; Aws; Azure; Google Cloud Platform; and Large Language Models.

What category does the Senior Data Engineer GenAI & Agentic AI With Financial Domain role belong to?expand_more

Senior Data Engineer GenAI & Agentic AI With Financial Domain at Smart Caliber Technology is part of the it job category on Recrutus.

About Smart Caliber Technology

The company specializes in staffing services, leveraging a team of experienced technical recruiters available around the clock to address urgent client needs. Key operational strengths include rapid response times, cost-effective pricing structures, and flexible engagement durations ranging from weeks to years. All placed professionals undergo rigorous pre-screening for technical and communication abilities, followed by thorough background checks that include reference and drug use verifications. A two-week performance guarantee is provided to ensure client satisfaction.

Smart Caliber Technology maintains a robust database of thousands of pre-screened consultants, with a significant presence in North America. These skilled professionals are prepared for immediate deployment to locations worldwide and are willing to relocate for reasonable assignment periods. The firm prioritizes structured hiring and onboarding processes, including continuous skill upgrades to improve employee retention and maintain high performance standards across all service lines.

Browse more roles: All Smart Caliber Technology jobs, it jobs on Recrutus.

Senior Data Engineer GenAI & Agentic AI With Financial Domain