AI Agent Developer and Tester
Not Disclosed•Full-TimeOn-site
location_onPaxton Avenue, Ballpark, Salt Lake City, Salt Lake County, Utah, 84111, United States
About the Role
Kforce is representing a client in Salt Lake City seeking an AI/Agent Developer & Tester to design, build, and validate LangGraph-based agent workflows within the APEX platform. This role is highly execution-focused, offering ownership of the testing strategy, quality, and reliability across AI agent systems. From unit-level validation through end-to-end workflows and production monitoring, the successful candidate will ensure agent accuracy, stability, and scalability within a non-deterministic LLM environment.
The position drives comprehensive test coverage across backend workflows and UI experiences. You will establish LLM testing frameworks, manage flaky test mitigation, and enforce regression discipline to ensure every defect is paired with a test before release. Additionally, you will validate structured outputs and ensure production observability of agent behavior and performance.
Hiring Process
By clicking "Apply Today," you agree to receive calls, AI-generated calls, text messages, or emails from Kforce and its affiliates, as well as service providers. Please note that if you choose to communicate via text messaging, the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You always have the right to cease communicating via text by using keywords such as STOP.
Equal Opportunity
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Work location
Work model: On-site
Paxton Avenue, Ballpark, Salt Lake City, Salt Lake County, Utah, 84111, United States
Salt Lake City, Utah
Key Responsibilities
- check_circleDesign and implement AI agent workflows using LangGraph and LangChain
- check_circleOwn end-to-end testing strategy for node-level and graph-level validation
- check_circleEstablish LLM testing frameworks with mocking and deterministic validation strategies
- check_circleBuild and maintain E2E test coverage using Playwright across APEX portals
- check_circleManage flaky test mitigation through controlled seeds and assertion thresholds
- check_circleEnsure production observability of agent behavior and performance
- check_circleSupport and manage cloud infrastructure on Google Cloud Platform
- check_circleValidate structured outputs and enforce JSON schema compliance
Requirements
- verifiedHands-on experience with LangGraph and/or LangChain
- verifiedStrong Python development skills including pytest and pytest-asyncio
- verifiedExperience testing AI/LLM-driven systems
- verifiedExperience implementing LLM mocking strategies
- verifiedExperience with Playwright or similar E2E UI testing tools
- verifiedFamiliarity with structured data validation (JSON schema)
- verifiedExperience with Google Cloud Platform
- verifiedExperience with LangSmith, RAGAS, or similar evaluation tools
- verifiedExperience with prompt versioning and lifecycle management
- verifiedExperience with adversarial/red-team testing of LLM systems
- verifiedExperience with token usage and cost instrumentation
- verifiedExperience with document processing or OCR pipelines
- verifiedBackground in financial services or regulated environments
- verifiedExperience with Terraform
- verifiedExperience with Azure DevOps pipelines
Nice to Have
Experience with Google Cloud Platform (Cloud Run), Terraform, and Azure DevOps pipelines.
Benefits & Perks
check_circleMedical, dental, and vision insurancecheck_circle401(k) retirement plancheck_circleLife insurancecheck_circleDisability insurancecheck_circlePaid time off for salaried personnelcheck_circlePaid sick leave for hourly employees on Service Contract Act projects
Similar Job Opportunities
Frequently asked questions about AI Agent Developer and Tester at Kforce Inc
What does a AI Agent Developer and Tester at Kforce Inc do?expand_more
Day-to-day, the AI Agent Developer and Tester at Kforce Inc will design and implement ai agent workflows using langgraph and langchain; own end-to-end testing strategy for node-level and graph-level validation; establish llm testing frameworks with mocking and deterministic validation strategies; and build and maintain e2e test coverage using playwright across apex portals.
What are the requirements for this AI Agent Developer and Tester role?expand_more
Kforce Inc is looking for candidates who meet the following requirements: Hands-on experience with LangGraph and/or LangChain; Strong Python development skills including pytest and pytest-asyncio; Experience testing AI/LLM-driven systems; Experience implementing LLM mocking strategies; Experience with Playwright or similar E2E UI testing tools; and Familiarity with structured data validation (JSON schema).
Where is the AI Agent Developer and Tester role at Kforce Inc located?expand_more
AI Agent Developer and Tester at Kforce Inc is based in Paxton Avenue, Ballpark, Salt Lake City, Salt Lake County, Utah, 84111, United States. This is a on-site role.
Is this AI Agent Developer and Tester job remote, hybrid, or on-site?expand_more
Kforce Inc has listed this AI Agent Developer and Tester role as on-site.
How much experience is required for this AI Agent Developer and Tester role?expand_more
Candidates for AI Agent Developer and Tester at Kforce Inc should have mid level.
What skills do you need for the AI Agent Developer and Tester role at Kforce Inc?expand_more
Key skills for AI Agent Developer and Tester at Kforce Inc include Langgraph; Langchain; Python; Pytest; Pytest-Asyncio; Playwright; Json Schema; and Google Cloud Platform.
What category does the AI Agent Developer and Tester role belong to?expand_more
AI Agent Developer and Tester at Kforce Inc is part of the it job category on Recrutus.