.NET & Spark Developer
Not Disclosed•ContractorOn-site
location_on342, Chicago Avenue South, Downtown East, Central, Minneapolis, Hennepin County, Minnesota, 55415, United States
About the Role
We are seeking a highly skilled Software Engineer to join our team on a contingent basis in Minneapolis, Minnesota. This role is designed to consult on complex initiatives and address large-scale software engineering challenges, specifically focusing on the strategic migration of SSIS ETL pipelines to Apache Spark and Spark Flow.
You will collaborate strategically with client personnel to support a portfolio of enterprise applications and data platforms. Your day-to-day will involve supporting data lake processes, including ingestion and access management, while providing application support for approximately 15 systems. You will also assist with data center migration impacts, build and maintain APIs using .NET and Python FastAPI, and develop frontend components in React and Angular. The position requires working within containerized environments like Docker and Kubernetes, supported by CI/CD pipelines using GitHub Actions.
Work location
Work model: On-site
342, Chicago Avenue South, Downtown East, Central, Minneapolis, Hennepin County, Minnesota, 55415, United States
Minneapolis, Minnesota
Key Responsibilities
- check_circleMigrate SSIS ETL pipelines to Apache Spark and Spark Flow
- check_circleSupport data lake processes including ingestion, file handling, and access management
- check_circleProvide application support for approximately 15 systems with troubleshooting and enhancements
- check_circleBuild and maintain APIs using .NET and Python FastAPI
- check_circleDevelop and support frontend components in React and Angular
- check_circleSupport CI/CD pipelines using GitHub Actions
- check_circleWork in containerized environments such as Docker and Kubernetes
- check_circleAssist with data center migration impacts across applications
Requirements
- verified5 years of Software Engineering experience
- verifiedProficiency in Apache Spark/Spark Flow
- verifiedExperience with SSIS or similar ETL tools
- verifiedStrong .NET C# development skills
- verifiedProficiency in Python and FastAPI
- verifiedExperience with SQL Server
- verifiedFrontend development experience in React and/or Angular
- verifiedFamiliarity with GitHub Actions
- verifiedExperience with Docker and Kubernetes
Nice to Have
Experience with MongoDB. Proficiency in Java. Experience with data lake or large-scale migration projects.
Benefits & Perks
check_circleMedical, dental, and vision insurancecheck_circle401K contributionscheck_circlePaid time off and sick leave
Similar Job Opportunities
Frequently asked questions about .NET & Spark Developer at Mt. Diablo Resource Recovery
What does a .NET & Spark Developer at Mt. Diablo Resource Recovery do?expand_more
In this .NET & Spark Developer at Mt. Diablo Resource Recovery role, you will migrate ssis etl pipelines to apache spark and spark flow; support data lake processes including ingestion, file handling, and access management; provide application support for approximately 15 systems with troubleshooting and enhancements; and build and maintain apis using .net and python fastapi.
What are the requirements for this .NET & Spark Developer role?expand_more
To qualify for the .NET & Spark Developer at Mt. Diablo Resource Recovery position, applicants should have: 5 years of Software Engineering experience; Proficiency in Apache Spark/Spark Flow; Experience with SSIS or similar ETL tools; Strong .NET C# development skills; Proficiency in Python and FastAPI; and Experience with SQL Server.
Where is the .NET & Spark Developer role at Mt. Diablo Resource Recovery located?expand_more
.NET & Spark Developer at Mt. Diablo Resource Recovery is based in 342, Chicago Avenue South, Downtown East, Central, Minneapolis, Hennepin County, Minnesota, 55415, United States. This is a on-site role.
Is this .NET & Spark Developer job remote, hybrid, or on-site?expand_more
Mt. Diablo Resource Recovery has listed this .NET & Spark Developer role as on-site.
How much experience is required for this .NET & Spark Developer role?expand_more
.NET & Spark Developer at Mt. Diablo Resource Recovery typically requires 5+ years of relevant experience at the senior level.
What skills do you need for the .NET & Spark Developer role at Mt. Diablo Resource Recovery?expand_more
Key skills for .NET & Spark Developer at Mt. Diablo Resource Recovery include Ssis; Apache Spark; Spark Flow; .net; Python; Fastapi; React; and Angular.
What category does the .NET & Spark Developer role belong to?expand_more
.NET & Spark Developer at Mt. Diablo Resource Recovery is part of the it job category on Recrutus.