Senior Big Data Engineer
Not Disclosed•ContractorOn-site
location_on1151, Morse Street Northeast, Trinidad, Ward 5, Washington, District of Columbia, 20002, United States
About the Role
We are seeking an experienced Senior Big Data Engineer to design, develop, and optimize enterprise data platforms, data pipelines, and analytics solutions. This role is critical for expanding and enhancing our data architecture capabilities, enabling the efficient ingestion, organization, processing, and visualization of large-scale data assets. The ideal candidate combines strong data engineering expertise with hands-on experience in database design, data modeling, cloud technologies, and scalable data processing frameworks.
In this onsite position based in Washington, DC, you will collaborate with business stakeholders, analysts, researchers, and technical teams to understand complex data requirements and deliver effective solutions. Your day-to-day will involve building and automating ETL/ELT workflows, performing root cause analysis on data issues, and supporting the migration of data pipelines between on-premises and cloud environments. You will also contribute to the software development lifecycle, ensuring the deployment of robust data applications and services while implementing best practices for data governance, quality, and security.
Work location
Work model: On-site
1151, Morse Street Northeast, Trinidad, Ward 5, Washington, District of Columbia, 20002, United States
Washington, District of Columbia
Key Responsibilities
- check_circleDesign, develop, and maintain enterprise data architectures, databases, data lakes, and scalable data platforms
- check_circleBuild, optimize, and automate ETL/ELT workflows and data integration pipelines
- check_circleDevelop and maintain scalable data processing frameworks for high-volume structured and unstructured data
- check_circleCollaborate with stakeholders to understand data requirements and deliver effective solutions
- check_circleImprove existing data systems to increase performance, reliability, and scalability
- check_circleDesign and implement optimal data delivery architectures to support analytics and reporting
- check_circleSupport migration of data pipelines and workflows between on-premises and cloud environments
- check_circleImplement data governance, quality, security, and operational best practices
- check_circleContribute to software development lifecycle activities including testing, deployment, and maintenance
- check_circleDesign and communicate enterprise information architecture at conceptual, logical, and physical levels
- check_circlePerform root cause analysis on data issues and business processes to identify improvements
Requirements
- verifiedBachelor's degree in Computer Science, Information Technology, Engineering, or related field
- verifiedMinimum 7 years experience in data engineering, data architecture, or database administration
- verifiedAdvanced proficiency in SQL
- verifiedExperience with PostgreSQL, Microsoft SQL Server, and MySQL
- verifiedAdvanced programming experience with Python, R, and scripting languages
- verifiedExperience with large-scale data systems and distributed computing
- verifiedExperience designing and automating ETL/ELT workflows
- verifiedExperience building and maintaining scalable databases and data pipelines
- verifiedStrong software engineering background
- verifiedExperience in Linux environments
- verifiedExperience with GitHub and GitLab
Nice to Have
Advanced degree in a technical discipline. Experience with workflow orchestration and automation tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions. Experience with cloud platforms including AWS, Microsoft Azure, and Snowflake. Experience implementing data warehouses utilizing Change Data Capture (CDC) methodologies. Experience implementing and maintaining CI/CD pipelines and DataOps practices. Experience with NoSQL and graph database technologies. Experience developing, training, deploying, and maintaining machine learning models. Knowledge of time-series data management, analytics, and forecasting techniques. Experience integrating structured and unstructured data sources. Working knowledge of additional programming languages such as Java, Scala, JavaScript, or Perl. Experience supporting analytics, research, financial, scientific, or data-intensive environments.
Similar Job Opportunities
Data Engineer Senior
HealthPartners • Bloomington, Minnesota
Not Disclosedarrow_forward
Database Administrator with Security Clearance
Barbaricum • Newport News, Virginia
Not Disclosedarrow_forward
Data Center Manager with Security Clearance
Computer World Services Corp. (CWS) • Morrisville, North Carolina
Not Disclosedarrow_forward
Skills, education and keywords
Skills: SQL, Postgresql, Microsoft SQL Server, MYSQL, Python, R, Linux, Github, Gitlab, Apache Airflow.
Education: Bachelor's degree in Computer Science, IT, Engineering, or related field required.
Frequently asked questions about Senior Big Data Engineer at Stellent IT
What does a Senior Big Data Engineer at Stellent IT do?expand_more
Day-to-day, the Senior Big Data Engineer at Stellent IT will design, develop, and maintain enterprise data architectures, databases, data lakes, and scalable data platforms; build, optimize, and automate etl/elt workflows and data integration pipelines; develop and maintain scalable data processing frameworks for high-volume structured and unstructured data; and collaborate with stakeholders to understand data requirements and deliver effective solutions.
What are the requirements for this Senior Big Data Engineer role?expand_more
To qualify for the Senior Big Data Engineer at Stellent IT position, applicants should have: Bachelor's degree in Computer Science, Information Technology, Engineering, or related field; Minimum 7 years experience in data engineering, data architecture, or database administration; Advanced proficiency in SQL; Experience with PostgreSQL, Microsoft SQL Server, and MySQL; Advanced programming experience with Python, R, and scripting languages; and Experience with large-scale data systems and distributed computing.
Where is the Senior Big Data Engineer role at Stellent IT located?expand_more
Senior Big Data Engineer at Stellent IT is based in 1151, Morse Street Northeast, Trinidad, Ward 5, Washington, District of Columbia, 20002, United States. This is a on-site role.
Is this Senior Big Data Engineer job remote, hybrid, or on-site?expand_more
Stellent IT has listed this Senior Big Data Engineer role as on-site.
How much experience is required for this Senior Big Data Engineer role?expand_more
Senior Big Data Engineer at Stellent IT typically requires 7+ years of relevant experience at the senior level.
What skills do you need for the Senior Big Data Engineer role at Stellent IT?expand_more
Key skills for Senior Big Data Engineer at Stellent IT include SQL; Postgresql; Microsoft SQL Server; MYSQL; Python; R; Linux; and Github.
What education is required for Senior Big Data Engineer at Stellent IT?expand_more
Educational requirements for this role: Bachelor's degree in Computer Science, IT, Engineering, or related field required.
What category does the Senior Big Data Engineer role belong to?expand_more
Senior Big Data Engineer at Stellent IT is part of the it job category on Recrutus.
About Stellent IT
We are a US based recruiting company.
Browse more roles: All Stellent IT jobs, it jobs on Recrutus.