Analyst, Lead Data Engineering
Not Disclosed•Full-TimeOn-site
location_onLight Company Road, Houston, Harris County, Texas, 77506, United States
About the Team
We are the largest publicly traded energy partnership, featuring one of the most diversified cash flow streams in the midstream segment of the energy industry. Our unique midstream energy organization fosters a creative and supportive environment with dynamic career opportunities. We value innovation and offer a platform where team members can share their ideas and be recognized for their contributions to our collective success.
About the Role
We are seeking an experienced Data Engineer to join our Big Data and Advanced Analytics department. In this role, you will partner closely with business domain experts to architect and build an Enterprise Data Lakehouse. This initiative is designed to support critical data analytic use cases across our midstream oil and gas operations, engineering, and measurements business units. Your work will be pivotal in integrating disparate data sources, ensuring data quality, and delivering trusted datasets that drive business objectives.
Work location
Work model: On-site
Light Company Road, Houston, Harris County, Texas, 77506, United States
Houston, Texas
Key Responsibilities
- check_circleDesign and implement reliable data pipelines to integrate disparate data sources into a Data Lakehouse
- check_circleDesign and implement data quality pipelines to ensure data correctness and build trusted datasets
- check_circleDesign and implement a Data Lakehouse solution that accurately reflects business operations
Similar Job Opportunities
Frequently asked questions about Analyst, Lead Data Engineering at Epco Corp
What does a Analyst, Lead Data Engineering at Epco Corp do?expand_more
A Analyst, Lead Data Engineering at Epco Corp is responsible for the following: Design and implement reliable data pipelines to integrate disparate data sources into a Data Lakehouse; Design and implement data quality pipelines to ensure data correctness and build trusted datasets; Design and implement a Data Lakehouse solution that accurately reflects business operations; and Assist with data platform performance tuning and physical data model support including partitioning and compaction.
What are the requirements for this Analyst, Lead Data Engineering role?expand_more
To qualify for the Analyst, Lead Data Engineering at Epco Corp position, applicants should have: 5 years of experience as a Data Engineer; 5 years of programming experience in Python and SQL; 5 years in software development lifecycle experience; Experience with Python Data Engineering packages (pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, Boto3); Experience implementing a Data Lakehouse using Apache Iceberg or Delta Lake; and Experience with data platform architecture.
Where is the Analyst, Lead Data Engineering role at Epco Corp located?expand_more
Analyst, Lead Data Engineering at Epco Corp is based in Light Company Road, Houston, Harris County, Texas, 77506, United States. This is a on-site role.