Senior Data Engineer
Apply NowCompany: TriOptus LLC
Location: Malvern, PA 19355
Description:
Role Summary:
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.
Required Skills : Data Analysis,Data Warehouse
Basic Qualification :
Additional Skills : Data Engineer
Background Check : No
Drug Screen : No
The Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect's data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading a team of Data Engineers and Analysts, optimizing ETL processes, and supporting the data structure required for robust analytics.
Key Responsibilities:
Lead the development of data pipelines using AWS Glue and PySpark, transforming data from raw to analytics-ready stages.
Collaborate with the Data Architect to implement data models and ensure data integrity.
Oversee the work of Data Engineers, providing technical guidance and ensuring adherence to best practices.
Monitor and optimize data processing workflows, ensuring efficient resource usage.
Skills and Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field.
7+ years of experience in data engineering, with a focus on AWS Glue and PySpark.
Strong skills in SQL and data pipeline development.
Experience leading data engineering teams and optimizing ETL workflows.
Required Skills : Data Analysis,Data Warehouse
Basic Qualification :
Additional Skills : Data Engineer
Background Check : No
Drug Screen : No