Senior Data Engineer - Hybrid
Apply NowCompany: Acosta Sales & Marketing
Location: Rogers, AR 72756
Description:
Job Description
The Senior Data Engineer role reports to the Manager, Data Engineering. The role is part of our Enterprise Data Platform team that manages the ingestion, storage, modeling, and consumption of data for Acosta and our clients. The ideal candidate will have extensive experience in data engineering, strong proficiency in Azure, Databricks, Snowflake knowledge, and a proven track record of working on large-scale data projects. Candidate must have strong communications skills and ability to collaborate with technical and nontechnical audience. The role is responsible for supporting workloads running on the Azure Big Data environment and associated technologies. This position will be responsible for designing, creating, and monitoring the data solutions, resolving incidents, optimizing workloads, tuning solutions, and making solution enhancements. The role will focus on development and production support and will be involved in R&D of emerging technologies with the application administrators and technical architects.
Responsibilities
Essential Functions of this Position
Building data ingestion and ETL pipelines at an enterprise level, following corporate standards and best practices
Work with Tech Leads and Architects to understand and implement solutions based on high level designs and requirements
Stay current with big data, ETL and general data technologies, with a strong focus on the Azure technology stack
Investigate new and emerging technologies based on future needs of the Data Platform and architectural direction
Monitoring, investigating, and maintaining ongoing production systems, specifically triggered and schedule ETL pipelines and data ingestion patterns
Optimization and refactoring of existing platform and legacy solutions
Migration of legacy systems into a modern data platform
Mentor Data Engineers on the Data Platform team
Other duties as assigned
Qualifications
Minimum Education and Work Experience
Bachelor's degree in Technology Industry is preferred, or equivalent related work experience may be substituted for some of the educational requirements
8 years of related work experience
Knowledge, Skills, and Abilities Requirements
5+years developing and supporting applications leveraging a big data stack (such as Azure)
5+years of experience with data integration/ETL tools such as Azure Data Factory or alternatives
3+years of experience with SDLC knowledge in both waterfall and agile methodologies
2+years of experience on following tools: SQL, Scala, Python, Spark, Kafka, and other related languages
Experience in scripting languages & automation such as bash and Python
Hands-on experience with source code management system (SVN, Git) and continuous integration tools (Azure Devops or alternatives)
Experience with Snowflake Technology Stack strongly preferred
Experience with Data Modelling strongly preferred
Experience in data warehousing (Data Vault methodology preferred)
Experience in handling data processing, delivering distributed and highly scalable applications
Experience with high-volume, transaction processing software applications
Good understanding of workload management, schedulers, scalability, and distributed platform architectures
Excellent communication skills (both written and oral) combined with strong interpersonal skills
Strong analytical skills and thought processes combined with the ability to be flexible and work analytically in a problem-solving environment
About Us
Acosta and Mosaic are the sales and marketing powerhouses behind the most recognized and proven brands with top retailers in the United States and Canada. We offer flexible services that maximize efficiency. Acosta has the talent and technology to build data-, reach- and relationship-driven strategies to execute those strategies, and the tools to monitor, track and optimize metrics-based results for customers and retailers.
The Acosta Group, in good faith, believes that this posted range of compensation is the accurate range for this role at the time of this posting. The Acosta Group may ultimately pay more or less than the posted range depending on candidate qualifications and locations. This range may be modified in the future.
The above statements are intended to describe the general nature and level of work being performed by people assigned to this classification. They are not intended to be construed as an exhaustive list of all responsibilities, duties, and skills required of personnel so classified. The Acosta Group reserves the right to modify all or part of any job descriptions at its discretion in order to meet and or exceed the needs of the business.
The Acosta Group, in good faith, believes that this posted range of compensation is the accurate range for this role at the time of this posting. The Acosta Group may ultimately pay more or less than the posted range depending on candidate qualifications and locations. This range may be modified in the future.
The Acosta Group utilizes E-Verify for validating the ability to work in the United States for all job candidates. If you want more information on what this entails and your rights as a job applicant, please use the link provided to access information on our use of E-Verify and your right to work. Employer Resources (e-verify.gov)
The Acosta Group is an Equal Opportunity Employer.
We are committed to providing accommodations for persons with disabilities. If you require accommodation, please contact EmployeeS[redacted], we will work with you to meet your needs, to the extent required by law.
By submitting your application, you agree with and accept the Acosta Privacy Statement and Terms of Conditions.
The Senior Data Engineer role reports to the Manager, Data Engineering. The role is part of our Enterprise Data Platform team that manages the ingestion, storage, modeling, and consumption of data for Acosta and our clients. The ideal candidate will have extensive experience in data engineering, strong proficiency in Azure, Databricks, Snowflake knowledge, and a proven track record of working on large-scale data projects. Candidate must have strong communications skills and ability to collaborate with technical and nontechnical audience. The role is responsible for supporting workloads running on the Azure Big Data environment and associated technologies. This position will be responsible for designing, creating, and monitoring the data solutions, resolving incidents, optimizing workloads, tuning solutions, and making solution enhancements. The role will focus on development and production support and will be involved in R&D of emerging technologies with the application administrators and technical architects.
Responsibilities
Essential Functions of this Position
Building data ingestion and ETL pipelines at an enterprise level, following corporate standards and best practices
Work with Tech Leads and Architects to understand and implement solutions based on high level designs and requirements
Stay current with big data, ETL and general data technologies, with a strong focus on the Azure technology stack
Investigate new and emerging technologies based on future needs of the Data Platform and architectural direction
Monitoring, investigating, and maintaining ongoing production systems, specifically triggered and schedule ETL pipelines and data ingestion patterns
Optimization and refactoring of existing platform and legacy solutions
Migration of legacy systems into a modern data platform
Mentor Data Engineers on the Data Platform team
Other duties as assigned
Qualifications
Minimum Education and Work Experience
Bachelor's degree in Technology Industry is preferred, or equivalent related work experience may be substituted for some of the educational requirements
8 years of related work experience
Knowledge, Skills, and Abilities Requirements
5+years developing and supporting applications leveraging a big data stack (such as Azure)
5+years of experience with data integration/ETL tools such as Azure Data Factory or alternatives
3+years of experience with SDLC knowledge in both waterfall and agile methodologies
2+years of experience on following tools: SQL, Scala, Python, Spark, Kafka, and other related languages
Experience in scripting languages & automation such as bash and Python
Hands-on experience with source code management system (SVN, Git) and continuous integration tools (Azure Devops or alternatives)
Experience with Snowflake Technology Stack strongly preferred
Experience with Data Modelling strongly preferred
Experience in data warehousing (Data Vault methodology preferred)
Experience in handling data processing, delivering distributed and highly scalable applications
Experience with high-volume, transaction processing software applications
Good understanding of workload management, schedulers, scalability, and distributed platform architectures
Excellent communication skills (both written and oral) combined with strong interpersonal skills
Strong analytical skills and thought processes combined with the ability to be flexible and work analytically in a problem-solving environment
About Us
Acosta and Mosaic are the sales and marketing powerhouses behind the most recognized and proven brands with top retailers in the United States and Canada. We offer flexible services that maximize efficiency. Acosta has the talent and technology to build data-, reach- and relationship-driven strategies to execute those strategies, and the tools to monitor, track and optimize metrics-based results for customers and retailers.
The Acosta Group, in good faith, believes that this posted range of compensation is the accurate range for this role at the time of this posting. The Acosta Group may ultimately pay more or less than the posted range depending on candidate qualifications and locations. This range may be modified in the future.
The above statements are intended to describe the general nature and level of work being performed by people assigned to this classification. They are not intended to be construed as an exhaustive list of all responsibilities, duties, and skills required of personnel so classified. The Acosta Group reserves the right to modify all or part of any job descriptions at its discretion in order to meet and or exceed the needs of the business.
The Acosta Group, in good faith, believes that this posted range of compensation is the accurate range for this role at the time of this posting. The Acosta Group may ultimately pay more or less than the posted range depending on candidate qualifications and locations. This range may be modified in the future.
The Acosta Group utilizes E-Verify for validating the ability to work in the United States for all job candidates. If you want more information on what this entails and your rights as a job applicant, please use the link provided to access information on our use of E-Verify and your right to work. Employer Resources (e-verify.gov)
The Acosta Group is an Equal Opportunity Employer.
We are committed to providing accommodations for persons with disabilities. If you require accommodation, please contact EmployeeS[redacted], we will work with you to meet your needs, to the extent required by law.
By submitting your application, you agree with and accept the Acosta Privacy Statement and Terms of Conditions.