Big Data Engineering Leads

Apply Now

Company: Circana

Location: Chicago, IL 60629

Description:

Job Title: Big Data Engineering Leads

Job Location: Various and unanticipated worksites throughout the U.S. (HQ: Chicago, IL).

Job Type: Full-Time

FP&A - Liz Leeds

Job Duties

Big Data Engineering Leads for various and unanticipated worksites throughout the U.S. (HQ: Chicago, IL). Design, develop, and maintain highly scalable ETL applications on Hadoop to support our data factory pipelines. Lead a team of big data engineers, participating in or leading projects to continue evolving our datasets and ensuring on-time delivery of projects that perform according to our best-in-class software development lifecycle. Lead the development of new scripts, tools, and methodologies for streamlining and automating ETL workflows. Lead and deliver big data projects using Spark, Python, Scala, SQL, and Hive. Oversee the design and creation of use-cases and scenarios for functional testing, integration testing, and system testing. Actively lead and participate in daily agile/scrum meetings and code reviews and coordinate with cross-functional operational teams for managing data delivery.

Job Requirements

Master's degree in Computer Science, Computer Engineering, Information Systems/Technology or related field plus three years of experience in senior data engineering or ETL development roles or as a solution analyst required. Required skills: Software development, leading/managing a team of 4+ developers, writing ETL Spark applications in PySpark or Scala, working in big data environments and developing data driven, analytical applications, Spark architecture, Data frames, Tuning spark, Relational databases (Oracle, PostgreSQL). Telecommuting permitted. $135,000/yr-$160,000/yr.

The below range reflects the range of possible compensation for this role at the time of this posting. This range may be modified in the future. An employee's position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, shift, travel requirements, sales or revenue-based metrics, any collective bargaining agreements, and business or organizational needs. The salary range for this role is $135,000/yr - $160,000/yr.

#LI-DNI

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)

Similar Jobs