Supervisor, Data Engineering

This is a pivotal role in leading and managing the data engineering team. It involves overseeing project execution, maintaining technical excellence, and fostering collaboration with cross-functional teams. This employee ensures data quality, manages resources efficiently, and drives process improvements; creates a conducive environment for innovation and growth by focusing on mentoring, risk management, and performance evaluation. Furthermore, the supervisor facilitates communication, documents processes, and provides strategic insights to enhance the team's impact and contribute to the organization's data-driven success. This employee will be comfortable with regular and collaborative interaction with business users.

JOB FUNCTIONS

• Gathers and analyzes business technical requirements
• Ensures a high degree of data quality from end to end across integrations
• Maintains and supports existing ETL processes
• Works with the development team and data stewards to create the business and data quality rules
• Collaborates with stakeholders including data, design, product, and executive teams and assists them with data-related technical issues
• Creates and maintains documentation on integration processes, execution procedures, data profiling results, data dictionaries, business glossaries, and data analysis findings
• Works with 3rd party data providers and APIs to pull data into Microsoft SQL Server
• Writes, tests, and troubleshoots complex SQL queries, stored procedures, and ETL processes
• Allocates resources and monitors project progress
• Participates in method development, process improvement, and standardization
• Continuously develops professional skills to use most effective approaches/methods/technologies
• Prepares reports on team performance and project status
• Fosters a culture of continuous learning and skill development

Job Responsibilities:

• Gather and analyze business technical requirements
• Ensure a high degree of data quality from end to end across integrations
• Maintain and support existing ETL processes
• Work with the development team and data stewards to create the business and data quality rules
• Collaborate with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues
• Create and maintain documentation on integration processes, execution procedures, data profiling results, data dictionaries, business glossaries, and data analysis findings
• Work with 3rd party data providers and API's to pull data into Microsoft SQL Server
• Write, test, and troubleshoot complex SQL queries, stored procedures, and ETL processes
• Allocate resources and monitor project progress
• Participate in method development, process improvement, and standardization
• Continuously develop professional skills to use most effective approaches/methods/technologies
• Prepare reports on team performance and project status
• Foster a culture of continuous learning and skill development
• Perform other duties and responsibilities as assigned

Qualifications:

• Proven experience in data engineering, with a strong track record of leading and managing teams
• Demonstrated experience in cloud-based data engineering solutions, preferably with Snowflake, including experience in building and optimizing data pipelines, transformations, and scalable data models
• Collect operations metrics on the effectiveness of the data engineering team
• Strong SQL development skills
• Experience building Data Management solutions on premise and in the cloud
• Strong understanding of data integration, data quality, and data governance
• Lead and participate in defining technical solutions, architecture improvements, technical reviews, and code reviews
• Excellent problem-solving skills and the ability to navigate complex technical challenges
• A solid background in Microsoft based ETL and T-SQL development
• Extensive experience working with SSIS
• Hands on experience using databases like SQL Server, Oracle, and DB2

• High interpersonal, communication, analytical, presentation skills, with a high business maturity
• Able to think creatively and analytically to solve problems
• Flexibility to adapt to evolving technologies and industry trends
• Strong organizational skills and the ability to meet deadlines/work independently

Education and Experience:

• Bachelor's Degree in Analytics, Statistics, Computer Science, or other related field OR equivalent work experience
• 5+ years of Data Integration technologies and principles with strong knowledge of SSIS package development, deployment, and troubleshooting
• 5+ years Microsoft T-SQL and Microsoft databases technologies (strong knowledge of stored procedures, ETL's, complex queries & joins, and user-defined functions)
• Experience scaling and managing 3+ person teams

Physical Demands:

While performing the duties of this job, the employee is regularly required to sit and use hands to finger, handle, or feel. The employee frequently is required to talk or hear. The employee is occasionally required to stand. The employee must occasionally lift and/or move up to 10 pounds. Specific vision abilities required by this job include close vision.