Data Integration Lead
Apply NowCompany: Omni Inclusive
Location: Media, PA 19063
Description:
Must Haves:
Strong leadership quality and able to handle a team of 7-8 resources.
Proficiency in Snowflake Cloud Data Platform and AWS
Expertise in Snow SQL, Snowflake procedures, UDF's using JavaScript/Python/SQL
10+ year of IT Industry experience in Talend DI/Informatica
Strong experience in ETL with Data migration, data consolidation
Ability to provide technical guidance to data engineering team for Talend/Informatica pipeline design and enhancements
Strong experience in creating data pipelines around event and messaging patterns, streaming data, Kafka, API and SAP systems using Talend/Informatica
Good experience in Databricks Notebook using Scala and SQL, Job Scheduling and Monitoring using Databricks.
Familiarity with Data Vault model and MicroStrategy / Tableau based BI framework.
Understanding of fundamentals of Git and Git workflows. Must have used at least one of the SAAS-based Git tools like GitHub, GitLab, Bitbucket
Experience of working in agile application development environment
Ability to proactively prioritize tasks in consultation with business stakeholders, Product Owners, Product Managers
Good to Have:
Valid Certification on Snowflake , Talend/Informatica
Hands on experience with Data Quality activities like analysis, profiling, Data cleansing and standardization rules implementation
Experience with implementation of inbound and outbound integrations of STIBO PIM solution
Confidence and agility in challenging times
Ability to work collaboratively with cross-functional teams in a fast-paced, team environment
Focus on innovation, competitive differentiation, and speed to market
Establish and maintain a working environment conducive to positive morale, individual style, quality, creativity, and teamwork
Understand Data Governance
Experience with Data migration process
ROLE Skill Required Proficiency - On a scale of 1-5
(5 being the highest) Data Engineering - Lead Snowflake Cloud Data Platform:
Snowflake Utilities SnowSql, SnowPipe, Snow SQL, Snowflake procedures, UDF's using JavaScript/Python/SQL
Understanding of snowflake architecture and features 5 Talend DI/Informatica:
Data loading from different DB (Snowflake, Mysql, MSSQL, Oracle etc), Creation of Data pipelines around event and messaging patterns, streaming data, Kafka , API, File Data (CSV, XLS, JSON, XML etc) handling, Job reusability with externalization of source information, Data cleaning and Transformation 3 Databricks:
Working with Databricks Notebook using Scala and SQL, Job Scheduling and Monitoring using Databricks, Handling External Libraries and submit Spark job using Set JAR options, Delta lake in Databricks 3 TMC ,Code Promotions, Job Scheduling and Management 3 WS 3 Data Vault 2.0 2 GitHub / GitLab / Bitbucket
Strong leadership quality and able to handle a team of 7-8 resources.
Proficiency in Snowflake Cloud Data Platform and AWS
Expertise in Snow SQL, Snowflake procedures, UDF's using JavaScript/Python/SQL
10+ year of IT Industry experience in Talend DI/Informatica
Strong experience in ETL with Data migration, data consolidation
Ability to provide technical guidance to data engineering team for Talend/Informatica pipeline design and enhancements
Strong experience in creating data pipelines around event and messaging patterns, streaming data, Kafka, API and SAP systems using Talend/Informatica
Good experience in Databricks Notebook using Scala and SQL, Job Scheduling and Monitoring using Databricks.
Familiarity with Data Vault model and MicroStrategy / Tableau based BI framework.
Understanding of fundamentals of Git and Git workflows. Must have used at least one of the SAAS-based Git tools like GitHub, GitLab, Bitbucket
Experience of working in agile application development environment
Ability to proactively prioritize tasks in consultation with business stakeholders, Product Owners, Product Managers
Good to Have:
Valid Certification on Snowflake , Talend/Informatica
Hands on experience with Data Quality activities like analysis, profiling, Data cleansing and standardization rules implementation
Experience with implementation of inbound and outbound integrations of STIBO PIM solution
Confidence and agility in challenging times
Ability to work collaboratively with cross-functional teams in a fast-paced, team environment
Focus on innovation, competitive differentiation, and speed to market
Establish and maintain a working environment conducive to positive morale, individual style, quality, creativity, and teamwork
Understand Data Governance
Experience with Data migration process
ROLE Skill Required Proficiency - On a scale of 1-5
(5 being the highest) Data Engineering - Lead Snowflake Cloud Data Platform:
Snowflake Utilities SnowSql, SnowPipe, Snow SQL, Snowflake procedures, UDF's using JavaScript/Python/SQL
Understanding of snowflake architecture and features 5 Talend DI/Informatica:
Data loading from different DB (Snowflake, Mysql, MSSQL, Oracle etc), Creation of Data pipelines around event and messaging patterns, streaming data, Kafka , API, File Data (CSV, XLS, JSON, XML etc) handling, Job reusability with externalization of source information, Data cleaning and Transformation 3 Databricks:
Working with Databricks Notebook using Scala and SQL, Job Scheduling and Monitoring using Databricks, Handling External Libraries and submit Spark job using Set JAR options, Delta lake in Databricks 3 TMC ,Code Promotions, Job Scheduling and Management 3 WS 3 Data Vault 2.0 2 GitHub / GitLab / Bitbucket