Sr Data Engineer (Snowflake)

Apply Now

Company: Cloud BC Labs

Location: Iselin, NJ 08830

Description:

Sr Data Engineer

Iselin, NJ

W2 Role

Job Responsibilities:

  • Able to provide architecture, design, implementation and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse
  • Provide production support for Data Warehouse issues such data load problems, transformation translation problems.
  • Able to translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
  • Able to work on data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly document implementations.
  • Able to perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
  • Able to develop EL pipelines in and out of data warehouse using combination of Databricks, Python and Snow SQL.
  • Able to provide data ingestion and processing pipelines using Python, Databricks, Snow SQL
  • Able to Establish and monitor Operational Level Agreements for the health and performance/cost of the warehouse environment (Loads, queries, data quality)

Required Qualifications

  • Overall 10+ years of experience is required.
  • Minimum 3 years of experience in design and implementation of large-scale data solution on Azure Snowflake Data Warehouse
  • Hands-on experience with Snowflake utilities such as Snow SQL, Snow Pipe, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures.
  • Good experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modelling
  • Good knowledge of MS Azure configuration items with respect to Snowflake
  • Experience in writing scripts (UNIX, Python)
  • Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies

Good to Have:

  • Experience in Finance / Banking industry - some understanding of Securities and Banking products.

Similar Jobs