Data Bricks Engineer
Apply NowCompany: Sarian, Inc.
Location: Chicago, IL 60629
Description:
Qualifications
Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog
Extensive hands-on experience implementing server less real-time/near real-time architecture using Cloud native services (i.e., Azure Stack), and Spark technologies (e.g., Spark Streaming, Spark ML)
Experience in data governance fields as lineage, quality, catalog, multi-cloud experience, etc.
5+ years of experience in Data bricks engineering solutions on one of the Cloud platforms (Azure)
5+ years of experience in Data Architecture and delivery experience on one of the Cloud platforms (Azure)
5+ years of Demonstrated experience in Microsoft Azure cloud solutions, architecture, related technologies
Demonstrable experience working in transformational projects where you implemented data platforms and/or ETL/ELT/CDC pipelines using Databricks
5+ years of Demonstrated experience in Microsoft Azure cloud solutions, architecture, related technologies
Experience with conceptualizing and architecting data lakes on cloud-centric platforms; should be able to articulate the value and key components of data lakes
Excellent interpersonal, verbal, and written communication skills
Passionate about learning new technologies
Bachelor's degree or equivalent work experience
Responsibilities
Work with clients to define their cloud data platform and implement cutting-edge data solutions to provide valuable business insights including AI/ML
Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions
Research, synthesize, recommend, and select technical approaches for solving difficult migration, development, and integration problems
Conduct and support workshops, design sessions, and project meetings as needed, playing a key role in client relations
Utilize Lake house Fundamentals, Developer Foundations Capstone, Developer Essentials Capstone, etc.
Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc.
On-call 24x7 support & Other duties as assigned
Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog
Extensive hands-on experience implementing server less real-time/near real-time architecture using Cloud native services (i.e., Azure Stack), and Spark technologies (e.g., Spark Streaming, Spark ML)
Experience in data governance fields as lineage, quality, catalog, multi-cloud experience, etc.
5+ years of experience in Data bricks engineering solutions on one of the Cloud platforms (Azure)
5+ years of experience in Data Architecture and delivery experience on one of the Cloud platforms (Azure)
5+ years of Demonstrated experience in Microsoft Azure cloud solutions, architecture, related technologies
Demonstrable experience working in transformational projects where you implemented data platforms and/or ETL/ELT/CDC pipelines using Databricks
5+ years of Demonstrated experience in Microsoft Azure cloud solutions, architecture, related technologies
Experience with conceptualizing and architecting data lakes on cloud-centric platforms; should be able to articulate the value and key components of data lakes
Excellent interpersonal, verbal, and written communication skills
Passionate about learning new technologies
Bachelor's degree or equivalent work experience
Responsibilities
Work with clients to define their cloud data platform and implement cutting-edge data solutions to provide valuable business insights including AI/ML
Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions
Research, synthesize, recommend, and select technical approaches for solving difficult migration, development, and integration problems
Conduct and support workshops, design sessions, and project meetings as needed, playing a key role in client relations
Utilize Lake house Fundamentals, Developer Foundations Capstone, Developer Essentials Capstone, etc.
Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc.
On-call 24x7 support & Other duties as assigned