Databricks Architect
Apply NowCompany: Syntricate Technologies
Location: San Jose, CA 95123
Description:
Job Title: Databricks Architect
Location: San Jose, CA (Onsite day 1 )
Duration: Long term contract/ Full time hire
Requirements
Key Responsibilities:
Work on client projects to deliver Microsoft Azure based Data engineering & Analytics solutions
Provide hands on technical leadership for relevant technical skills, in multiple projects if required
Design and implement high performing scalable analytics solutions on Azure following well-architected framework guidelines
Design pipelines to ingest & integrate structured/unstructured data from heterogeneous sources
Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
Mandatory Skills
In-depth knowledge Data processing techniques and handling large data sets
Hands on experience using different storage services on Azure for storing data, like ADLS, SQL DB, SYnapse, Delta tables, Hive
Expert level hands on experience using Databricks in at least 4 projects, creating notebooks using Scala/Python
Expertise using Pyspark and Spark SQL for processing data for various use cases
. Expertise in code/performance optimization, and troubleshooting PySpark notebooks
Good understanding of Delta lake and how it can be used in conjunction with ADLS and other storage
Experience working with atleast 1 big data project using map-reduce
Experience with Databricks scheduling features to automate Databricks jobs
Problem-solving skills along with good interpersonal & communication skills
Self-starter who can pick up any other relevant Azure Services in the Analytics space
Good-to-Have Skills
Databricks Certified Data Engineer
Knowledge of HDInsight, and Azure DevOps is a big plus
DP 203 - Microsoft Certified Azure Data Engineer
Knowledge in Power BI
Exposure to Databricks on AWS
Location: San Jose, CA (Onsite day 1 )
Duration: Long term contract/ Full time hire
Requirements
Key Responsibilities:
Work on client projects to deliver Microsoft Azure based Data engineering & Analytics solutions
Provide hands on technical leadership for relevant technical skills, in multiple projects if required
Design and implement high performing scalable analytics solutions on Azure following well-architected framework guidelines
Design pipelines to ingest & integrate structured/unstructured data from heterogeneous sources
Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
Mandatory Skills
In-depth knowledge Data processing techniques and handling large data sets
Hands on experience using different storage services on Azure for storing data, like ADLS, SQL DB, SYnapse, Delta tables, Hive
Expert level hands on experience using Databricks in at least 4 projects, creating notebooks using Scala/Python
Expertise using Pyspark and Spark SQL for processing data for various use cases
. Expertise in code/performance optimization, and troubleshooting PySpark notebooks
Good understanding of Delta lake and how it can be used in conjunction with ADLS and other storage
Experience working with atleast 1 big data project using map-reduce
Experience with Databricks scheduling features to automate Databricks jobs
Problem-solving skills along with good interpersonal & communication skills
Self-starter who can pick up any other relevant Azure Services in the Analytics space
Good-to-Have Skills
Databricks Certified Data Engineer
Knowledge of HDInsight, and Azure DevOps is a big plus
DP 203 - Microsoft Certified Azure Data Engineer
Knowledge in Power BI
Exposure to Databricks on AWS