Azure Data Engineer
Apply NowCompany: Diamondpick
Location: Redmond, WA 98052
Description:
Job description-
Responsibilities:
Design and development of Data Engineering solutions, Data models using Azure Data stack for enterprise scale applications
Communicate and defend design, requirements, feature set, functionality, usability and limitations of subsystem to team and/or development lead or manager.
Design and exhibit strong coding skills with high quality database solutions within a fast paced monthly release cycle
Design ETL process, data migrations within/to Azure could platform.
String knowledge in Vector Databases like COSMOS DB
troubleshooting of data pipelines ETL issues, performing root cause analysis and ability to resolve issues
Mandatory Skills:
Must have experience with Azure Data /Analytical services- Azure SQL, COSMOS DB, Synapse, ADF, Azure Analytical Services (AAS), Azure Data Explorer (ADX), Azure Data Lake (ADLS), Power BI
Good to have implementing experience in big data processing tools - COSMOS, Kusto, Azure Databricks, Spark
Expertise in writing and optimizing the best quality SQL queries, complex stored procedures
In depth understanding of Azure Data architecture and hands on experience with various tools.
strong communication skills
Ability to work effectively both individually and on a team.
Preferred Skills:
Python and Statistics
Experience with other AI and machine learning algorithms.
Knowledge of data science and analytics.
Responsibilities:
Design and development of Data Engineering solutions, Data models using Azure Data stack for enterprise scale applications
Communicate and defend design, requirements, feature set, functionality, usability and limitations of subsystem to team and/or development lead or manager.
Design and exhibit strong coding skills with high quality database solutions within a fast paced monthly release cycle
Design ETL process, data migrations within/to Azure could platform.
String knowledge in Vector Databases like COSMOS DB
troubleshooting of data pipelines ETL issues, performing root cause analysis and ability to resolve issues
Mandatory Skills:
Must have experience with Azure Data /Analytical services- Azure SQL, COSMOS DB, Synapse, ADF, Azure Analytical Services (AAS), Azure Data Explorer (ADX), Azure Data Lake (ADLS), Power BI
Good to have implementing experience in big data processing tools - COSMOS, Kusto, Azure Databricks, Spark
Expertise in writing and optimizing the best quality SQL queries, complex stored procedures
In depth understanding of Azure Data architecture and hands on experience with various tools.
strong communication skills
Ability to work effectively both individually and on a team.
Preferred Skills:
Python and Statistics
Experience with other AI and machine learning algorithms.
Knowledge of data science and analytics.