Data Engineer
Apply NowCompany: Diamondpick
Location: Redmond, WA 98052
Description:
Role- Data Engineer
Location- Redmond, WA
Job description-
total 8+ years of experience
Should have experience in using Pyspark
Working experience on KUSTO for telemetry data
Should be able to write python code in Azure Synapse Notebook.
Good understanding & working experience of Azure Synapse end-to-end.
Should have experience in working with Spark ( structured streaming data - possibly from Event hubs)
Should have experience in handing large volume of data (possibly in 100s of GB).
Should be able to debug and fine tune the jobs/notebook for optimum memory consumption and processing.
Should have knowledge of Data warehousing, data management for efficient data handling.
Should have good knowledge of data modeling & data engineering work
Experience working with large data sets using SQL/Azure Data Lake/PySpark/ADF/Synapse, etc., to derive actionable insights is highly desirable.
They should be productive soonest possible post joining.
Nice To Have
Local Redmond resource/PST working hour resource
Microsoft ecosystem knowledge
Location- Redmond, WA
Job description-
total 8+ years of experience
Should have experience in using Pyspark
Working experience on KUSTO for telemetry data
Should be able to write python code in Azure Synapse Notebook.
Good understanding & working experience of Azure Synapse end-to-end.
Should have experience in working with Spark ( structured streaming data - possibly from Event hubs)
Should have experience in handing large volume of data (possibly in 100s of GB).
Should be able to debug and fine tune the jobs/notebook for optimum memory consumption and processing.
Should have knowledge of Data warehousing, data management for efficient data handling.
Should have good knowledge of data modeling & data engineering work
Experience working with large data sets using SQL/Azure Data Lake/PySpark/ADF/Synapse, etc., to derive actionable insights is highly desirable.
They should be productive soonest possible post joining.
Nice To Have
Local Redmond resource/PST working hour resource
Microsoft ecosystem knowledge