Data Engineer 2

Join our dynamic team where you will play a vital role in ensuring data hygiene and quality across our systems. You will collaborate with various teams in Azure to analyze data, identify gaps, and curate information for enhanced decision-making. Your expertise will drive process automation and efficiency improvements, contributing to our success in data management and reporting.

Responsibilities

• Conduct daily data analysis to identify gaps and maintain data hygiene in source systems, working closely with Azure teams.
• Identify data sources and prepare queries using languages such as Kusto and SQL for data extraction and report preparation in Azure Data Explorer or Power BI.
• Design processes, data models, and reports to surface insights related to change management and various workstreams.
• Collaborate with services and Azure Teams to capture learnings from incidents, storing them centrally for consistent retrieval.
• Propose, plan, and expedite identified process automations to improve efficiency.
• Track and analyze incidents daily to understand causation and associations with deployments, providing updates to the team.
• Provide feedback on recommended data improvements and follow up within program workstreams.
• Plan and create efficient techniques to transform raw data into compatible formats for downstream data sources, databases, and tools.
• Ensure data quality and completeness using queries, data wrangling, and statistical techniques, merging data into distributed systems for further processing.

Requirements

• Proficient in writing Kusto queries and improving performance of existing queries, with knowledge of structured and non-structured databases.
• Skilled in developing data models to create insightful reports using Azure Data Explorer, Power BI, or relevant BI tools.
• Experienced in using analytics to discover, interpret, and communicate meaningful patterns in complex datasets for effective decision-making.
• Ability to identify trends, patterns, and relationships in data to analyze information and draw accurate conclusions.
• Proficient in developing Power Apps, Power Automate flows, and Lens jobs for data retrieval, storage, or other required automations.
• Strong communication skills to effectively collaborate with Azure teams on troubleshooting, data analysis, and reporting.

Candidate Requirements

• Years of Experience Required: 2-4 years in business analytics, data science, software development, data modeling, or data engineering.
• Degrees or Certifications: Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field. A Master's Degree is preferred.
• Best vs. Average: The best candidate will have experience with Kusto Query Language, Python, Power BI, Azure Data Explorer, Power Apps/Power Platform.
• Performance Indicators: Performance will be assessed based on meeting deadlines, quality of work, quick assistance on urgent requests, and feedback from the team.

Top Hard Skills

• Minimum 2 years experience with Kusto Query Language
• Minimum 2 years experience with Python
• Minimum 2 years experience with Azure Data Explorer
• Minimum 2 years experience with Power BI
• Minimum 2 years experience with Power Apps/Power Platform

This role is 100% onsite.