Data Engineer

Job Description
Welcome to Yoush Consulting. Are you an independent IT Consultant, or do you wish to become one? Yoush Consulting provides project management and information technology expertise to help our clients deliver their projects.

Azure DevOps Engineer with D365 and F&O experience

As a Data Engineer, you will be responsible for building and maintaining the systems and processes that allow for the extraction, transformation, and loading (ETL) of data from various sources into our Azure-based data ecosystem.

Responsibilities

• Provide a detailed review and assessment of the enterprise data warehouse environment and proposed changes and implementation plan to improve scalability and performance
• Design and develop SSIS ETL process using table partitioning with a focus on performance improvement of large tables
• Design and develop Power BI reports to show SSIS package run duration and trend over time
• Perform data analysis and provided suggestions and feedback to the team to design and develop optimized SQL Queries and Stored Procedures (SCD Type1, SCD Type2 using Hash bytes) to improve performance
• Design and implement an operational process to provide a high-level summary of SQL Server and database environment to assist in the upgrade and migration of SQL Server databases to newer versions

Requirements
3+ Proven experience as a Data Engineer, with a focus on Microsoft Azure technologies.
Experience with Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, Azure Databricks
Proficient in SQL and scripting languages (e.g., Python).
Strong understanding of data modeling and database design principles.
Experience with data warehousing concepts and methodologies.
Familiarity with data integration and ETL tools.
Excellent problem-solving and communication skills.