Senior Software Developer - ETL
Apply NowCompany: Cynet Systems
Location: Toronto, ON M4E 3Y1
Description:
Job Description:
- Design, development, and execution of test plans, cases, scripts, and test data based on functional and technical specifications to validate solutions.
- This includes creating and maintaining a full test plan, testing procedures, an associated library of test cases and scripts, test data (e.g., manufactured, obfuscated), and maintaining full traceability from the test plan through cases.
- Perform manual and automated testing to validate system /integration functionality and performance.
- Collaborate with stakeholders to ensure proper integration of tests into the continuous integration/continuous delivery (CI/CD) pipeline.
- Provide analytical, development, and testing support and execute project level testing of the applications and solutions.
- Plan and execute data migration activities, ensuring various systems integration from external/internal sources to Microsoft Dynamics Customer Engagement and Finance & Operation.
- Verify the configuration, tuning, and optimization of Dynamics 365 applications to ensure seamless integration with other external/internal enterprise systems.
- nalyze and optimize the performance of the system integration.
- Provide functional guidance to CRM users through documentation, training sessions, and the resolution of system issues.
- Perform data validation tasks such as to validate the extracted/imported data to ensure its accuracy, completeness, and consistency.
- Help with identifying and resolving data quality issues.
- Develop processes for transferring data and files between internal and external environments via network, sFTP, APIs, Microsoft Power Platform, Logic Apps.
- Develop processes for encryption and decryption in an Azure environment.
- Perform testing and quality assurance related tasks such as to conduct thorough testing to verify the accuracy and integrity of the data manipulated in interfaces.
- Define test cases and address any issues or discrepancies that arise during the testing phase.
- Document the processes developed.
- Other duties as assigned.
- Complete work and achieve milestones within the assigned deadlines.
- Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as candidate becomes aware of them.
- Submit Deliverables for the Cluster/Ministry approval as they are completed.
- Project Gateway Process, and other applicable Guidelines, Standards and Procedures.
- 5+ years working experience of Microsoft (MS) Azure Cloud technology especially MS Dynamics 365 Customer Relationship Management (CRM) and Enterprise Resource Planning (ERP) applications such as Customer Engagement and Finance & Operations, PowerApps, Power Automate and Power BI, Data Factory and Data Pipelines.
- 5+ years of proven working experience in integrating various data sources and systems, both on-premises and in the cloud, using Azure ETL services or other ETL tools.
- 5+ years of experience working on, preferably leading, testing teams and efforts.
- In-depth knowledge of integration technologies commonly used with Dynamics, such as DataVerse, Data Entities, and APIs.
- Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
- Proficiency in Azure Data Factory, Azure Synapse workspaces.
- Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.
- Proficiency in Azure-specific scripting using PowerShell or Azure CLI, .NET, C#, Power Platform, Logic Apps.
- Expert proficiency with data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modeling, query performance analysis & tuning.
- zure cloud certifications (e.g., Azure Administrator, Azure Developer, Azure Data Engineer, Azure Database Administrator).
- Knowledge of integration technologies commonly used with Dynamics, such as DataVerse, Data Entities, and APIs.
- Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.
- Expertise in data transformation techniques, aggregation, enrichment, and normalization using Azure cloud technologies.
- Understanding of data governance principles, data privacy regulations and experience working with high-sensitivity data, and knowledge of best practices for data security and compliance in Azure.
- bility to monitor and troubleshoot integration processes and implement efficient data processing techniques in Azure.
- Expertise with Microsoft Power Platform, Logic Apps.
- Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
- Experience with SQL Server Management Studio, Azure data management tools, XRM toolbox, data modeling tools (ERWIN or PowerDesigner).
- Familiarity with data warehousing concepts and experience working with Azure Synapse Analytics.
- Experience with PowerApps platform, Power Automate, Dynamics CE and F&O.