Sr. Azure Data Engineer
Apply NowCompany: Centraprise
Location: Arlington, VA 22204
Description:
Job Description -
Sr. Azure Data Engineer
Arlington, Virginia
Fulltime
Key Areas Description
Roles & Responsibilities
Responsible for designing, building, testing, and delivering data pipelines to enhance the Azure Data Lake using structured and unstructured data sources
Builds and delivers Azure DevOps model using automation and Continuous Integration/Continuous Deployment (CI/CD) pipelines following Agile methodologies (i.e. Scrum, SAFe, Kanban)
Develops forward-thinking IT blueprints
Collaborates with Product Owners and Data Engineers to drive alignment and acceptance of the enterprise architecture
Ensures the security of data by maintaining the integrity and performance of client databases and guaranteeing that data is stored securely and optimally
Creates design documentation and code delivery as part of the client Standards Experience Required
10+ years of experience in business analytics and/or IT solution delivery
5+ years of experience in Azure Cloud technologies (as mentioned below)
Experience designing, developing, and implementing analytics platforms using Azure Cloud architecture using structured and unstructured data sources Key Areas.
Job Description
Must-have experience
Experience in generating data pipelines in Azure ADF
Experience in ingesting data from different Sources using in Azure ADF
Experience in transforming the data using Azure Databricks
Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management
Implement Integration solution in Microsoft Azure
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
Works closely with a team of frontend and backend engineers, product managers, and analysts
Experience working in agile development projects and sprint delivery Good to have
Experience working with CPG customers
Experience in areas of master data like material master and transactional data in manufacturing like Bill of Material, Sales Data etc.
Worked in SAP BW to Azure data Integration projects Factors for success
Prompt communication and timely deliverables
Detailed documentation of requirements and design approach
Ability to look for solutions and work around when technology does not provide straight forward approach
Mandatory Technical Skills
Azure Cloud Technologies: Azure Data Factory, Azure Data Lake Analytics, PySpark, Azure Data Bricks, Azure SQL Data Warehouse / Synapse, Azure Functions, Event Hub, Azure DevOps
Sr. Azure Data Engineer
Arlington, Virginia
Fulltime
Key Areas Description
Roles & Responsibilities
Responsible for designing, building, testing, and delivering data pipelines to enhance the Azure Data Lake using structured and unstructured data sources
Builds and delivers Azure DevOps model using automation and Continuous Integration/Continuous Deployment (CI/CD) pipelines following Agile methodologies (i.e. Scrum, SAFe, Kanban)
Develops forward-thinking IT blueprints
Collaborates with Product Owners and Data Engineers to drive alignment and acceptance of the enterprise architecture
Ensures the security of data by maintaining the integrity and performance of client databases and guaranteeing that data is stored securely and optimally
Creates design documentation and code delivery as part of the client Standards Experience Required
10+ years of experience in business analytics and/or IT solution delivery
5+ years of experience in Azure Cloud technologies (as mentioned below)
Experience designing, developing, and implementing analytics platforms using Azure Cloud architecture using structured and unstructured data sources Key Areas.
Job Description
Must-have experience
Experience in generating data pipelines in Azure ADF
Experience in ingesting data from different Sources using in Azure ADF
Experience in transforming the data using Azure Databricks
Experience in Azure DevOps CI/CD - Stories, Bugs, and Issue management
Implement Integration solution in Microsoft Azure
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
Works closely with a team of frontend and backend engineers, product managers, and analysts
Experience working in agile development projects and sprint delivery Good to have
Experience working with CPG customers
Experience in areas of master data like material master and transactional data in manufacturing like Bill of Material, Sales Data etc.
Worked in SAP BW to Azure data Integration projects Factors for success
Prompt communication and timely deliverables
Detailed documentation of requirements and design approach
Ability to look for solutions and work around when technology does not provide straight forward approach
Mandatory Technical Skills
Azure Cloud Technologies: Azure Data Factory, Azure Data Lake Analytics, PySpark, Azure Data Bricks, Azure SQL Data Warehouse / Synapse, Azure Functions, Event Hub, Azure DevOps