Azure Databricks Engineer
Apply NowCompany: Cynet Systems
Location: Raleigh, NC 27610
Description:
Job Description:
Responsibilities:
Responsibilities:
- Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing.
- Collaborate with business users to develop data products that align with business domain expectations.
- Work with DBAs to ingest data from cloud and on-prem transactional databases
- Contribute to the development of the Data Architecture for Client DIT - Transportation:
- By following practices for keeping sensitive data secure.
- By streamlining the development of data products for use by data analysts and data scientists.
- By developing and maintaining documentation for data engineering processes.
- By ensuring data quality through testing and validation.
- By sharing insights and experiences with stakeholders and engineers throughout DIT - Transportation.