Data Engineer
Apply NowCompany: Cloud BC Labs
Location: Reston, VA 20191
Description:
Position : Data Engineer (Azure Data Factory & Snowflake)
Location : Remote
Term : C2C/W2 role
Job Description :
We are seeking a skilled Data Engineer with expertise in Azure Data Factory (ADF) and Snowflake to join our dynamic data team. The candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support business intelligence, analytics, and reporting needs.
Key Responsibilities:
1. Data Integration & Pipeline Development:
Design and develop ETL pipelines using Azure Data Factory to integrate data from multiple sources into Snowflake.
Implement and optimize data workflows to ensure high performance and reliability.
2. Snowflake Database Development:
Develop, optimize, and manage Snowflake databases, schemas, and tables.
Write and tune complex SQL queries to process and analyze large datasets.
3. Cloud Architecture & Collaboration:
Collaborate with architects to design scalable and secure cloud data solutions.
Work with cross-functional teams to gather requirements and translate them into technical solutions.
4. Performance Tuning:
Optimize Snowflake and Azure Data Factory for cost and performance.
Implement best practices for data governance, security, and quality.
5. Monitoring & Troubleshooting:
Monitor data pipelines and resolve issues promptly.
Automate repetitive tasks and improve system reliability.
Qualifications & Skills:
Technical Skills:
Proficiency with Azure Data Factory and Snowflake.
Strong SQL skills and experience with data modeling.
Familiarity with Azure services (e.g., Azure Data Lake).
Experience with programming languages like Python for data processing.
Soft Skills:
Strong analytical and problem-solving abilities.
Excellent communication and teamwork skills.
Preferred Experience:
Hands-on experience with ADF and Snowflake.
Experience working in an Agile environment.
Knowledge of data warehousing and Power BI.
Knowledge of Microsoft Fabric
Location : Remote
Term : C2C/W2 role
Job Description :
We are seeking a skilled Data Engineer with expertise in Azure Data Factory (ADF) and Snowflake to join our dynamic data team. The candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support business intelligence, analytics, and reporting needs.
Key Responsibilities:
1. Data Integration & Pipeline Development:
Design and develop ETL pipelines using Azure Data Factory to integrate data from multiple sources into Snowflake.
Implement and optimize data workflows to ensure high performance and reliability.
2. Snowflake Database Development:
Develop, optimize, and manage Snowflake databases, schemas, and tables.
Write and tune complex SQL queries to process and analyze large datasets.
3. Cloud Architecture & Collaboration:
Collaborate with architects to design scalable and secure cloud data solutions.
Work with cross-functional teams to gather requirements and translate them into technical solutions.
4. Performance Tuning:
Optimize Snowflake and Azure Data Factory for cost and performance.
Implement best practices for data governance, security, and quality.
5. Monitoring & Troubleshooting:
Monitor data pipelines and resolve issues promptly.
Automate repetitive tasks and improve system reliability.
Qualifications & Skills:
Technical Skills:
Proficiency with Azure Data Factory and Snowflake.
Strong SQL skills and experience with data modeling.
Familiarity with Azure services (e.g., Azure Data Lake).
Experience with programming languages like Python for data processing.
Soft Skills:
Strong analytical and problem-solving abilities.
Excellent communication and teamwork skills.
Preferred Experience:
Hands-on experience with ADF and Snowflake.
Experience working in an Agile environment.
Knowledge of data warehousing and Power BI.
Knowledge of Microsoft Fabric