Data Engineer

Piper Companies is seeking a Data Engineer to join an established healthcare tech organization located in Maryland . This position is HYBRID (4 days REMOTE, Thursday on-site in Columbia, MD).

Requirements:

• Design, build, and maintain large, complex data processing pipelines that meet business requirements.
• Develop automated controls and perform unit, integration, and user acceptance testing to ensure accuracy and reliability.
• Develop scalable and reusable frameworks for ingestion and transformation of large data sets.
• Troubleshoot and perform root cause analysis on data pipeline issues.
• Collaborate with source system owners and business owners to incorporate changes into data pipelines.
• Create comprehensive documentation of data workflows, processes, and infrastructure.

Qualifications:

• 3+ years of experience in data integration.
• Advanced programming skills in PySpark, Python.
• Thorough understanding of Data Lakes, raw/enriched/curated layer concepts, and ETL within the Azure framework.
• Proven experience in building complex data pipelines (data warehousing, data lakes).
• Experience in Databricks and Azure Data Factory.
• 4+ year college degree (required).

Compensation:

• Hourly Rate: $45-$55 per hour
• Comprehensive benefit package: Medical, Dental, Vision. Sick leave as required by law.

This job opens for applications on 4/21/25. Applications for this job will be accepted for at least 30 days from the posting date.

#LI-KS1

#LI-HYBRID

Keywords: Data Engineering, Data Engineer, Databricks, Python, PySpark, ETL, Big Data, Apache Spark, Data Warehousing, SQL, Cloud Computing, Data Pipelines, Machine Learning, Data Lakes, Hadoop, Scala, Data Integration, Data Transformation, Data Modeling, Analytics, AWS, Azure, GCP, Data Governance, Performance Optimization, Data Security, Data Quality, Workflow Automation, Real-time Data Processing, Batch Processing, Data Visualization, Business Intelligence