ETL Developer / Data Engineer

ROLE - ETL Developer / Data Engineer

LOCATION - Remote

MAIN SKILLS - Coding Python/ Pyspark/ Scala, Have strong experience building data pipeline, Exp with Big data frameworks: Spark, Cloud data exp- AWS

Responsibilities

• Develop, debug and enhance large-scale ETL batch jobs that transforms large amounts of data
• Develop utilities and toolkits to speed up engineering tasks and consolidate repetitive manual tasks executed by engineers while performing data investigations
• Programming in at least one of the following languages: Java, Python, Scala

Required Skills

Programming language - Python, Java, or Scala

• Familiarity with Git or similar version control system
• Good understanding of data processing concepts and data engineering process.
• Able to frequently collaborate closely with a diverse tight-knit team
• Experience investigating and/or debugging problems
• Able to track, analyze, and report issues in a timely manner
• Attention to detail and a commitment to quality, while delivering work on schedule
• Highly organized and efficient
• Flexibility to respond and react to changing priorities quickly and efficiently
• Excellent oral and written communication in English

Highly Desired Skills

Big data processing, e.g. Spark/Hadoop

• Cloud based services, e.g. AWS
• Workflow management tools, e.g. Apache Airflow
• SQL
• QA/QE