Data Engineer

Role: Data Engineer with hands on Java experience a must.
Customer Location: Remote is ok
Duration: 12+ Months Contract

JOB DESCRIPTION:
Java, Python, Oozie, Pig, Scala, SageMaker, Hive, Airflow, AWS

Nice to have: MapReduce, Unix shell scripting, SQL/NoSQL, Git or Maven, Spark, Kafka

Big Data developers with hands-on experience in building data pipeline applications

With Hands on Java Experience
-2+ yrs of hands-on experience in building Big Data applications using SQL/NoSQL technologies in the Hadoop ecosystem
-Strong MapReduce/Java app development experience & UNIX shell scripting skill
-Prepare Env for science model training
-Investigation and initial work to connect with new system (Ex. key-value store, remote service)
-SHP, eSHP topology
-TnV web crawling pipeline
-SRT batch scoring pipeline
-SRT model updating pipeline
-Hive, Pig with custom UDF implementation in Java
-MySQL
-Oozie
-Git, Maven
-Spark
-Plus: Kafka, DevOps, CI/CD