Big Data Engineer
Apply NowCompany: Avani Technology Solutions, Inc.
Location: Portland, OR 97229
Description:
Job Description
- Excellent scripting skills in one or more (Java Script, Shell, Python etc.)
- Experience with Git, Subversion or other version control systems
- Experience with continuous integration and/or continuous delivery
- Hands on experience with configuration management tools, such as Puppet, Chef or AWS OpsWorks
- Hands on experience with HDFS, Map Reduce, Presto, Hive, Impala, Spark or similar technologies
- Ability to build libraries, user defined functions and frameworks on Hadoop eco system, Python and/or Spark
- Understanding of Hadoop distributions such as EMR
- Experience with AWS or Cloud
- Orchestration tools experience like Airflow or similar open source tools
- Experience with Snowflake cloud data warehouse is a BIG plus