Sr. Software Engineer

Apply Now

Company: Keylent, Inc.

Location: Dearborn, MI 48126

Description:

Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply.
Tax Terms: W2, 1099
Corp-Corp or 3rd Parties: Yes

Description
The Hadoop Developer/Architect
Location: Dearborn, MI
The Hadoop Developer/Architect position will provide expertise in a wide range of technical areas, including but not limited to: Cloudera Hadoop ecosystem, Java, collaboration toolsets integration using SSO, configuration management, hardware and software configuration and tuning, software design and development, and application of new technologies and languages which are aligned with
1. Design and development of data ingestion pipelines.
2. Perform data migration and conversion activities.
3. Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
4. Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
5. Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
Required Skills:
1. Java/Scala
2. Hadoop (preferably Cloudera CDH-5.12+), HDFS, Hive, Impala, Spark, Oozie, HBase
3. Apache Kafka
4. Any RDBMS
5. Linux
Good to Have:
Python
Flume
Solr
ETL Tools
NoSQL databases (Mongo/Couchbase/Cassandra), IIB or any other ESB experience

Similar Jobs