Spark Consultant

Position: Spark Consultant

Location: Rancho Cordova, CA

Duration: 9 +months

The candidate must know the following technologies:

# Python development # Spark cluster configuration and development

# Oracle SQL development

# Java & Scala development

The candidate must know the following technologies:
Linux server administration
Delta Lake configuration and development
Airflow configuration and development
Microsoft Azure Key Vault configuration and development
Spark cluster configuration and development
Python & Python Spark development
Java & Scala development (nice to have)

Candidate responsibilities and duties:
Implement and support Apache Spark (on premise)
Implement Apache Airflow cluster with RabbitMQ and Celery technologies
Implement Azure Key Vault infrastructure and set up Key Vaults for both application development and data warehousing.
Develop custom security modules for Spark Cluster in J

Regards,

Sangeetha

West Advanced Technologies, Inc.

Serving government agencies for 22 Years

www.wati.com