AWS databricks, Pyspark Developer
Apply NowCompany: Sarian, Inc.
Location: Bloomfield, CT 06002
Description:
Role Name
AWS databricks, Pyspark Python Developer
Experience Required
6-10 years
Job Description
Should have extensive handson experience in Terraform, S3, API Gateway, Lamba, SNS and SQS.
Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
Should have CICD experience using tools like GIT, Jenkins etc
Experience working with SPARK and real time analytic frameworks. Structured streaming.
Knowledge in Databricks reporting.
They need to be experienced in programming language (Python, Pyspark)
Hands-on experience integrating open-source components into data-analytic solutions
Working with vendors to enhance tool capabilities to meet enterprise needs
Willingness to continuously learn & share learnings with others
Strong troubleshooting and performance tuning skills.
Experience building multi-tenant, virtualized infrastructure a strong plus
Education
AWS databricks, Pyspark Python Developer
Experience Required
6-10 years
Job Description
Should have extensive handson experience in Terraform, S3, API Gateway, Lamba, SNS and SQS.
Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
Should have CICD experience using tools like GIT, Jenkins etc
Experience working with SPARK and real time analytic frameworks. Structured streaming.
Knowledge in Databricks reporting.
They need to be experienced in programming language (Python, Pyspark)
Hands-on experience integrating open-source components into data-analytic solutions
Working with vendors to enhance tool capabilities to meet enterprise needs
Willingness to continuously learn & share learnings with others
Strong troubleshooting and performance tuning skills.
Experience building multi-tenant, virtualized infrastructure a strong plus
Education
- B- BS/BE/BTech/MCA degree or equivalent technical experience