Bigdata Developer
Apply NowCompany: SysMind Tech
Location: Costa Mesa, CA 92627
Description:
Role : Spark, Scala, Big data developer
Location : Costa Mesa, CA
Job Description :
Technical/Functional Skills
Experienced engineer with hands on and strong coding skills, preferably with Java, Scala, Python.
AWS Cloud experience - S3, EFS, ECS, EMR, etc.
Knowledge of Hadoop/Spark and various data formats like Parquet, AVRO, CSV, etc.
Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) is a plus.
Great attention to details with analytical/curious mind.
Organizational and communication skills
Experience Required
8 - 10 years
Roles & Responsibilities
Perform large-scale data processing using Python and Apache Spark.
Utilize AWS services like S3, EMR, EC2 for data storage and processing.
Schedule, monitor, and troubleshoot data pipelines with Apache Airflow.
Ensure the data quality, observability, and integrity across all our data infrastructure.
Location : Costa Mesa, CA
Job Description :
Technical/Functional Skills
Experienced engineer with hands on and strong coding skills, preferably with Java, Scala, Python.
AWS Cloud experience - S3, EFS, ECS, EMR, etc.
Knowledge of Hadoop/Spark and various data formats like Parquet, AVRO, CSV, etc.
Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) is a plus.
Great attention to details with analytical/curious mind.
Organizational and communication skills
Experience Required
8 - 10 years
Roles & Responsibilities
Perform large-scale data processing using Python and Apache Spark.
Utilize AWS services like S3, EMR, EC2 for data storage and processing.
Schedule, monitor, and troubleshoot data pipelines with Apache Airflow.
Ensure the data quality, observability, and integrity across all our data infrastructure.