Big Data Engineer-Assurance / Digital : Big Data Testing (Hadoop
Apply NowCompany: Tephra Inc.
Location: San Jose, CA 95101
Description:
Description:
Architect and design solution, including hands work to build Develop scripts and Manage Big Data Stack to support Platform And Application Development.
- HDFS deep expertise - Must
- Apache Spark deep expertise - Must
- Python / Scala - One of them required
Responsibilities:
Manage the data lake, help prepare the data (including lot of video and image data) for all applications.
Enable application performance, Optimization of data storage, Fast retrieval
Metadata management
Data Structures how to use, Programming Skills, Fundamentals ( for ex. indexing) - key requirement
Write Spark programs. Spark Context, Refactoring - key requirement
Qualifications:
Bachelor Engg . Comp Sc. ( preferred)
1) Years of experience required for position (In Big data 5 yrs, Overall around 10+years)
2) Location for the position
San Jose, CA
Architect and design solution, including hands work to build Develop scripts and Manage Big Data Stack to support Platform And Application Development.
- HDFS deep expertise - Must
- Apache Spark deep expertise - Must
- Python / Scala - One of them required
Responsibilities:
Manage the data lake, help prepare the data (including lot of video and image data) for all applications.
Enable application performance, Optimization of data storage, Fast retrieval
Metadata management
Data Structures how to use, Programming Skills, Fundamentals ( for ex. indexing) - key requirement
Write Spark programs. Spark Context, Refactoring - key requirement
Qualifications:
Bachelor Engg . Comp Sc. ( preferred)
1) Years of experience required for position (In Big data 5 yrs, Overall around 10+years)
2) Location for the position
San Jose, CA