Data Engineer
Apply NowCompany: Okaya Corp.
Location: Quincy, MA 02169
Description:
Location : North Quincy MA
Data Engineer
Hybrid onsite 3days
Only W2 candidates
Skill Sets Required
Data Engineer
Hybrid onsite 3days
Only W2 candidates
Skill Sets Required
- Good decision-making and problem solving skills
- Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).
- Solid Knowledge on medallion architecture, DLT and unity catalog within Databricks.
- Experience in migrating data from on-prem Hadoop to Databricks/AWS
- Understanding of core AWS services, uses, and AWS architecture best practices
- Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
- Solid knowledge on Airflow
- Solid knowledge on CI/CD pipeline in AWS technologies
- Application migration of RDBMS, java/python applications, model code, Opensearch etc.
- Solid programming background on scala and/or python with Spark
- Experience with Docker and Kubernetes is a plus