Core Data Engineer
Apply NowCompany: Diverse Lynx LLC
Location: Phoenix, AZ 85032
Description:
Skills: Digital : DevOps Continuous Integration and Continuous Delivery (CI/CD), Cloud Bees
Job Description:
Core Data Engineering Skills Proficiency in using GCP's big data tools like:o Big Query: For data warehousing and SQL analytics. o Dataproc: For running Spark and Hadoop clusters. o GCP Dataflow: For stream and batch data processing. (High level Idea)o GCP Pub/Sub: For real-time messaging and event ingestion. (High level Idea)o Expertise in building automated, scalable, and reliable pipelines using custom Python/Scala solutions or Cloud Data Functions. 2. Programming and Scripting Strong coding skills in SQL, and Java. Familiarity with APIs and SDKs for GCP services to build custom data solutions. 3. Cloud Infrastructure
Understanding of GCP services such as Cloud Storage, Compute Engine, and Cloud Functions.
Familiarity with Kubernetes (GKE) and containerization for deploying data pipelines. (Optional but Good to have)4. DevOps and CI/CD
Experience setting up CI/CD pipelines using Cloud Build, GitHub Actions, or other tools.
Monitoring and logging tools like Cloud Monitoring and Cloud Logging for production workflows.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Job Description:
Understanding of GCP services such as Cloud Storage, Compute Engine, and Cloud Functions.
Familiarity with Kubernetes (GKE) and containerization for deploying data pipelines. (Optional but Good to have)4. DevOps and CI/CD
Experience setting up CI/CD pipelines using Cloud Build, GitHub Actions, or other tools.
Monitoring and logging tools like Cloud Monitoring and Cloud Logging for production workflows.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.