Senior Big Data Engineer
Apply NowCompany: Luxoft
Location: Stamford, CT 06902
Description:
Project description
ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:
Scalable cost-efficient infrastructure, using cloud PaaS components.
Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
Shared across Front Office, Finance and Risk, improving regulatory compliance.
One-Platform / One-Experience -fast to train, easy to operate, retaining talent.
The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.
Responsibilities
Development of big data technologies like Apache Spark and Azure Databricks
Programming complex production systems in Scala or Java or Python
Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
Experience with containerisation in development, build and runtime environments including experience of KubernetesNY salary
140-150K/year
Skills
Must have
Development of big data technologies like Apache Spark and Azure Databricks
Programming complex production systems in Scala or Java or Python
Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
Experience with containerisation in development, build and runtime environments including experience of Kubernetes
Nice to have
Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
Python experience
Testing and instrumentation practices, observability and alerting tooling
Understanding of information modelling, data structures and algorithms
Technical architecture and low-level design
Agile development and planning practices
Ability to collaborate effectively in a large global team and influence key architectural decisions
Other
Languages
English: C1 Advanced
Seniority
Senior
ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:
Scalable cost-efficient infrastructure, using cloud PaaS components.
Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
Shared across Front Office, Finance and Risk, improving regulatory compliance.
One-Platform / One-Experience -fast to train, easy to operate, retaining talent.
The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.
Responsibilities
Development of big data technologies like Apache Spark and Azure Databricks
Programming complex production systems in Scala or Java or Python
Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
Experience with containerisation in development, build and runtime environments including experience of KubernetesNY salary
140-150K/year
Skills
Must have
Development of big data technologies like Apache Spark and Azure Databricks
Programming complex production systems in Scala or Java or Python
Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
Experience with containerisation in development, build and runtime environments including experience of Kubernetes
Nice to have
Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
Python experience
Testing and instrumentation practices, observability and alerting tooling
Understanding of information modelling, data structures and algorithms
Technical architecture and low-level design
Agile development and planning practices
Ability to collaborate effectively in a large global team and influence key architectural decisions
Other
Languages
English: C1 Advanced
Seniority
Senior