Big Data Cloud Developer (Senior)
Apply NowCompany: Appcast
Location: Montreal, QC H1A 0A1
Description:
Big Data Cloud Developer (Senior)
Category: Software Development/ Engineering
Main location: Canada, Quebec, Montral
Position ID:J0425-1237
Employment Type: Full Time
Position Description:
As Big Data Cloud Expert, you are part of a global central team distributed between Montral and Paris, with multiple responsibilities related to our Data Lake platform on Microsoft Azure cloud. Member of the team, you are the main point of contact for AMER region projects, in front of the teams using the platform for various business lines.
Your future duties and responsibilities:
That Data Lake platform is leveraging various Open-Source technologies, such as Spark or Kafka, but also leverage on Azure specific technologies, as Azure Storage, HDInsight, Synapse, Fabric, AKS, etc.
The platform is self-service, with as much automation as possible, with strong requirements on security due to our regulated environment, with also stability in mind for critical business processes.
You'll participate to the design of the evolution of the platform ad project transformation, implementation and production support as well. You'll also provide your expertise to projects onboarding on the platform.
Your Big Data skills are as important as your Azure skills in that context, along with good understanding of performance and security concepts.
For your role, you will oversee the following missions:
Identify future needs and improvements, design the solutions to be validated with the rest of the team
Test and evaluate new Azure technologies, work with security team and Microsoft teams to make them available in our secured environment
Participate to the implementation of the solution, build automation and monitoring for a stable self-service offer
Provide trainings on data state-of-art
Help data project teams to onboard and transform on/in Azure
Train other members of the team and advise other teams on the implementation of their Big Data projects
Participate to the production support, with overtime when necessary, and communication on incidents with our AMER users.
It's a wide role with covering many topics, and great opportunity to learn new things.
Required qualifications to be successful in this role:
Technical stack
JAVA | AZURE | SPARK | AKS - KUBERNETES | FABRIC
Must Have:
5+ years of development and architecture experience with Java, building multi-threaded applications, APIs
Very good experience utilizing Big Data technologies, such as Hadoop, Kafka and/or Azure Kubernetes Service, OpenTable formats like Delta or Iceberg
Good experience on Microsoft Azure cloud technologies, such as Azure Storage, Azure Synapse, Azure AI search
Good experience using Apache Spark
Previous experience with Oracle SQL or PostgreSQL or similar RDBMS background
Nice to Have:
Good working knowledge of the following:
Terraform
PowerShell / Bash
Experience with Continuous Integration / Continuous Delivery using modern DevOps tools and workflows such as git, GitHub, Jira, Docker, and Jenkins
Bachelor's degree in computer science, DEC, or equivalent technical Certifications
Languages: French and English* are required.
*Ability to communicate in English, both orally and in writing, is a requirement as the person in this position will need to collaborate regularly with colleagues and partners in the United States.
Loc: Montreal
#LI-AR1
Skills:
What you can expect from us:
Together, as owners, let's turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because...
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.
Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.
Come join our team-one of the largest IT and business consulting services firms in the world.
Category: Software Development/ Engineering
Main location: Canada, Quebec, Montral
Position ID:J0425-1237
Employment Type: Full Time
Position Description:
As Big Data Cloud Expert, you are part of a global central team distributed between Montral and Paris, with multiple responsibilities related to our Data Lake platform on Microsoft Azure cloud. Member of the team, you are the main point of contact for AMER region projects, in front of the teams using the platform for various business lines.
Your future duties and responsibilities:
That Data Lake platform is leveraging various Open-Source technologies, such as Spark or Kafka, but also leverage on Azure specific technologies, as Azure Storage, HDInsight, Synapse, Fabric, AKS, etc.
The platform is self-service, with as much automation as possible, with strong requirements on security due to our regulated environment, with also stability in mind for critical business processes.
You'll participate to the design of the evolution of the platform ad project transformation, implementation and production support as well. You'll also provide your expertise to projects onboarding on the platform.
Your Big Data skills are as important as your Azure skills in that context, along with good understanding of performance and security concepts.
For your role, you will oversee the following missions:
Identify future needs and improvements, design the solutions to be validated with the rest of the team
Test and evaluate new Azure technologies, work with security team and Microsoft teams to make them available in our secured environment
Participate to the implementation of the solution, build automation and monitoring for a stable self-service offer
Provide trainings on data state-of-art
Help data project teams to onboard and transform on/in Azure
Train other members of the team and advise other teams on the implementation of their Big Data projects
Participate to the production support, with overtime when necessary, and communication on incidents with our AMER users.
It's a wide role with covering many topics, and great opportunity to learn new things.
Required qualifications to be successful in this role:
Technical stack
JAVA | AZURE | SPARK | AKS - KUBERNETES | FABRIC
Must Have:
5+ years of development and architecture experience with Java, building multi-threaded applications, APIs
Very good experience utilizing Big Data technologies, such as Hadoop, Kafka and/or Azure Kubernetes Service, OpenTable formats like Delta or Iceberg
Good experience on Microsoft Azure cloud technologies, such as Azure Storage, Azure Synapse, Azure AI search
Good experience using Apache Spark
Previous experience with Oracle SQL or PostgreSQL or similar RDBMS background
Nice to Have:
Good working knowledge of the following:
Terraform
PowerShell / Bash
Experience with Continuous Integration / Continuous Delivery using modern DevOps tools and workflows such as git, GitHub, Jira, Docker, and Jenkins
Bachelor's degree in computer science, DEC, or equivalent technical Certifications
Languages: French and English* are required.
*Ability to communicate in English, both orally and in writing, is a requirement as the person in this position will need to collaborate regularly with colleagues and partners in the United States.
Loc: Montreal
#LI-AR1
Skills:
- English
- French
- Apache Kafka
- Apache Spark
- Kubernetes
What you can expect from us:
Together, as owners, let's turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because...
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.
Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.
Come join our team-one of the largest IT and business consulting services firms in the world.