Senior Data Engineer in Data Platform and Engineering Services
Apply NowCompany: RICEFW Technologies, Inc.
Location: O Fallon, MO 63366
Description:
Job Description Summary
Job Description Summary
Overview
A global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
As a Sr. Data Engineer in Data Platform and Engineering Services, you will have the opportunity to build high performance data pipelines to load into Mastercard Data Warehouse. Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems.
Role
Develop high quality, secure and scalable data pipelines using spark, Java/Scala on object storage and Hadoop
Follow MasterCard Quality Assurance and Quality Control processes
Leverage new technologies and approaches to innovating with increasingly large data sets
Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems
Perform assigned tasks and production incident independently
Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency
All About You
7 to 9 years of experience in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment
Experience of building data pipelines through Spark with Java/Scala on Hadoop or Object storage
Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge
Experience of working on Nifi will be an added advantage
Experience of working with APIs will be an added advantage
Experience and working in Unix environment is added advantage
Experience of working in Agile teams
Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
Strong communication skills - both verbal and written - and strong relationship, collaboration skills and organizational skills
Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
Flexibility to work as a member of a matrix based diverse and geographically distributed project teamsLocation: O'Fallon, Missouri (Main Campus) There is a requirement to be onsite 2 to 3 days a week Person will be expected to be onsite DAY 1 LOCAL Candidates are highly preferred and will get first preference - if someone is not local and does not live too far and can relocate within 1 or 2 weeks that could work but please know that any non-local candidates will be replaced/swapped out for locals so the goal should be to find local Please source some new candidates based off these new notes below. Any experience with benchmarking will be a huge plus and he made a lot of emphasis on that skill on the call so please try and find that in a candidate. 3 Openings even thought this is for 1 listing. Open to taking multiple candidates. All 3 are the same skillset. Data Analysis & Data Benchmarking. Preference on Python or ETL Data Pipeline skill would be good. If someone has Data Science knowledge, might dedicate one role to that person but primarily all 3 will be of the same role. Wants strong Data Analytical skills. Trying to migrate our legacy system into a modernized architecture. Concentrate on benchmarking and comparing with the new system Top Skills: SQL or any data analysis, well versed with programming language- prefers python or even Java, spark helps Data Benchmarking Roles experience is ideal. Data Engineering background will help. With Benchmarking (we have a Hadoop system where big data comes into play a lot) Automating Onsite schedule: flexible but come into the office 3x a week. The team will be based out of STL. Tues, Thurs for sure and the 3rd day unsure, but once a month will need to be in the office on a Monday or Friday Interview at least 1 hour with video and technical / whiteboarding Looking to hire as soon as possible - start date will be set for 10 business days after the offer is made
Job Description Summary
Overview
A global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
As a Sr. Data Engineer in Data Platform and Engineering Services, you will have the opportunity to build high performance data pipelines to load into Mastercard Data Warehouse. Our Data Warehouse provides analytical capabilities to a number of business users who help different customers provide answers to their business problems through data. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems.
Role
Develop high quality, secure and scalable data pipelines using spark, Java/Scala on object storage and Hadoop
Follow MasterCard Quality Assurance and Quality Control processes
Leverage new technologies and approaches to innovating with increasingly large data sets
Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems
Perform assigned tasks and production incident independently
Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency
All About You
7 to 9 years of experience in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment
Experience of building data pipelines through Spark with Java/Scala on Hadoop or Object storage
Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge
Experience of working on Nifi will be an added advantage
Experience of working with APIs will be an added advantage
Experience and working in Unix environment is added advantage
Experience of working in Agile teams
Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
Strong communication skills - both verbal and written - and strong relationship, collaboration skills and organizational skills
Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
Flexibility to work as a member of a matrix based diverse and geographically distributed project teamsLocation: O'Fallon, Missouri (Main Campus) There is a requirement to be onsite 2 to 3 days a week Person will be expected to be onsite DAY 1 LOCAL Candidates are highly preferred and will get first preference - if someone is not local and does not live too far and can relocate within 1 or 2 weeks that could work but please know that any non-local candidates will be replaced/swapped out for locals so the goal should be to find local Please source some new candidates based off these new notes below. Any experience with benchmarking will be a huge plus and he made a lot of emphasis on that skill on the call so please try and find that in a candidate. 3 Openings even thought this is for 1 listing. Open to taking multiple candidates. All 3 are the same skillset. Data Analysis & Data Benchmarking. Preference on Python or ETL Data Pipeline skill would be good. If someone has Data Science knowledge, might dedicate one role to that person but primarily all 3 will be of the same role. Wants strong Data Analytical skills. Trying to migrate our legacy system into a modernized architecture. Concentrate on benchmarking and comparing with the new system Top Skills: SQL or any data analysis, well versed with programming language- prefers python or even Java, spark helps Data Benchmarking Roles experience is ideal. Data Engineering background will help. With Benchmarking (we have a Hadoop system where big data comes into play a lot) Automating Onsite schedule: flexible but come into the office 3x a week. The team will be based out of STL. Tues, Thurs for sure and the 3rd day unsure, but once a month will need to be in the office on a Monday or Friday Interview at least 1 hour with video and technical / whiteboarding Looking to hire as soon as possible - start date will be set for 10 business days after the offer is made