Senior Data & Integration Engineer

Description:

Senior Data & Integration Engineer
Senior Data & Integration Engineer who is a self-starter to work in a diverse and fast-paced environment that can join our Enterprise Sourcing & Procurement Technology Team. This is an individual contributor role that is responsible for the design and development of data and integration solutions that are strategic for the business and built on the latest technologies and patterns. This is a global role that requires partnering with the broader client team at the country, regional and global level by utilizing in-depth knowledge of data, infrastructure, technologies and data engineering experience.

Responsibilities:

• Independently planning, designing, developing, executing, and monitoring complex data integration activities to support project delivery and daily operation.
• Defining, implementing, debugging, and optimizing data integration mappings and scripts from a variety of data sources.
• Spearheading the development of ETL code, metadata definitions, and models, queries, scripts, schedules, work processes, and maintenance procedures.
• Building and maintaining APIs, along with developing integration patterns based on API technologies and event-based messages.
• Mentoring less experienced analysts on proper standards/techniques to improve their accuracy and efficiency.
• Performing unit testing, system integration testing, and regression testing, and assisting with user acceptance testing.
• Contributing to the design of information infrastructure and data management processes to move the organization towards a more sophisticated, agile, and robust target state data architecture.
• Articulating business requirements into a technical solution that can be designed and engineered.
• Consulting with the business to develop documentation and communication materials to ensure accurate usage and interpretation of data.
• Developing an understanding of how the data flows from various source systems and source types to fine-tune the data integration solution.
• Developing systems that ingest, cleanse, and normalize diverse datasets, creating data pipelines from various internal and external sources, and building structure for previously unstructured data.

Qualifications/Skills:

• A Bachelor's degree in Information Science, Computer Science, Mathematics, Statistics, or a quantitative discipline in science, business, or social science.
• A minimum of 5-7+ years of relevant experience.
• Strong computer science fundamentals.
• Excellent technical, analytical, and organizational skills.
• Effective written and verbal communication skills, including technical writing.
• Experience as a data developer using Python, Kafka, Spark Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Azure Search, etc.
• Experience in building and maintaining APIs and developing integration patterns based on API technologies and event-based messages.
• Experience handling unstructured data, working in a data lake environment, leveraging data streaming, and developing data pipelines driven by events/queues.
• Hands-on engineering leadership skills, with a curiosity about technology, adaptability to change, and understanding of the technologies supporting areas such as Cloud Computing (AWS, Azure preferred), Micro Services, Streaming Technologies, Network, Security, etc.
• Proven reliability, self-motivation, and self-discipline, with the capability to execute on multiple projects simultaneously within a fast-paced environment, working with cross- functional teams.

• Overall, candidate needs to have:
  • Enterprise Integrations experience with a large client
  • 3rd Party SaaS experience developing/using APIs
  • Azure experience is HIGHLY preferred (if have AWS or GCP it is good, but Azure experience would obviously eliminate one learning curve)
• Background:
  • Currently, client is rolling out Aravo for their vendor/supplier management system - they also have other existing systems such as Jagger this resource will interact with as well. They don't need specific experience with Aravo or Jagger, but really the experience developing the APIs.
  • There is a Data Team that manages Enterprise Data Platform (EDP) and this resource will work with the Data Team and the Aravo team and the Jagger team to develop and create the APIs
  • Resource needs to have heavy experience with API integration points, and bringing those together in event-based integration patterns - in some case there may be batch-based integrations needed.