Senior Data Engineer

Job Summary:

We are seeking a Senior Data Engineer to join our IT Operations team, responsible for transforming operational data into meaningful insights that drive efficiency, optimize service performance, and enhance decision-making. The ideal candidate will be a hands-on data expert with experience in designing scalable data pipelines, developing analytical models, and working with large datasets to extract actionable intelligence.

What the candidate will do

• Demonstrate strong knowledge of and ability to operationalize, leading data technologies and best practices.
• Applying data modeling techniques to organize and transform data into meaningful and valuable output; and profiling large quantities of data to provide appropriate recommendations for products and/or processes.
• Design, build, automate and maintain data tools and solutions (e.g., pipelines, models, tables) to acquire, process, and store IT operation data by ensuring the accessibility, reliability, and quality of data for end users and to support reporting and data requirements.
• Research and recommend technologies and processes to support rapid scale and future state growth initiatives from the data front.
• Prioritize business needs, leadership questions, and ad-hoc requests for on-time delivery.
• Collaborate with internal business units and data teams on business requirements, data access, processing/transformation and reporting needs and leverage existing and new tools to provide solutions.
• Collaborate on architecture and technical design discussions to identify and evaluate high impact process initiatives.
• Lead the implementation of data governance, access control and identify and reduce security risks.
• Perform and participate in code reviews, peer inspections and technical design/specifications.
• Develop performance metrics to establish process success and work cross-functionally to consistently and accurately measure success over time
• Delivers measurable business process improvements while re-engineering key processes and capabilities and maps to future-state vision
• Prepare documentations and specifications on detailed design.
• Be able to work in a globally distributed team in an Agile/Scrum approach.

Basic Qualifications

• Master's or Bachelor's Degree in computer science or similar technical field of study or equivalent practical experience.
• 7 years professional software development experience, including experience in the Data Engineering space
• Interact with product managers, and business stakeholders to understand data needs and help build data infrastructure that scales across the company
• Strong SQL skills - knows advanced level SQL coding (windows functions, CTEs, dynamic variables, Hierarchical queries, Materialized views etc)
• Experience with data-driven architecture and systems design knowledge of Hadoop related technologies such as HDFS, Apache Spark, Apache Flink, Hive, and Presto.
• Familiarity with metrics such as MMTR (Mean Minutes to Repair) and MTTD (Mean Time to Detect).
• Good hands-on experience with Object-Oriented programming languages like Python. Familiarity with Python data processing packages like Pandas and NumPy is a bare minimum.
• Proven experience in large-scale distributed storage and database systems (SQL or NoSQL, e.g. HIVE,MySQL, Cassandra) and data warehousing architecture and data modeling.
• Working experience in cloud technologies like GCP, AWS, Azure
• Knowledge of reporting tools like Tableau, Looker Studio and/or other BI tools.