Senior Software Developer

Job Description:

Responsibilities:

• Design, develop, test and implement:
• data pipelines using Python and AWS services (Glue, StepFunctions, Lambda)
• complex data transformation procedures
• data models for the efficient storing of data in relational databases as well as in unstructured data repositories
• reusable classes and modules to enhance the maintainability and ability to deliver solutions quickly.
• Review existing code base and assist other more junior team members ensuring a consistent level of quality.
• ssess new business requirements and propose adequate technical solutions (using on-prem and on-cloud resources)
• Monitor automatic execution of the various data loads and proactively address issues such as data processing errors or performance degradations.

AWS Cloud Experience:

• Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)
• Experience using AWS Services such as Glue, StepFunctions, Lambda, S3 or equivalent

Data Warehouse:

• Extract/Transform/Load data (ideally Informatica experience on Cloud).

Experience and Skill Set Requirements:
General Development Experience (Python):

• Server-side scripting.
• Working with XLSX, CSV, JSON files, relational databases, structured and unstructured data.
• Data engineering and .processes automation.
• Linux experience

WS Cloud Experience:

• Experience using AWS Services such as Glue, StepFunctions, Lambda, S3 or equivalent.
• Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)

Data Warehouse:

• Data modeling (relational & dimensional), advanced SQL.
• Extract/Transform/Load data.
• Data reporting/visualization.

Software Development Life Cycle:

• Full SDLC from requirements gathering, design, implementation, testing to deployment and production support.
• Familiar with project management (agile/scrum and waterfall).
• Change and Incident management.

General Skills:

• Communication, presentation, negotiation skills, Consulting, problem-solving and decision-making skills.
• Public sector experience.