Senior Specialist - Data Engineering (Technical Lead with Snowflake, Python & Azure)
Apply NowCompany: Futran Tech Solutions Pvt. Ltd.
Location: Chicago, IL 60629
Description:
Job Summary
We are looking for a highly motivated and experienced Implementation Technical Lead to oversee the end to end Integration of our core applications that support our alternatives business The ideal candidate will need to be
highly skilled in Python with expertise in Azure Function Apps Azure SQL Snowflake databases REST APIs and API integration The candidate will be responsible for designing developing and maintaining scalable and efficient applications in data engineering platform architecture sound technical knowledge on full stack technologies Java or Python and will work on diverse projects from building APIs and web applications to data processing and automation around the data platform while ensuring alignment with business and technical requirements This role requires Python programming and related frameworks along with strong data engineering and problem solving skills mindset
Key Responsibilities
Lead the development design development and deployment of data pipelines storage solutions and analytic tools
Ensure scalability reliability and security of the platform to meet current and future demands
Oversee the implementation of data lakes warehouses and ELTETL pipelines on azure and snowflake
Develop and Review code and ensure adherence to development best practices and standards
Foster a culture of collaboration innovation and continuous improvement within the team
Drive integration of real-time and batch data processing capabilities
Ensure compliance with data governance policies security and regulatory requirements
Implement robust data quality lineage and cataloguing processes
Build and integrate APIs and backend systems using frameworks like Django Flask or Fast API
Develop scripts and tools for data analysis transformation and automation
Write unit tests integration tests and conduct debugging to ensure software quality
Work closely with cross functional teams including developers product managers business analysts and other stakeholders to align the data platform with organizational goals
Translate business requirements into scalable technical solutions
Qualifications
Proven experience in leading the design and development of large scale data platform
Proven experience as a full stack developer or similar role
Expertise in data platform technologies snowflake Azure SQL Server
Proficiency in data engineering tools and frameworks Apache Kafka Spark
Strong understanding of cloud platforms Azure and containerization Docker Kubernetes
Experience with both batch and real-time data processing
Deep knowledge of SQL and programming languages JAVA or Python
Strong Problem solving communication and leadership skills
Experience of code deployments using CICD Pipelines
Proficiency with code repos GitHub
Knowledge and experience developing restful APIs
Certifications in Snowflake Azure
Experience in Alternatives Private equity Private Capital Co investments debt venture capital hedge and real assets domain
working with private market industry solutions Investran Alter domus I Capital Subscribe backstop chronograph
Strong understanding of private market operations investment lifecycle and structures and fund life cycle
Technology certifications on Azure snowflake Domain certifications on CFA
We are looking for a highly motivated and experienced Implementation Technical Lead to oversee the end to end Integration of our core applications that support our alternatives business The ideal candidate will need to be
highly skilled in Python with expertise in Azure Function Apps Azure SQL Snowflake databases REST APIs and API integration The candidate will be responsible for designing developing and maintaining scalable and efficient applications in data engineering platform architecture sound technical knowledge on full stack technologies Java or Python and will work on diverse projects from building APIs and web applications to data processing and automation around the data platform while ensuring alignment with business and technical requirements This role requires Python programming and related frameworks along with strong data engineering and problem solving skills mindset
Key Responsibilities
Lead the development design development and deployment of data pipelines storage solutions and analytic tools
Ensure scalability reliability and security of the platform to meet current and future demands
Oversee the implementation of data lakes warehouses and ELTETL pipelines on azure and snowflake
Develop and Review code and ensure adherence to development best practices and standards
Foster a culture of collaboration innovation and continuous improvement within the team
Drive integration of real-time and batch data processing capabilities
Ensure compliance with data governance policies security and regulatory requirements
Implement robust data quality lineage and cataloguing processes
Build and integrate APIs and backend systems using frameworks like Django Flask or Fast API
Develop scripts and tools for data analysis transformation and automation
Write unit tests integration tests and conduct debugging to ensure software quality
Work closely with cross functional teams including developers product managers business analysts and other stakeholders to align the data platform with organizational goals
Translate business requirements into scalable technical solutions
Qualifications
Proven experience in leading the design and development of large scale data platform
Proven experience as a full stack developer or similar role
Expertise in data platform technologies snowflake Azure SQL Server
Proficiency in data engineering tools and frameworks Apache Kafka Spark
Strong understanding of cloud platforms Azure and containerization Docker Kubernetes
Experience with both batch and real-time data processing
Deep knowledge of SQL and programming languages JAVA or Python
Strong Problem solving communication and leadership skills
Experience of code deployments using CICD Pipelines
Proficiency with code repos GitHub
Knowledge and experience developing restful APIs
Certifications in Snowflake Azure
Experience in Alternatives Private equity Private Capital Co investments debt venture capital hedge and real assets domain
working with private market industry solutions Investran Alter domus I Capital Subscribe backstop chronograph
Strong understanding of private market operations investment lifecycle and structures and fund life cycle
Technology certifications on Azure snowflake Domain certifications on CFA