11267 - Data Engineer Level 3
Apply NowCompany: Strategic Data Systems Business Solutions
Location: Cincinnati, OH 45238
Description:
07th October, 2024
Data Engineer Level 3
For more than three decades, Strategic Data Systems (SDS) has been a software consultancy firm specializing in strategy, technology, and business transformation for Fortune 100 companies, mid-sized firms, and startups. At SDS, we empower our development teams to address our clients' critical business challenges by leveraging cutting edge technologies. If you seek a workplace where your contributions are truly appreciated, then SDS is the company for you. Join us today to work alongside fellow development specialists and become a crucial part of our dynamic and cohesive community.
What You'll Do
We are seeking a Sr. Data Engineer who need to join our dynamic and fast-paced team. The ideal candidate should excel in development or pipeline, orchestrating data, resolving connection issue, solve production issues, guide team members. The successful candidate will play a critical role in leading the development and design of Supply Chain Data Engineering solutions, maintaining high standards of code quality, and reducing technical debt and vulnerabilities across the project. The ideal candidate should be able to work in shared service team and work in multiple initiatives parallelly.
1.Python Unit Testing
2.Unity Catalog
3.Databricks Asset Bundles
4.Unit Testing/Mocking
What You'll Get
SDS, Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.
Data Engineer Level 3
For more than three decades, Strategic Data Systems (SDS) has been a software consultancy firm specializing in strategy, technology, and business transformation for Fortune 100 companies, mid-sized firms, and startups. At SDS, we empower our development teams to address our clients' critical business challenges by leveraging cutting edge technologies. If you seek a workplace where your contributions are truly appreciated, then SDS is the company for you. Join us today to work alongside fellow development specialists and become a crucial part of our dynamic and cohesive community.
What You'll Do
We are seeking a Sr. Data Engineer who need to join our dynamic and fast-paced team. The ideal candidate should excel in development or pipeline, orchestrating data, resolving connection issue, solve production issues, guide team members. The successful candidate will play a critical role in leading the development and design of Supply Chain Data Engineering solutions, maintaining high standards of code quality, and reducing technical debt and vulnerabilities across the project. The ideal candidate should be able to work in shared service team and work in multiple initiatives parallelly.
- Development: - Working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation, Terraform scripting and DevOps process.
- Lead Development Initiatives: Develop code with FTR and of quality. Also to take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards.
- Code Quality and Maintenance: Oversee the maintenance of code quality and enforce best practices, including code reviews, unit testing, CICD, and adherence to coding standards.
- Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address vulnerabilities in the codebase.
- Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment.
- Collaboration: Work closely with cross-functional teams, including product management, Cloud Security, LOB, Network security, and DevOps, to integrate different features into broader solutions.
- Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience.
- Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance.
- Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives.
- Azure Cloud Experience - Must have
- Data Bricks
- PySpark, Python
- Object oriented programming concepts
- Passion for Data/Data Engineering as a career
- Terraform related work experience
- Technical skills: Azure, Databricks, PySpark, Object Oriented programming concept, Python, Delta share and Terraform
- GitHub Actions: Familiarity with setting up and managing CI/CD pipelines using GitHub Actions, ensuring smooth and automated deployment processes.
- Agile Methodology: Experience working in an Agile/Scrum environment, with a focus on iterative development, continuous feedback, and delivery.
- Proven experience in a similar role, with a strong track record as Sr. Data Engineer and has helped/lead development teams in delivering high-quality data orchestration solutions with min 7+ years' experience.
1.Python Unit Testing
2.Unity Catalog
3.Databricks Asset Bundles
4.Unit Testing/Mocking
What You'll Get
SDS, Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.
- Competitive base salary
- Medical, dental, and vision insurance coverage
- Optional life and disability insurance provided
- 401(k) with a company match and optional profit sharing
- Paid vacation time
- Paid Bench time
- Training allowance offering
- You'll be eligible to earn referral bonuses!