Data Engineer - Python
Apply NowCompany: Libsys, Inc.
Location: Houston, TX 77084
Description:
Job Title: Data Engineer - Python
Location: Houston, Texas (Onsite)
Job Description:
The successful candidate will meet the following qualifications:
Responsibilities include:
Location: Houston, Texas (Onsite)
Job Description:
The successful candidate will meet the following qualifications:
- 10+ years in IT and 7+ years of programming experience in Python.
- Expertise in developing and maintaining data pipelines.
- Experience in testing, packaging, and deploying machine learning models.
- Experience in software engineering practices such as Design Principles and Patterns, Unit Testing, Refactoring, CI/CD, and version control.
- Expertise in Object-Oriented Design Principals and Functional Programming Principals
- Experience with common Python Data Engineering packages including Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3
- Experience in storage technologies including SQL relational databases and Object Storage such as AWS S3
- Experience in implementing distributed computing systems.
- Experience in designing modular, reusable software components.
- Experience in developing API endpoints and microservices.
- Knowledgeable of MLOps Principles
- Knowledgeable of ML platform technologies including Apache Airflow, Kubernetes, Dask, Ray, and MLFlow
Responsibilities include:
- Work directly with Business domain experts and Data Scientists to develop high quality, reliable, scalable, machine learning systems.
- Design and implement frameworks and tools to streamline the machine learning process.
- Automate manual data collection and processing tasks to improve efficiency.
- Leverage software architecture and design patterns to develop fault tolerant microservices.
- Convert research-based machine learning models into production-ready software.
- Implement processes to ensure coding standards, code quality, documentation, and test coverage.