Engineer
Apply NowCompany: Tata Consultancy Services
Location: Columbus, OH 43230
Description:
Skill: Data Engineer
Must have skills:
Generic Managerial skills:
Salary Range - $90,000-$120,000 a year
#LI-NS2
- Expertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks.
- Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources into Cloud data ware houses.
- Proficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability.
- Experience in data extraction, data acquisition, transformation, data manipulation, performance tuning and data analysis.
- Experience in Python libraries to build efficient data processing workflows and streamline ETL operations across large data sets and similar distributed systems.
- Expertise in automating data quality checks, reducing data errors and ensuring more reliable reporting and analytics with data marts.
- Experience in deployment activities.
Must have skills:
- Pyspark.
- Python.
- Data warehousing experience.
- ETL Process.
- Deployment experience.
Generic Managerial skills:
- Machine Learning: Experience with integrating machine learning models into data pipelines.
- DevOps Practices: Familiarity with CI/CD pipelines and infrastructure as code (IaC).
- Data Visualization: Knowledge of data visualization tools like Power BI, Tableau, or similar.
- Soft Skills: Strong interpersonal and communication skills, with the ability to work effectively in a team environment.
Salary Range - $90,000-$120,000 a year
#LI-NS2