Technical Lead
Apply NowCompany: Tata Consultancy Services
Location: Columbus, OH 43230
Description:
Skill: Databricks Tech Lead
Salary Range - $95,000-$120,000 a year
#LI-NS2
- Responsible for designing, building, and maintaining pipelines that transform raw data into actionable insights in the Databricks environment.
- They utilize tools like Apache Spark to manage large datasets, optimize data flow, and ensure efficient data processing.
- Experience in generating data models, delivering data collection, storage, access, and analytics data platform solutions, and implementing database back-up, recovery, and archiving strategy.
- Real time data ingestion using Stream sets.
- Experience UDM Model.
- Experience in Dimensional Modelling, Data Migration, Data Cleansing, Data conversion and bridging, and ETL techniques on multiple databases and operating systems.
- Python, Databricks, perl, spark, Kubernetes, dockers and other cloud native tools and technologies.
- Provide solution design guidance to other technical staff, and assist in integrating various systems.
- Consult with users to determine requirements needed to guide development of the data models.
- Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
- Write SQL, Python, and PySpark code for efficient data processing and transformation.
- Understand and translate business requirements into technical designs.
- Develop mapping documents and transformation rules as per project scope.
- Communicate project status with stakeholders, ensuring smooth project execution.
Salary Range - $95,000-$120,000 a year
#LI-NS2