Azure Databricks Architect
Apply NowCompany: Tata Consultancy Services
Location: Alpharetta, GA 30022
Description:
MUST HAVE SKILLS
Roles & Responsibilities
Salary Range-$100,000-$140,000 a year
#LI-KR1
- Experience: Proven experience as a Data Architect or similar role with extensive experience in designing and implementing solutions on Azure Databricks.
- Technical Skills: o Proficiency with Azure Databricks, Apache Spark, and data processing frameworks.
- Strong experience with Azure services (e.g., Azure Data Lake, Azure Synapse, Azure SQL).
- Familiarity with data modeling, ETL processes, and data warehousing concepts.
- Knowledge of programming languages such as o Python, Scala, or SQL. Skills:
- Excellent problem-solving and analytical skills. o Strong communication and collaboration skills.
- Ability to manage multiple projects and prioritize tasks effectively. Certifications (Preferred): Azure Data Engineer or Azure Solutions Architect certifications.
Roles & Responsibilities
- Architecture Design: Design and architect scalable and high-performance data solutions on Azure Databricks, including data pipelines, data lakes, and real-time processing systems.
- Implementation: Lead the implementation of Azure Databricks solutions, ensuring best practices for performance, security, and data governance.
- Integration: Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL Database, as well as third-party tools and data sources.
- Optimization: Monitor and optimize data workflows and queries for performance and cost efficiency.
- Collaboration: Work closely with data engineers, data scientists, and business stakeholders to understand requirements and deliver effective solutions.
- Governance: Ensure data governance and security policies are implemented and adhered to within the Databricks environment. Documentation: Create and maintain documentation for architecture, processes, and best practices.
- Mentorship: Provide guidance and mentorship to junior team members and help them with technical challenges.
Salary Range-$100,000-$140,000 a year
#LI-KR1