AWS Databricks Admin

Apply Now

Company: Efficus, Inc.

Location: Charlotte, NC 28269

Description:

Job Description:

Bachelor's degree in computer science, Information Technology, or a related field.
Proven experience in cloud computing, specifically AWS, with a focus on GovCloud.
Strong understanding of Databricks and its integration with AWS services

Responsibilities:

1. Platform Management:

Administer and maintain the Databricks environment within AWS GovCloud.
Monitor Databricks workflows, clusters, and jobs to ensure optimal performance and uptime.

2. Security and Compliance:

Ensure compliance with government and organizational security standards.
Manage access controls and permissions for Databricks users in alignment with security policies.

3. Performance Optimization:

Analyze system performance and implement improvements for performance tuning and resource optimization.
Collaborate with data engineering and analytics teams to optimize data pipelines and workflows.

4. Integration and Automation:

Implement automation solutions for reporting, monitoring, and resource provisioning within Databricks.
Work with APIs and SDKs for seamless integration with other AWS services and third-party tools.

5. User Support and Training:

Provide technical support to users and troubleshoot issues related to Databricks.
Conduct training sessions and workshops for users to help them leverage the capabilities of Databricks effectively.

6. Collaboration:

Collaborate with DevOps, security, and data engineering teams to support deployment strategies and best practices.
Participate in cross-functional projects, ensuring data governance and integrity.

7. Documentation and Reporting:

Maintain comprehensive documentation related to Databricks configurations, procedures, and best practices.
Generate and analyze reports on system usage, performance metrics, and compliance adherence.

Skills