Kafka Administrator
Apply NowCompany: Diverse Lynx LLC
Location: Dallas, TX 75217
Description:
Job Summary: We are seeking an experienced Confluent Kafka Administrator to manage and maintain our Kafka infrastructure. The ideal candidate will have a minimum of 5 years of experience with Confluent Kafka and a strong background in data streaming and real-time data processing.
Key Responsibilities:
Kafka Cluster Management: Install, configure, and manage Kafka clusters, including Confluent Kafka components.
Monitoring and Performance Tuning: Monitor Kafka clusters for performance, reliability, and capacity planning. Optimize Kafka performance and troubleshoot issues.
Security: Implement and manage security measures for Kafka clusters, including encryption, authentication, and authorization.
Data Integration: Work with development teams to integrate Kafka with various data sources and sinks.
Upgrades and Patching: Plan and execute upgrades and patches for Kafka clusters to ensure they are up-to-date with the latest features and security fixes.
Disaster Recovery: Develop and maintain disaster recovery plans for Kafka clusters.
Documentation: Create and maintain documentation for Kafka configurations, processes, and procedures.
Support: Provide support for Kafka-related issues and work closely with other teams to resolve any problems.
Topic Management: Manage Kafka topics, including adding and removing topic configurations, setting cleanup policies, and configuring retention times.
Required Skills and Qualifications:
Experience: Minimum of 5 years of experience with Confluent Kafka.
Technical Skills: Strong knowledge of Kafka architecture, Food and Beverage mode (Kafka Raft), Kafka Connect, Kafka Streams, and KSQL.
Scripting and Automation: Proficiency in scripting languages (e.g., Python, Bash) and automation tools (e.g., Ansible, Terraform).
Monitoring Tools: Experience with monitoring tools like Prometheus, Grafana, Dynatrace, and Splunk ITSI.
Security: Knowledge of security best practices for Kafka, including SSL/TLS, Kerberos, and RBAC.
Problem-Solving: Strong analytical and problem-solving skills.
Communication: Excellent communication and collaboration skills.
Preferred Qualifications:
Certifications: Confluent Certified Administrator or Developer.
Cloud Experience: Experience with cloud platforms (e.g., AWS) and managing Kafka in cloud environments.
DevOps: Familiarity with DevOps practices and tools.
Database Knowledge: Experience with databases
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Key Responsibilities:
Kafka Cluster Management: Install, configure, and manage Kafka clusters, including Confluent Kafka components.
Monitoring and Performance Tuning: Monitor Kafka clusters for performance, reliability, and capacity planning. Optimize Kafka performance and troubleshoot issues.
Security: Implement and manage security measures for Kafka clusters, including encryption, authentication, and authorization.
Data Integration: Work with development teams to integrate Kafka with various data sources and sinks.
Upgrades and Patching: Plan and execute upgrades and patches for Kafka clusters to ensure they are up-to-date with the latest features and security fixes.
Disaster Recovery: Develop and maintain disaster recovery plans for Kafka clusters.
Documentation: Create and maintain documentation for Kafka configurations, processes, and procedures.
Support: Provide support for Kafka-related issues and work closely with other teams to resolve any problems.
Topic Management: Manage Kafka topics, including adding and removing topic configurations, setting cleanup policies, and configuring retention times.
Required Skills and Qualifications:
Experience: Minimum of 5 years of experience with Confluent Kafka.
Technical Skills: Strong knowledge of Kafka architecture, Food and Beverage mode (Kafka Raft), Kafka Connect, Kafka Streams, and KSQL.
Scripting and Automation: Proficiency in scripting languages (e.g., Python, Bash) and automation tools (e.g., Ansible, Terraform).
Monitoring Tools: Experience with monitoring tools like Prometheus, Grafana, Dynatrace, and Splunk ITSI.
Security: Knowledge of security best practices for Kafka, including SSL/TLS, Kerberos, and RBAC.
Problem-Solving: Strong analytical and problem-solving skills.
Communication: Excellent communication and collaboration skills.
Preferred Qualifications:
Certifications: Confluent Certified Administrator or Developer.
Cloud Experience: Experience with cloud platforms (e.g., AWS) and managing Kafka in cloud environments.
DevOps: Familiarity with DevOps practices and tools.
Database Knowledge: Experience with databases
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.