Devops
Capgemini
Software Engineering
India
Posted on Oct 28, 2024
- Migration exp from Apache Kafka to Confluent Kafka
- Devops, Kubernetes.
- Design, deploy, and maintain Kafka clusters across multiple environments (development, testing, production).
- Configure Kafka brokers, topics, partitions, and ACLs (Access Control Lists) as per security requirements.
- Monitor Kafka infrastructure performance and ensure high availability and low-latency data transmission.
- Collaborate with DevOps and development teams to optimize Kafka configurations for performance and scalability.
- Troubleshoot and resolve issues related to Kafka cluster connectivity, broker performance, and data replication.
- Implement Kafka producers and consumers, ensuring data pipelines are robust and efficient.
- Develop automation scripts (e.g., using Ansible, Shell scripting) for Kafka cluster provisioning and maintenance tasks.
- Provide guidance and mentorship to junior members of the Kafka administration team.
- Stay updated with Kafka community developments and best practices, recommending upgrades and improvements