Kafka Administrator

Responsibilities: Design, deploy, configure, and maintain highly available Apache Kafka clusters across on-premises, cloud, and managed environments, including AWS MSK and Confluent Cloud. Administer Kafka topics, partitions, quotas, retention policies, replication settings, and consumer groups to ensure optimal performance and cost efficiency. Manage Kafka ecosystem components, including Kafka Connect, Schema Registry, MirrorMaker, Confluent Replicator, and REST Proxy. Execute Kafka upgrades, patching, hardware refreshes, cluster rebuilds, and migrations while minimizing downtime and operational risks. Perform Kafka performance tuning, throughput testing, and benchmarking across producers, consumers, brokers, and controllers. Optimize batching, compression, acknowledgments ( acks ), in-sync replicas (ISR), and cluster health. Develop capacity plans, partitioning strategies, infrastructure sizing models, and cluster right-sizing recommendations. Integrate Apache Kafka with AWS MSK and other enterprise systems. Implement monitoring, alerting, troubleshooting, backup and recovery, and disaster recovery procedures. Apply strong Linux and networking fundamentals, including TCP/IP, DNS, and load balancing, to troubleshoot infrastructure and connectivity issues. Develop architecture diagrams, operational standards, runbooks, and migration documentation. Conduct knowledge transfer sessions and ensure smooth documentation handoff at key milestones and project completion. Required Skills and

Qualifications: 8–10 years of overall relevant IT experience.