-
Use case for deleting corrupted Kafka topic
Hi, We had a week ago a case in which the client could not delete a topic from the cluster (Kafka version in this case was 1.0.0). When the topic was listed, there were no leaders assigned for the partitions. It was pretty clear that it would not delete it until we fixed it. First…
-
Log rotate for Kafka Garbage collect without restart
Morning, If you have a Apache Kafka version which is below 1.0.0 and you don’t have garbage collect rotate as shown here: with: -Xloggc:/opt/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=100M without: -Xloggc:/opt/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps One option is to modify the parameters in order to include them in the process that starts but…
-
Consumer group coordinator in Kafka using some scala script
Morning, Just a small post regarding returning a consumer group coordinator for a specific consumer group. We had the issue that consumer groups are re-balancing and we didn’t knew if it’s related to application logic or the Consumer Group Coordinator was changing and the Kafka cluster was reassign a different one each time. So, a…