-
Don’t delete the Kafka GC logs when they are used
Hi, I made a mistake some time ago, and it’s there to hunt me. Deleting the normal gc logs including the one it’s already used doesn’t solve anything, it just created a more difficult situation. Here is my example: /dev/sda1 50G 42G 5.2G 90% / /opt/kafka/logs# ll total 34M drwxrwxr-x 2 kafka kafka 4.0K Oct…
-
Final version of SSL gen script for kafka
Hi, I wrote a lot about this topic but it seems that i came to the procedure specified by Confluent. Here is the right way to do it, at least for now: #!/bin/bash HOST= PASSWORD= KEYSTOREPASS= VALIDITY=365 keytool -keystore kafka.server.keystore.jks -alias ${HOST} -validity $VALIDITY -genkey -dname “CN=${HOST}, OU=MyTeam, O=MyCompany, L=Bucharest S=Romania C=RO” -storepass $KEYSTOREPASS -keypass…
-
Wrong again, there is no return code 0 on self signed certs
Morning, It looks like i was wrong again with the SSL generation script. Here is the second article Code 0 is not good after all and it signals that Kafka broker is closing the connection really fast. So: There is no 0 on self signed certs Please make sure that you have a certificate in…
-
Correct SSL script for Kafka deployment
Hi, I wrote some time ago a post about certificate generation in order to secure Kafka cluster. Long story short, it was wrong! Here is the correct version that returns O (keystore is correctly generated and used) #!/bin/bash HOST= PASSWORD= KEYSTOREPASS= VALIDITY=365 keytool -keystore kafka.server.temp.keystore.jks -alias $HOST -validity $VALIDITY -genkey -dname “CN=${HOST}, OU=Myteam, O=Mycompany, L=Bucharest…
-
Cgroups management on Linux – first steps
Hi, I didn’t know that much about control groups but i see that there are a big thing in performance and process optimization. For the moment i would like to share two important info that i found. First, there are three options that you need to activate in you want to play with control group…
-
Kernel not compatible with zookeeper version
Morning, It’s important to share this situation with you. This morning i came to the office to see that a cluster that was upgraded/restarted had an issue with Zookeeper instances. Symptoms were clear: instances won’t start completely. But why? After a little bit of investigation, i went to the /var/log/syslog (/var/log/zookeeper did not contain any…
-
Puppet gems install workaround after TLS 1.0 switchoff
Hi, It seems that since Ruby disabled the TLS 1.0 protocol, there is an issue with installing custom gems in the puppet server. If you run puppetserver gem environment you will probably see the following output: /opt/puppetlabs/bin/puppetserver gem environment RubyGems Environment: – RUBYGEMS VERSION: 2.4.8 – RUBY VERSION: 1.9.3 (2015-06-10 patchlevel 551) [java] – INSTALLATION…
-
Convert mdx image (daemon tools) to iso
Hi, Some time ago i created some images that were saved in mdx format using (Daemon Tools). Those were Windows times, but i migrated to Debian since then. I created a Windows virtual-box machine in order to use them but unfortunately it does not allow to mount them in this format. In order to convert…
-
Kafka cluster nodes and controller using golang
Hi, Using the golang library for zookeeper from here you can get very easily the nodes that are registered in the cluster controller node. In order to install this module, beside needing to setup the GOPATH you will have also to install packages from linux distro repo called: bzr, gcc, libzookeeper-mt-dev Once all of this…
-
Error 127, not related to Puppet or Golang
Hi, Something from my experience playing with Golang and Puppet code this morning. I wrote a very very simple script to restart a service that you can find here Today i wanted to put it on the machine and run it with puppet, so i wrote a very small class that looked like this: class…