-
Fixing the kafka-manager puppet code
Hi, we have a new code version for kafka-manager deploy. I will not give more details, just that now it also has a fact for the kafka-password and also some minor changes. Fact looks like this: require ‘facter’ Facter.add(:kafka_manager_pass) do setcode do file=’/etc/kafka-manager/application.conf’ if File.exist?(file) kafka_manager_pass = Facter::Core::Execution.exec(“cat #{file} | grep basicAuthentication.password | cut -d’=’…
-
Fixing the keystore/trustore distribution code
Hi, There is an extra thing to be added to my article http://log-it.tech/2017/07/27/configure-kafka-truststore-keystore-using-puppet/ As is the code copies the files at each puppet run to the other nodes which not contain the keystore generation code. And to fix this i used yet again another puppet module that should share data between the nodes, you can…
-
Puppet implementation of traefik load balancer for kafka-manager
Hi, It’s time to give the puppet implementation for the traefik small case. It is related to the following article http://log-it.tech/2017/08/08/balancing-requests-kafka-manager-using-traefik/ Starting from that i tried to find a puppet module that can actually install the package more or less accurate and i found this https://forge.puppet.com/praekeltfoundation/traefik Now, for the service install it works, but for defining of…
-
Install puppet gems on puppet master using hiera
Morning, I needed to install a toml-rb gem in order to my puppet traefik module to work and i just want to short post my workaround on doing that automatically. There was some code in our repo for that but it used only hiera array, don’t really know, so i had to write a very…
-
Balancing requests to kafka-manager using traefik
Hi, Just wanted to share with you a quite small and simple config to balance the traffic between three machines that have kafka-manager installed. For this i used traefik since it was new to me and i wanted to gain a little bit of experience with it. It’s an interesting solution but it took me…
-
Configure kafka truststore and keystore using puppet
Hi, Since the last article was about the template needed to generate the truststore and keystore, now it’s time to give you the rest of the fragments for the deployment with puppet. So, We will have the kafka_security gen class that was called on the last post and it should look like this in the…
-
Generate Kafka key/trust store for TLS activation
Morning folks, Just wanted to share with you also the code for script required on generation of keystore and truststore for Kafka. It is not much but it might be helpful someday. So, the erb script should look like this, and i will show you as well how you can integrate this also with puppet:…
-
Jupyter Notebook – very very interesting tool
Hi, As i was taking a look on the Docker newsletter beside Moby and other articles related to that i found this interesting tool and also tutorial/presentation: Beside that you can find the official site here: http://jupyter.org This caught my attention and i will certainly try this on a machine. I am pretty curios since i…
-
Install Kafka Manager with Puppet
Hi, I will continue on this line with the install of a management tool called Kafka manager using same old Puppet. The main source of the project is here: https://github.com/yahoo/kafka-manager If you scroll down at packaging you will see that you have the possibility to create a .deb package for Ubuntu or Debian setup or…
-
Integrate Kafka with Datadog monitoring using puppet
Hi, Since i was in debt with an article on how to integate Kafka monitoring using Datadog, let me tell you a couple of things about this topic. First of all, we are taking the same config of Kafka with Jolokia that was describe in following article. From the install of the brokers on our…