-
Puppet gems install workaround after TLS 1.0 switchoff
Hi, It seems that since Ruby disabled the TLS 1.0 protocol, there is an issue with installing custom gems in the puppet server. If you run puppetserver gem environment you will probably see the following output: /opt/puppetlabs/bin/puppetserver gem environment RubyGems Environment: – RUBYGEMS VERSION: 2.4.8 – RUBY VERSION: 1.9.3 (2015-06-10 patchlevel 551) [java] – INSTALLATION…
-
Observer functionality for puppet zookeeper module
Morning, I know it’s been some time since i last posted but i didn’t had the time to play that much. Today i want to share with you the use case in which we needed to modify the module used for the deployment of zookeeper in order to include also observer role. The link that…
-
Kafka limits implementation using puppet
Morning, I keep my promise and provide you with the two simple blocks that are needed to implement limits that we discussed in article http://log-it.tech/2017/10/16/ubuntu-change-ulimit-kafka-not-ignore/ For the limits module you can use: https://forge.puppet.com/puppetlabs/limits As for the actual puppet implementation, I took the decision not to restart the service immediately. This being said, it’s dead simple…
-
Kafka implementation using puppet at IMWorld Bucharest 2017
Hi, I recently had a presentation on how to deploy kafka using puppet and what do you need as a minimum in order to have success in production. Here is the presentation: Hope it is useful. Cheers! Update: There is also an official version from IMWorld which you can find here: And also the article…
-
Eyaml hiera configuration for puppet, as promised
Morning, We managed to configure also the hiera backend in order to have eyaml module active. It is related to the following past article http://log-it.tech/2017/05/29/install-eyaml-module-on-puppet-master/. So in the hiera.yaml you bassicaly need to add the following configuration before hierarchy: :backends: – eyaml – yaml – puppetdb and :eyaml: :datadir: /etc/puppetlabs/hieradata :pkcs7_private_key: /etc/puppetlabs/puppet/eyaml/private_key.pkcs7.pem :pkcs7_public_key: /etc/puppetlabs/puppet/eyaml/public_key.pkcs7.pem :extension:…
-
Implementing logrotate for kafka
Hi, Yes, we will need to implement also logrotate if we want to keep kafka under control. My solution was with puppet, as you probably expected. After i took a look on the documentation related to log4j properties i this i had a configuration figured out that should look like the following erb template #…
-
Fixing the kafka-manager puppet code
Hi, we have a new code version for kafka-manager deploy. I will not give more details, just that now it also has a fact for the kafka-password and also some minor changes. Fact looks like this: require ‘facter’ Facter.add(:kafka_manager_pass) do setcode do file=’/etc/kafka-manager/application.conf’ if File.exist?(file) kafka_manager_pass = Facter::Core::Execution.exec(“cat #{file} | grep basicAuthentication.password | cut -d’=’…
-
Fixing the keystore/trustore distribution code
Hi, There is an extra thing to be added to my article http://log-it.tech/2017/07/27/configure-kafka-truststore-keystore-using-puppet/ As is the code copies the files at each puppet run to the other nodes which not contain the keystore generation code. And to fix this i used yet again another puppet module that should share data between the nodes, you can…
-
Puppet implementation of traefik load balancer for kafka-manager
Hi, It’s time to give the puppet implementation for the traefik small case. It is related to the following article http://log-it.tech/2017/08/08/balancing-requests-kafka-manager-using-traefik/ Starting from that i tried to find a puppet module that can actually install the package more or less accurate and i found this https://forge.puppet.com/praekeltfoundation/traefik Now, for the service install it works, but for defining of…
-
Install puppet gems on puppet master using hiera
Morning, I needed to install a toml-rb gem in order to my puppet traefik module to work and i just want to short post my workaround on doing that automatically. There was some code in our repo for that but it used only hiera array, don’t really know, so i had to write a very…