-
Migrating Websphere MQ 7.0.1 to IBM MQ 8.0.0.x
Hi, Since there aren’t that many things new that i have done regarding Kafka and opensource software, i want to share with you this, not to be lost on a distant gitlab repo my IBM MQ migration steps and script. In order to migrate an instance from an older version (without support ) to a…
-
Automigrate data contained in a topic to different Kafka brokers
Hi, Let’s keep it short, you have a cluster composed of three Kafka brokers and you add another two. The details of doing that are pretty straight forward. If they are new, give them a unique broker.id and put the zoookeeper.connect string in order to know on which cluster to register. If they are already…
-
How to deploy Prometheus infrastructure for Kafka monitoring using puppet
Hi, In the last couple of days i worked on deployment of Prometheus server and agent for Kafka monitoring. In that purpose i will share with you the main points that you need to do in order to achieve this. First thing to do is to use the prometheus and grafana modules that you will…
-
List paths created by package install on Ubuntu
Hi, I was searching this morning to see what paths and files were created using package install with puppet and i found this: root@test:~# apt list –installed | grep goss WARNING: apt does not have a stable CLI interface yet. Use with caution in scripts. goss/trusty,now 0.3.0-3 amd64 [installed] root@test:~# dpkg-query -L goss /. /usr…
-
Wrong Kafka configuration and deployment using puppet
Hi, I just want to share with you one case that we have last week and that involved some wrong kafka deplyment from puppet that actually filled the filesystems and got our colleagues that were using it for a transport layer on ELK. Lets start with the begining, we have some puppet code to deploy…
-
Sysdig container isolation case debugged on kubernetes
Hi, I didn’t get to actual test anything related to this but i managed to find a very interesting article that might be lost if you are not a sysdig fan. You can find it at following link https://sysdig.com/blog/container-isolation-gone-wrong/ To put into perspective, this tool is used for some very interesting debugging situation, i have played…
-
Install eyaml module on puppet master
Hi, Today i will show how i installed module used for data encrypt in order to safely include it in hiera yaml files) It really simple as described on https://github.com/voxpupuli/hiera-eyaml. The actual step that i couldn’t find explicitly written in the doku and i had to figure it out myself is that you need to…
-
Small Mirror Maker test between different Kafka clusters
Hi, Today i am trying to show you what i have been playing with for the last day. There was a business case in which some colleagues from Analytics wanted to replicate all the data from other systems in their cluster. We will start with this, two independent configured clusters with 3 servers each (on…
-
Check Kafka JMX node stats using JConsole
Hi, As you probably know, Kafka is already publishing a lot of performance data on JMX to be collected. In order to do this, you will need to install jconsole (for Windows it’s already embedded in the jdk installation, for Linux you can use this article to check it out https://www.garron.me/en/linux/find-which-package-library-belongs.html. After you have done that,…
-
Small Vagrant config file for Rancher deploy
Hi, Just wanted to post this also, if it’s not that nice the config using a jumpserver, surely we can convert that to code (Puppet/Ansible), you can also use Vagrant. The main issue that i faced when i tried to create my setup is that for a reason (not really sure why, Vagrant on Windows…