-
Small Mirror Maker test between different Kafka clusters
Hi, Today i am trying to show you what i have been playing with for the last day. There was a business case in which some colleagues from Analytics wanted to replicate all the data from other systems in their cluster. We will start with this, two independent configured clusters with 3 servers each (on…
-
Check Kafka JMX node stats using JConsole
Hi, As you probably know, Kafka is already publishing a lot of performance data on JMX to be collected. In order to do this, you will need to install jconsole (for Windows it’s already embedded in the jdk installation, for Linux you can use this article to check it out https://www.garron.me/en/linux/find-which-package-library-belongs.html. After you have done that,…
-
Small Vagrant config file for Rancher deploy
Hi, Just wanted to post this also, if it’s not that nice the config using a jumpserver, surely we can convert that to code (Puppet/Ansible), you can also use Vagrant. The main issue that i faced when i tried to create my setup is that for a reason (not really sure why, Vagrant on Windows…
-
Monitoring Kafka with DataDog
Hi, A very interesting series of articles that should be checked regarding one option of Kafka monitoring with Datadog : https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/. I will have in the near future a task regarding this, will post the outcome when it’s done. P.S: It was done and you can find the implementation here : Integrate Kafka with Datadog…
-
Monitoring Kafka node using Docker
Hi, Today i am just going to point you to a very interesting article related to monitoring of Kafka node/nodes using InfluxDB, Grafana and Docker. Hope it is useful, i will surely try it in one of the days. https://softwaremill.com/monitoring-apache-kafka-with-influxdb-grafana/ Now this is not quite standard but nevertheless it is an option. Cheers!
-
Memory check by process in Linux
Hi, I wanted to post this since it might be useful in some situations. On a Linux machine it seems that one way to check the memory usage by top processes is with ps aux –sort -rss (This means that it’s order by Resistent Set Size) Once executed it will return an output similar to this:…
-
Register RancherOs to the Rancher framework
Hi, After we were able to login via ssh on our machines, it’s time to put them to use by subscribing them to a orchestrating framework. One free and pretty powerful framework of such kind is given by the same company. In order to use it you will need to have Docker installed, more info…
-
Install RancherOS on VirtualBox and configure it for ssh access
Hi, If you are not familiar with what is RancherOS you can learn more from this link: Rancher docu It’s basically a very small Linux distro that runs all the processes as Docker containers (including the system processes). So, starting from here, we will need a RancherOS image which you can download from the following location: Rancher…