-
Plotting unique values in a dataframe column
Today, I began experimenting with a Kaggle dataframe for the first time. Here is the link to it: https://www.kaggle.com/datasets/open-powerlifting/powerlifting-database To make a long story short, if you want to plot the count for each individual column and capture the unique values of a particular column inside that dataframe, you can simply achieve it by using the…
-
Getting unique IP from mongoDB and use it for traceroute query
Hi, Some time ago, I tried to write some python code in order to grab each unique IP from my traffic logs and trying to trace it so that We can find similar nodes which were used for the jumps. This is also a good exercise in order to improve the basic dataframe information and…
-
Merging initial data load with IP info
Getting back to my traffic statistics project, I managed to play with aggregation of the two main collections that had the information I needed. First of all there is the normal code to load data from Mongo and check also the columns that can be used for the join. Which is available below After this,…
-
Loading unique IP’s in MongoDB
Hi, So today I played a little bit with the possibility of storing the unique IP addresses in a separate table. Since I will use a subscription from ip-api.com, it seems that there is an option to query info by batch processing with a limit of 100 IP’s per payload. So, at a first glance…
-
Start of the traffic project
So, I managed to gather about 1 GB of records from the pfsense installation and grab them from the box (filter.log files that you can find under /var/log). And I have a list of 16 logs that I need to concatenate. I had a lot of trouble concatenating it since I tried multiple times to…
-
Unique value on columns – pandas
Hi, Today is a short example on cases that have longer columns with spaces. For example. I have a dataframe that has the following columns: I have read in some sources that you can use the construction wine_new.[column name].unique() to filter the values. If you have a one word column, it will work, but if…