-
Transforming from dict to separate columns
I queried, some time ago, trace route info for IP’s in a list and took the wrong decision to save it in the following form. At first sight it’s not really an issue but if you want to retrieve it and create a dataframe it will look not as expected. Here is the actual code…
-
Powerlifting play ground
It’s true that I switched a little bit from this blog to Medium in hope of a larger audience but I will leave the link also here: https://medium.com/@sorin.tudor/powerlifting-play-ground-582c7e4da17d Hopefully even more analysis will come. Cheers!
-
Plotting unique values in a dataframe column
Today, I began experimenting with a Kaggle dataframe for the first time. Here is the link to it: https://www.kaggle.com/datasets/open-powerlifting/powerlifting-database To make a long story short, if you want to plot the count for each individual column and capture the unique values of a particular column inside that dataframe, you can simply achieve it by using the…
-
Getting unique IP from mongoDB and use it for traceroute query
Hi, Some time ago, I tried to write some python code in order to grab each unique IP from my traffic logs and trying to trace it so that We can find similar nodes which were used for the jumps. This is also a good exercise in order to improve the basic dataframe information and…
-
Merging initial data load with IP info
Getting back to my traffic statistics project, I managed to play with aggregation of the two main collections that had the information I needed. First of all there is the normal code to load data from Mongo and check also the columns that can be used for the join. Which is available below After this,…
-
Loading unique IP’s in MongoDB
Hi, So today I played a little bit with the possibility of storing the unique IP addresses in a separate table. Since I will use a subscription from ip-api.com, it seems that there is an option to query info by batch processing with a limit of 100 IP’s per payload. So, at a first glance…
-
Start of the traffic project
So, I managed to gather about 1 GB of records from the pfsense installation and grab them from the box (filter.log files that you can find under /var/log). And I have a list of 16 logs that I need to concatenate. I had a lot of trouble concatenating it since I tried multiple times to…
-
Unique value on columns – pandas
Hi, Today is a short example on cases that have longer columns with spaces. For example. I have a dataframe that has the following columns: I have read in some sources that you can use the construction wine_new.[column name].unique() to filter the values. If you have a one word column, it will work, but if…