Re: [sword-devel] FYI geo IP lookups of repo access

2017-09-10 Thread ref...@gmx.net
There is one thing of which I am not sure how relevant it is, but the EU has created legislation counting IP addresses as personal data (among many other things) and making them subject to storage restrictions and other limitations. Here in the UK it becomes law early next year. Sites designed and

Re: [sword-devel] FYI geo IP lookups of repo access

2017-09-10 Thread DM Smith
The country information is interesting. I’ve found that bots also skew the counts. In my bin dir on the CW server, I have a perl program, moduleScrape.pl, (~/bin/moduleScrape.pl) that slogs through the logs to figure out module downloads counting each download once rather than by all the parts.

Re: [sword-devel] FYI geo IP lookups of repo access

2017-09-10 Thread Karl Kleinpaste
On 09/10/2017 06:32 PM, ref...@gmx.net wrote: > Can you not count for individual Ip addresses per country? Of course I can. I can count, sort, and summarize anything in the data that you like. It's entirely a matter of the complexity of the pipeline. http://karl.kleinpaste.org/.../ftp-xiphos-org.ip

Re: [sword-devel] FYI geo IP lookups of repo access

2017-09-10 Thread ref...@gmx.net
Can you not count for individual Ip addresses per country?Sent from my mobile. Please forgive shortness, typos and weird autocorrects. Original Message Subject: [sword-devel] FYI geo IP lookups of repo accessFrom: Karl Kleinpaste To: sword devel CC: Now and then I get

[sword-devel] FYI geo IP lookups of repo access

2017-09-10 Thread Karl Kleinpaste
Now and then I get curious about where all the accesses to ftp.xiphos.org come from. This is a crude summary from my /var/log/xferlog since early August. Counts of accesses can be gotten by substituting the last "uniq" stage of the pipeline with "uniq -c | sort -nr" but such counts are registerin