Re: Data structure for plotting monotonically expanding data set

2021-06-05 Thread Martin Di Paola
One way to go is using Pandas as it was mentioned before and Seaborn for plotting (built on top of matplotlib) I would approach this prototyping first with a single file and not with the 1000 files that you have. Using the code that you have for parsing, add the values to a Pandas DataFrame

Re: Data structure for plotting monotonically expanding data set

2021-06-04 Thread Chris Nyland
I agree with dn. While you could scrape the text files each time you want to display a user from a design perspective it makes more sense to use a database to store the data. This doesn't mean that you need to get rid of the text files or change the format that they are written to but instead that

Re: Data structure for plotting monotonically expanding data set

2021-05-27 Thread dn via Python-list
On 27/05/2021 21.28, Loris Bennett wrote: > Hi, > > I currently a have around 3 years' worth of files like > > home.20210527 > home.20210526 > home.20210525 > ... > > so around 1000 files, each of which contains information about data > usage in lines like > > namekb > alice 1

Re: Data structure for plotting monotonically expanding data set

2021-05-27 Thread Peter J. Holzer
On 2021-05-27 11:28:11 +0200, Loris Bennett wrote: > I currently a have around 3 years' worth of files like > > home.20210527 > home.20210526 > home.20210525 > ... > > so around 1000 files, each of which contains information about data > usage in lines like > > namekb > alice 1

Data structure for plotting monotonically expanding data set

2021-05-27 Thread Loris Bennett
Hi, I currently a have around 3 years' worth of files like home.20210527 home.20210526 home.20210525 ... so around 1000 files, each of which contains information about data usage in lines like namekb alice 123 bob 4 ... zebedee 999 (there are actually more colum

Re: Data structure for plotting monotonically expanding data set

2021-05-27 Thread Edmondo Giovannozzi
Il giorno giovedì 27 maggio 2021 alle 11:28:31 UTC+2 Loris Bennett ha scritto: > Hi, > > I currently a have around 3 years' worth of files like > > home.20210527 > home.20210526 > home.20210525 > ... > > so around 1000 files, each of which contains information about data > usage in lines