Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-14 Thread David Ahern
On 9/9/13 9:03 AM, David Ahern wrote: I have a flight recorder style command that address this problem (long-running/daemons) by processing task events and then stashing the sample events on a time-ordered list with chopping to maintain the time window. so far I noticed there could be race amon

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-10 Thread David Ahern
On 9/9/13 9:06 AM, Ingo Molnar wrote: Aren't you losing potentially important events by doing that -- FORK, COMM, MMAP? I suspect these could/should be tracked and emitted fully (in bulk) when a new data file is opened, so that each partial data file is fully consistent? In my case I am not s

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-10 Thread Peter Zijlstra
On Tue, Sep 10, 2013 at 09:54:38AM +0300, Adrian Hunter wrote: > On 09/09/13 14:17, Peter Zijlstra wrote: > > The only reason I wanted this is so that each thread can write its own > > data. The current one file thing is an immense bottle-neck for big > > machines. > > Do you need multiple files

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-10 Thread Namhyung Kim
Hi Peter and Jiri, On Mon, 9 Sep 2013 13:17:49 +0200, Peter Zijlstra wrote: > On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: >> hi, >> sending the support for multiple file storage. Initial >> RFC is here: >> http://marc.info/?l=linux-kernel&m=137408381902423&w=2 >> >> v2 changes: >>

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Adrian Hunter
On 09/09/13 14:17, Peter Zijlstra wrote: > On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: >> hi, >> sending the support for multiple file storage. Initial >> RFC is here: >> http://marc.info/?l=linux-kernel&m=137408381902423&w=2 >> >> v2 changes: >> - reworked perf mmap size setup to

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Ingo Molnar
* David Ahern wrote: > On 9/9/13 7:03 AM, Jiri Olsa wrote: > >my usage currently is to having this running during the day: > >(well whenever I remember to run it.. ;-) ) > > > > [jolsa@krava perf]$ sudo ./perf record -g -M 1m -a > > > >and checking report when the system or app get stuck > > >

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread David Ahern
On 9/9/13 7:31 AM, Jiri Olsa wrote: On Mon, Sep 09, 2013 at 07:11:11AM -0700, David Ahern wrote: On 9/9/13 7:03 AM, Jiri Olsa wrote: my usage currently is to having this running during the day: (well whenever I remember to run it.. ;-) ) [jolsa@krava perf]$ sudo ./perf record -g -M 1m -a a

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Jiri Olsa
On Mon, Sep 09, 2013 at 07:11:11AM -0700, David Ahern wrote: > On 9/9/13 7:03 AM, Jiri Olsa wrote: > >my usage currently is to having this running during the day: > >(well whenever I remember to run it.. ;-) ) > > > > [jolsa@krava perf]$ sudo ./perf record -g -M 1m -a > > > >and checking report w

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Jiri Olsa
On Mon, Sep 09, 2013 at 01:55:18PM +0200, Peter Zijlstra wrote: > On Mon, Sep 09, 2013 at 01:36:41PM +0200, Jiri Olsa wrote: > > On Mon, Sep 09, 2013 at 01:17:49PM +0200, Peter Zijlstra wrote: > > > On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: > > This patchset is actually doing 3 ess

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread David Ahern
On 9/9/13 7:03 AM, Jiri Olsa wrote: my usage currently is to having this running during the day: (well whenever I remember to run it.. ;-) ) [jolsa@krava perf]$ sudo ./perf record -g -M 1m -a and checking report when the system or app get stuck with multiple files I can just easily (or auto

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Peter Zijlstra
On Mon, Sep 09, 2013 at 01:36:41PM +0200, Jiri Olsa wrote: > On Mon, Sep 09, 2013 at 01:17:49PM +0200, Peter Zijlstra wrote: > > On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: > This patchset is actually doing 3 essential things: > 1) adds new perf data format version (v3) > 2) adds

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Jiri Olsa
On Mon, Sep 09, 2013 at 01:17:49PM +0200, Peter Zijlstra wrote: > On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: > > hi, > > sending the support for multiple file storage. Initial > > RFC is here: > > http://marc.info/?l=linux-kernel&m=137408381902423&w=2 > > > > v2 changes: > > - re

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-09 Thread Peter Zijlstra
On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: > hi, > sending the support for multiple file storage. Initial > RFC is here: > http://marc.info/?l=linux-kernel&m=137408381902423&w=2 > > v2 changes: > - reworked perf mmap size setup to be able to get > the mmap size value easily l

Re: [PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-01 Thread Andi Kleen
On Sun, Sep 01, 2013 at 12:36:11PM +0200, Jiri Olsa wrote: > hi, > sending the support for multiple file storage. Initial > RFC is here: > http://marc.info/?l=linux-kernel&m=137408381902423&w=2 Just a general comment. If you repost please always keep the overview description/motivation in 0/0. -A

[PATCHv2 00/25] perf tool: Add support for multiple data file storage

2013-09-01 Thread Jiri Olsa
hi, sending the support for multiple file storage. Initial RFC is here: http://marc.info/?l=linux-kernel&m=137408381902423&w=2 v2 changes: - reworked perf mmap size setup to be able to get the mmap size value easily later - added perf.data read/write test for v2 and v3 for both endiani