Hi all,
The current architecture of nfdump is limited to a single process.
I am well aware of this limitation and already have ideas for a multithreading
implementation. The trick is to find a balance between CPU and I/O as
it turns out, that I/O becomes a bottleneck.
The multithreading implementation is one of the next things of the todo list.
But be aware, it will not be the solution for all the problems and TB data
processing. These would need other concepts.
- Peter
On 08.10.15 11:33, Николай Кинаш wrote:
> Hi all.
> I have a very large sequence of files from nfcapd.. I want to get fast TOP
> 30 flows ordered by bytes via nfdump. Right now, i can get them in 30
> minutes. I wonder about parallelize of nfdump. Have developers tried to
> create the parallel nfdump?(maybe there is some architecture restriction,
> in which parallel version can't be done)
> Are developers plan to create the parallel nfdump? Is it possible?
>
>
> Regards,
> Nikolay
>
>
>
> ------------------------------------------------------------------------------
>
>
>
> _______________________________________________
> Nfdump-discuss mailing list
> Nfdump-discuss@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nfdump-discuss
>
--
Be nice to your netflow data. Use NfSen and nfdump :)
------------------------------------------------------------------------------
_______________________________________________
Nfdump-discuss mailing list
Nfdump-discuss@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfdump-discuss
