Hi Nikolay, First of all I'm not a developer, but I have faced the same kind of problem. One thing that you could look into, is doing the parallelization using GNU parallel[0]. This will not be a solution in every scenario, but if yours allows querying individual nfcapd-files, and combining/processing the results afterwards (think Map/Reduce), it could be of use to you.
Again, it will require some more thinking, but in my experience it's well worth the effort. HTH, Luuk Hendriks University of Twente On Thu 8 Oct 2015, 17:33, Николай Кинаш wrote: > Hi all. > I have a very large sequence of files from nfcapd.. I want to get fast TOP > 30 flows ordered by bytes via nfdump. Right now, i can get them in 30 > minutes. I wonder about parallelize of nfdump. Have developers tried to > create the parallel nfdump?(maybe there is some architecture restriction, > in which parallel version can't be done) > Are developers plan to create the parallel nfdump? Is it possible? > > > Regards, > Nikolay > ------------------------------------------------------------------------------ > _______________________________________________ > Nfdump-discuss mailing list > Nfdump-discuss@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nfdump-discuss ------------------------------------------------------------------------------ _______________________________________________ Nfdump-discuss mailing list Nfdump-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfdump-discuss
