Have you looked at Pinterest Secor? ( http://engineering.pinterest.com/post/84276775924/introducing-pinterest-secor )
Cheers, Robert On Mon, Jun 16, 2014 at 5:17 AM, Mark Godfrey <msg...@gmail.com> wrote: > There is Bifrost, which archives Kafka data to S3: > https://github.com/uswitch/bifrost > > Obviously that's a fairly specific archive solution, but it might work for > you. > > > Mark. > > On Mon, Jun 16, 2014 at 11:02 AM, Anatoly Deyneka <adeyn...@gmail.com> > wrote: > > > Hi all, > > > > I'm looking for the way of archiving data. > > The data is hot for few days in our system. > > After that it can rarely be used. Speed is not so important for archive. > > > > Lets say we have kafka cluster and storage system. > > It would be great if kafka supported moving data to storage system > instead > > of eviction and end user could specify what storage system is > used(dynamo, > > s3, hadoop, etc...). > > Is it possible to implement? > > > > What other solutions you can advice? > > > > Regards, > > Anatoly > > >
