Interesting,
one idea we've tossed around is to use zeromq as a transport layer. Implement
a lager_zeromq_backend and a simple zeromq receiver feeding messages into HDFS.
Will look at your amqp backend!
--
Bip Thelin
Evolope AB | Lugnets Allé 1 | 120 33 Stockholm
Tel 08-533 335 37 | Mob 0735
Not to hijack your thread or anything, but I just pushed to Github a lager
backend for sending stuff to AMQP. You could have a subscriber in Java or
whatever that fed those messages directly into HDFS and wouldn't have to worry
about Thrift directly in the backend...
https://github.com/jbrisbin
On Thu, Nov 17, 2011 at 04:52:58PM +0100, Bip Thelin wrote:
> Hi,
>
> I've been thinking about using lager to push logs to our Big Data Hadoop
> backend for later analysis using Scribe. Looking at the lager_syslog backend
> it looks fairly simple to create such a backend. But thrift works kind
