Re: postgresql consumer

2014-10-19 Thread Jun Rao
Perhaps you can ask the storm mailing list about the storm-postgresql code? Thanks, Jun On Sat, Oct 18, 2014 at 10:32 AM, Sa Li wrote: > > Hi, all > > I've just made a 3-node kafka cluster (9 brokers, 3 for each node), the > performance test is OK. Now I am using tridentKafkaSpout, and being a

Re: postgresql consumer

2014-10-18 Thread Sa Li
Hi, all I've just made a 3-node kafka cluster (9 brokers, 3 for each node), the performance test is OK. Now I am using tridentKafkaSpout, and being able to getting data from producer, see BrokerHosts zk = new ZkHosts("10.100.70.128:2181"); TridentKafkaConfig spoutConf = new TridentKafkaCon

Re: postgresql consumer

2014-10-08 Thread Jun Rao
You can look at the consumer example at http://kafka.apache.org/documentation.html#highlevelconsumerapi Thanks, Jun On Wed, Oct 8, 2014 at 7:51 PM, Sa Li wrote: > Hi, All > > I setup a kafka cluster, and plan to publish the messages from Web to > kafka, the messages are in the form of json, I

postgresql consumer

2014-10-08 Thread Sa Li
Hi, All I setup a kafka cluster, and plan to publish the messages from Web to kafka, the messages are in the form of json, I want to implement a consumer to write the message I consumer to postgresql DB, not aggregation at all. I was thinking to use KafkaSpout in storm to make it happen, now I