good to see that you've got it figured out, almost. Is there data in
Cassandra? did you check that? I have never used the Cassandra connector,
so i don't know if you've set it up correctly. you'll have to start by
checking at the source for data. Thats all I can help with at this point.
Sorry
-B
On Wed, May 9, 2018 at 3:29 AM, Jagannath Bilgi <jsbi...@yahoo.com.invalid>
wrote:
> Thank you Williams.
> Tried in different way and able to add Cassandra connector.
> However unable to fetch data in console. Below are details.
> {"name": "packs2","config" : { "tasks.max": "1", "connector.class" :
> "com.datamountaineer.streamreactor.connect.cassandra.source.CassandraSourceConnector",
> "connect.cassandra.contact.points" : "localhost",
> "connect.cassandra.port" : 9042, "connect.cassandra.username" :
> "cassandra", "connect.cassandra.password" : "cassandra",
> "connect.cassandra.consistency.level"
> : "LOCAL_ONE", "connect.cassandra.key.space" : "blog",
> "connect.cassandra.import.mode" : "incremental",
> "connect.cassandra.kcql" : "INSERT INTO test_topic SELECT event_data,
> event_ts FROM pack_events IGNORE event_ts PK event_ts WITHUNWRAP
> INCREMENTALMODE=TIMESTAMP", "connect.cassandra.initial.offset" :
> "2018-01-22 00:00:00.0000000Z", "connect.cassandra.import.poll.interval"
> : 1000 }}
> root@0299b340104c:/confluent-4.1.0# curl localhost:8083/connectors["
> packs2"]root@0299b340104c:/confluent-4.1.0#
> kafka-console-consumer --bootstrap-server localhost:9092 --topic
> test_topic (no output)
> connect log[2018-05-08 05:13:07,996] INFO Connector packs2 start of poll
> queue size for pack_events is: 0 (com.datamountaineer.
> streamreactor.connect.cassandra.source.CassandraSourceTask:138)[2018-05-08
> 05:13:07,996] INFO Connector packs2 query SELECT event_data,event_ts FROM
> blog.pack_events WHERE event_ts > ? AND event_ts <= ? ALLOW FILTERING
> executing with bindings (2018-01-22T00:00:00Z, 2018-01-22T00:08:25Z).
> (com.datamountaineer.streamreactor.connect.cassandra.source.
> CassandraTableReader:174)[2018-05-08 05:13:07,998] INFO Connector packs2
> end of poll queue size for pack_events is: 0 (com.datamountaineer.
> streamreactor.connect.cassandra.source.CassandraSourceTask:164)[2018-05-08
> 05:13:07,999] INFO Connector packs2 processing results for
> blog.pack_events. (com.datamountaineer.streamreactor.connect.
> cassandra.source.CassandraTableReader:217)[2018-05-08 05:13:07,999] INFO
> Connector packs2 processed 0 row(-s) into test_topic topic for table
> pack_events (com.datamountaineer.streamreactor.connect.cassandra.source.
> CassandraTableReader:251)
> cassandra Datacqlsh:blog> select * from pack_events;
> event_id | event_ts | event_data----------+---------
> ------------------------+--------------- 500 | 2018-01-22
> 20:28:50.869000+0000 | {"foo":"bar"} 501 | 2018-05-08
> 20:28:50.869000+0000 | {"foo":"bar"}(2 rows)
>
> No change in result even after removing offset property
> Please review and advise
> Thanks and regards
> Jagannath S Bilgi
>
>
>
> On Tuesday, May 8, 2018, 9:30:18 PM GMT+5:30, Burton Williams <
> burton.b.willi...@gmail.com> wrote:
>
> Its clear you're not setting up your docker image correctly. Can you draw
> out your directory structure that you build the docker image from? and
> provide the contents of your Dockerfile
>
> -B
>
> On Sat, May 5, 2018 at 12:55 PM, Jagannath Bilgi <jsbi...@yahoo.com.invalid
> >
> wrote:
>
> > Thank you.
> > However that is command prompt.
> > Tried below options. However none of them worked.
> > ./bin/zookeeper-server-start.sh config/zookeeper.properties sh
> > ./bin/zookeeper-server-start.sh config/zookeeper.properties (it fails
> > with bin/kafka-run-class.sh not found) Included kafka installation
> > directory to path
> > Thanks and regards
> > Jagannath S Bilgi
> >
> >
> > On Saturday, May 5, 2018, 4:36:09 PM GMT+5:30, Burton Williams <
> > burton.b.willi...@gmail.com> wrote:
> >
> > Your ZK path is incorrect. It has a `#` vs a '/' in it. Try changing
> that.
> >
> > -B
> >
> > On Fri, May 4, 2018 at 12:41 AM, Jagannath Bilgi
> <jsbi...@yahoo.com.invalid
> > >
> > wrote:
> >
> > > Hi Williams,
> > >
> > > Thank you for quick reply.
> > >
> > > I am new to Kafka and stream processing. Wanted to implement solution
> > > through docker. It is expected to contain Zookeeper, Kafka,
> > Kafkka-Connect
> > > and Cassandra.
> > >
> > > Tried example from Getting started with the Kafka Connect Cassandra
> > Source
> > > <https://medium.com/walmartlabs/getting-started-
> with-the-kafka-connect-
> > cassandra-source-e6e06ec72e97>
> > >
> > > Unable to proceed further as getting below error while starting kafka.
> > >
> > > root@default:~/kafka_2.11-1.1.0#bin/zookeeper-server-start.sh
> > > config/server.properties
> > > -sh: bin/zookeeper-server-start.sh: not found
> > >
> > > Below is uname -a output
> > > Linux default 4.4.111-boot2docker #1 SMP Thu Jan 11 16:25:31 UTC 2018
> > > x86_64 GNU/Linux
> > >
> > >
> > > Thanks and regards
> > >
> > > Jagannath S Bilgi
> > >
> > >
> > >
> > > ----- Forwarded Message -----
> > > *From:* Jagannath Bilgi <jsbi...@yahoo.com>
> > > *To:* "users@kafka.apache.org" <users@kafka.apache.org>
> > > *Sent:* Friday, May 4, 2018, 9:58:53 AM GMT+5:30
> > > *Subject:* Re: Kafka-connect
> > >
> > > Hi Williams,
> > >
> > > Thank you for quick reply.
> > >
> > > Wanted to implement solution through docker. It is expected to contain
> > > Zookeeper, Kafka, Kafkka-Connect and Cassandra.
> > >
> > > Tried example in Getting started with the Kafka Connect Cassandra
> Source
> > > <https://medium.com/walmartlabs/getting-started-
> with-the-kafka-connect-
> > cassandra-source-e6e06ec72e97>
> > >
> > > Getting below error while starting kafka.
> > >
> > > [image: Inline image]
> > >
> > >
> > > [image: Inline image]
> > >
> > > Thanks and regards
> > >
> > > Jagannath S Bilgi
> > >
> > >
> > > On Friday, May 4, 2018, 2:40:45 AM GMT+5:30, Burton Williams <
> > > burton.b.willi...@gmail.com> wrote:
> > >
> > >
> > > whats in docker? kafka? kafka-connnect? Did you try setting up outside
> > of a
> > > container first?
> > >
> > > -B
> > >
> > > On Thu, May 3, 2018 at 2:22 PM, Jagannath Bilgi
> > <jsbi...@yahoo.com.invalid
> > > >
> > > wrote:
> > >
> > > > Hi Team,
> > > > Trying to load data from Cassandra to Kafka using kafka-connect.
> Tried
> > > > results from Google search. However unable to complete successfully.
> > > >
> > > > Could you please help me in resolving this.
> > > > Note : trying to deploy using Docker.
> > > > Thanks and regards
> > > >
> > > > Jagannath S Bilgi
> > > >
> > >
> >
> >
>
>
