ance. I think this puzzle is now
> solved :)
> Best wishes,
> David
>
> -----Original Message-
> From: Randall Hauch [mailto:rha...@gmail.com]
> Sent: 28 April 2017 16:08
> To: dev@kafka.apache.org
> Subject: Re: Kafka Connect and Partitions
>
> The source connector
ow
> solved :)
> Best wishes,
> David
>
> -Original Message-----
> From: Randall Hauch [mailto:rha...@gmail.com]
> Sent: 28 April 2017 16:08
> To: dev@kafka.apache.org
> Subject: Re: Kafka Connect and Partitions
>
> The source connector creates SourceRecord obje
r guidance. I think this puzzle is now solved :)
Best wishes,
David
-Original Message-
From: Randall Hauch [mailto:rha...@gmail.com]
Sent: 28 April 2017 16:08
To: dev@kafka.apache.org
Subject: Re: Kafka Connect and Partitions
The source connector creates SourceRecord object and can se
these are related in order to figure out why the
default partitioner is writing all data to the same (Kafka) partition.
Still puzzled,
David
-Original Message-
From: Randall Hauch [mailto:rha...@gmail.com]
Sent: 28 April 2017 16:08
To: dev@kafka.apache.org
Subject: Re: Kafka Connect and Pa
is
> mapped to the same Kafka partition.
>
> Could you explain how the SourceRecord is used to derive the partition key
> please. Can you see from the above summary why the partition key is null?
> It defeats me :(
>
> Have a good weekend, thanks,
>
> David
>
> -Original Messag
SourceRecord is used to derive the partition key
please. Can you see from the above summary why the partition key is null? It
defeats me :(
Have a good weekend, thanks,
David
-Original Message-
From: Gwen Shapira [mailto:g...@confluent.io]
Sent: 27 April 2017 17:44
To: dev@kafka.apac
] INFO ### Writing [98] events
> [41:30,646] INFO ### Sink Task [602953950] has processed [900] events
>
> [41:30,881] INFO ### Task [1714504927] retrieved [100] records
> [41:30,881] INFO ### Task [1714504927] has read all of its files
> (c.b.b.pp.kafkaConnect.tasks.RecordRetriever:65)
&
62883] has processed [0] events
[41:31,178] INFO WorkerSinkTask{id=topicsToFolders-0} Committing offsets
(org.apache.kafka.connect.runtime.WorkerSinkTask:261)
-Original Message-
From: Gwen Shapira [mailto:g...@confluent.io]
Sent: 26 April 2017 18:29
To: dev@kafka.apache.org<mailto:dev@kafka.apache.org>
Subje
ailto:g...@confluent.io]
Sent: 26 April 2017 18:29
To: dev@kafka.apache.org
Subject: Re: Kafka Connect and Partitions
Hi,
I'll need a bit more detail to help :) Are you writing a connector or trying to
use an existing one? If existing, which connector? Is it source or sink?
Here are few thi
Hi,
I'll need a bit more detail to help :) Are you writing a connector or
trying to use an existing one? If existing, which connector? Is it source
or sink?
Here are few things I'd look at when debugging:
* Is the connector reading from the topic you think you are reading?
* Do you actually have
I've defined several Kafka Connect tasks via the tasks.max property to process
a set of topics.
Initially I set the partitions on the topics to 1 and partitioned the topics
across the tasks programmatically so that each task processed a subset of the
topics (or so I thought ...).
I then noticed
11 matches
Mail list logo
