aker-at-current-2022-the-next-kafka-summit/.
If you have any questions about submitting I would be pleased to answer
them - you can contact me directly at ro...@confluent.io.
The call for speakers closes at June 26, 23:59 CT.
Thanks,
Robin Moffatt
Program Committee Chair
eless-transformations
--
Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 3 May 2022 at 03:09, Liam Clarke-Hutchinson
wrote:
> Hi Emily,
>
> Nope, Kafka doesn't have that capability built in, it's just a distributed
> log that's great for st
Hi Jordan,
Is there a good reason for wanting to do this? I can think of multiple
reasons why you shouldn't do this even if technically it works in some
cases.
Or it's just curiosity as to whether you can/should?
thanks, Robin.
--
Robin Moffatt | Principal Developer Adv
I *think* it should work - you just need to get your advertised.listeners
set up correctly. I wrote a blog about this that should help you understand
the config more:
www.confluent.io/blog/kafka-client-cannot-connect-to-broker-on-aws-on-docker-etc/
--
Robin Moffatt | Staff Developer Advocate
, please do
feel free to contact me directly - ro...@confluent.io.
thanks,
Robin Moffatt
P.S. Hereโs a little-known fact about CfPs: at this stage, you donโt
need to have written the talk itself - just the abstract. If your talk
is accepted then you need to write it :)
[1] https://www.kafka-summit.org
Kafka Summit Americas 2021 starts tomorrow - register for free at
https://www.myeventi.events/kafka21/na/ and tune in for tons of
great Apache Kafka content!
--
Robin Moffatt | Staff Developer Advocate | ro...@confluent.io | @rmoff
Congratulations Konstantine!
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 21 Jun 2021 at 16:28, Mickael Maison wrote:
> Hi,
>
> It's my pleasure to announce that Konstantine Karantasis is now a
> member of the Kafka PMC.
>
>
There's also this
https://forum.confluent.io/t/kafka-connect-jmespath-expressive-content-based-record-filtering/1104
which is worth checking out - I came across it after recording that video
unfortunately but it looks like a useful predicate implementation.
--
Robin Moffatt | Senior Deve
Great news, congratulations Randall!
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Sat, 17 Apr 2021 at 00:45, Matthias J. Sax wrote:
> Hi,
>
> It's my pleasure to announce that Randall Hauch in now a member of the
> Kafka PMC.
>
> R
Satendra - there was a new blog published just today about
running Confluent Control Center on Windows:
https://www.confluent.io/blog/set-up-and-run-kafka-on-windows-and-wsl-2
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 26 Mar 2021 at 10:07, Robin
You can use WSL2:
https://www.confluent.io/blog/set-up-and-run-kafka-on-windows-linux-wsl-2
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 26 Mar 2021 at 05:09, Satendra Negi
wrote:
> Hello Guys,
>
> Is there any way to run the confluent kafk
still have a properties file to configure
the worker itself.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 23 Mar 2021 at 02:02, Himanshu Shukla
wrote:
> Hi All,
>
> I am having these below understanding regarding Kafka connect.
>
> 1
There is a similar discussion about Kafka Connect images here:
https://issues.apache.org/jira/browse/KAFKA-9774
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 16 Mar 2021 at 16:04, Francois Papon
wrote:
> Hi,
>
> It would be nice to push an
Congratulations Tom!
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 15 Mar 2021 at 18:00, Mickael Maison wrote:
> Hi all,
>
> The PMC for Apache Kafka has invited Tom Bentley as a committer, and
> we are excited to announce that he accep
For what it's worth, that sounds less like a Kafka Connector and more like
a Kafka Streams app.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 11 Mar 2021 at 18:27, Nick Siviglia wrote:
> Hi Everyone,
>
> I'd like to create a Kafka con
of it here:
https://forum.confluent.io/t/kafka-connect-jmespath-expressive-content-based-record-filtering/1104
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 10 Mar 2021 at 09:55, raman gugnani
wrote:
> HI Tom,
>
> For which connector class conne
I wrote a blog about loading data into Apache Kafka using kafkacat. It's
kinda hacky, but it works and was an interesting journey through some other
bash tools too :D
https://rmoff.net/2021/02/26/loading-delimited-data-into-kafka-quick-dirty-but-effective/
--
Robin Moffatt | Senior Deve
You can read about the security available in Apache Kafka here:
https://kafka.apache.org/documentation/#security_ssl
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 16 Feb 2021 at 15:18, Jones, Isaac wrote:
> Hello,
>
> I have a couple important
%p
Offset: %o
Headers: %h\n'
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 10 Feb 2021 at 17:59, Rovere Lorenzo wrote:
> Hi
>
>
>
> We are on Kafka version: 2.2.1-kafka-4.1.0
>
> We have some issues when trying to dump some
edaysofsmt/
thanks, Robin.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 14 Dec 2020 at 16:30, Ryanne Dolan wrote:
> Robin, I don't think this is an appropriate use of the user group.
>
> Ryanne
>
> On Mon, Dec 14, 2020 at 10:20 AM R
๐
๐ #TwelveDaysOfSMT ๐ ๐
Day 5๏ธโฃ: MaskField
https://rmoff.net/2020/12/14/twelve-days-of-smt-day-5-maskfield/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 11 Dec 2020 at 17:14, Robin Moffatt wrote:
> ๐
๐ #TwelveDaysOfSMT ๐ ๐
>
>
๐
๐ #TwelveDaysOfSMT ๐ ๐
Day 4๏ธโฃ: RegexRouter
https://rmoff.net/2020/12/11/twelve-days-of-smt-day-4-regexrouter/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 10 Dec 2020 at 17:56, Robin Moffatt wrote:
> Here's the third instalment
Here's the third instalment of ๐
๐ #TwelveDaysOfSMT ๐ ๐
Flatten :https://rmoff.net/2020/12/10/twelve-days-of-smt-day-3-flatten/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 10 Dec 2020 at 09:49, Robin Moffatt wrote:
> Here's the seco
Here's the second instalment of ๐
๐ #TwelveDaysOfSMT ๐ ๐
Day 2: ValueToKey and ExtractField :
https://rmoff.net/2020/12/09/twelve-days-of-smt-day-2-valuetokey-and-extractfield/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 9 Dec 2020 at 09:07,
-timestamp/
Reply here with any feedback, any particular SMT you'd like me to explore,
or scenarios to solve :)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
Why is quantity a STRING? Should it be a numeric?
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 8 Sep 2020 at 08:52, Rainer Schamm wrote:
> Hi all
>
> we are struggling a bit with a fairly simple stream that is supposed to
> map columns
, Robin.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 7 Sep 2020 at 10:00, Himanshu Shukla
wrote:
> Hi,
> We are planning to go for amazon MSK instead of having our own self
> launched cluster on bare EC2 machines.
>
> It would be very help
I echo what Michael says here.
Another consideration is that logos are often shrunk (when used on slides)
and need to work at lower resolution (think: printing swag, stitching
socks, etc) and so whatever logo we come up with needs to not be too fiddly
in the level of detail - something that I thin
ka-02
For MongoDB connectors see https://www.confluent.io/hub/#mongodb
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 27 Jul 2020 at 18:19, Milka Wafula wrote:
> Hello,
>
> Please how may we connect mongoDB with ka
Check out this article where it covers decimal handling:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/#bytes-decimals-numerics
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 2 Jul 2020 at 13:54, vishnu murali
wrote:
>
If you're going to cross-post, it's useful to include where else you've
asked this before, so that people can see what else has been suggested and
answered to avoid duplicating their effort :)
https://stackoverflow.com/questions/62343035/kafka-entity-default-vs-entity-name
--
You might also find this resource useful in general:
https://www.confluent.io/whitepaper/comparing-confluent-platform-with-traditional-messaging-middleware/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
โชOn Wed, 10 Jun 2020 at 16:00, โซื ืชื ืืืืืืจโฌโ
wrote
gt;
> Thanks,
> Yu
>
> On Thu, May 28, 2020 at 6:01 PM Robin Moffatt wrote:
> >
> > When you create the connector, it will start.
> >
> >
> > --
> >
> > Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
> >
&g
When you create the connector, it will start.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 28 May 2020 at 04:12, Yu Watanabe wrote:
> Dear community .
>
> I would like to ask question related to source connector in kafka
> connect (2.4
The KIP for the current rebalancing protocol is probably a good reference:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-415:+Incremental+Cooperative+Rebalancing+in+Kafka+Connect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 26 May 2020 at 14:25
See here:
https://docs.confluent.io/current/security/basic-auth.html#basic-auth-kconnect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 22 May 2020 at 15:42, wrote:
> Hi Team,
>
> I have configured a Kafka Connect source connector on Distribut
blem or an
actual one. If this is an actual problem that you're encountering and need
a solution to then since the task allocation is not deterministic it sounds
like you need to deploy separate worker clusters based on the workload
patterns that you are seeing and machine resources available.
urces
available.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 20 May 2020 at 16:39, Deepak Raghav
wrote:
> Hi Robin
>
> Replying to your query i.e
>
> One thing I'd ask at this point is though if it makes any difference where
> the ta
s any difference where
the tasks execute? The point of a cluster is that Kafka Connect manages the
workload allocation. If you need workload separation and
guaranteed execution locality I would suggest separate Kafka Connect
distributed clusters.
--
Robin Moffatt | Senior Developer Advocate
nting a problem to you (if so please describe why), or if you're just
interested in the theory behind the rebalancing protocol?
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 20 May 2020 at 06:46, Deepak Raghav
wrote:
> Hi
>
> Please,
Hi Vishnu,
I think there is a problem with your email client, it's just sent a
duplicate of each of your emails from yesterday?
thanks, Robin.
On Tue, 19 May 2020 at 16:44, vishnu murali
wrote:
> Hi Guys
>
> By Trying SFTP CSV SOURCE i am getting this exception by using this
> configuration.
>
You need to externalise your container data stores. Here's an
example Docker Compose that does that:
https://github.com/confluentinc/demo-scene/blob/master/wifi-fun/docker-compose.yml
<https://github.com/confluentinc/demo-scene/blob/master/wifi-fun/docker-compose.yml#L10>
--
Ro
This should help your understanding:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 19 May 2020 at 11:48, ๆทฑๅคงๆๅฑๅ wrote:
> Thank you, Ixy, thanks for your reply, it's working now!
> I wil
Check this out: https://rmoff.dev/fix-jdbc-driver-video (specifically here
for Docker instructions https://www.youtube.com/watch?v=vI_L9irU9Pc&t=665s)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 15 May 2020 at 08:16, vishnu murali
wrote:
>
If you just want it once then delete the connector once it's processed all
the data
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 14 May 2020 at 16:14, vishnu murali
wrote:
> Thanks Liam
>
> But I am asking like assume I am having 100
line-world-thereabouts-part-3/
-
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/
- http://rmoff.dev/ksldn19-kafka-connect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 13 May 2020 at 10:34, vishnu murali
wrote:
> Hi Guys,
>
components as is. When you configure Schema Registry
you point it at your existing Apache Kafka cluster (
https://docs.confluent.io/current/schema-registry/installation/config.html#schemaregistry-config
)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 11 May 2020
> wirite to target database. I want to use self-written java code
instead of kafka jdbc sink connector.
Out of interest, why do you want to do this? Why not use the JDBC sink
connector (or a fork of it if you need to amend its functionality)?
--
Robin Moffatt | Senior Developer Advoc
You can use Apache Kafka as you are currently using, and just deploy Schema
Registry alongside it.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Sat, 9 May 2020 at 02:16, Chris Toomey wrote:
> You have to either 1) use one of the Confluent serializ
Schema Registry and its serde libraries are part of Confluent Platform,
licensed under Confluent Community Licence (
https://www.confluent.io/confluent-community-license-faq/)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 8 May 2020 at 13:39, vishnu
See https://www.youtube.com/watch?v=b-3qN_tlYR4&t=627s
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 7 May 2020 at 06:48, vishnu murali
wrote:
> Hey Guys,
>
> i am working on JDBC Sink Conneector to take data from kafka topic to
> mysql.
&g
Are you talking about MirrorMaker 2? That runs as a connector.
If not, perhaps you can clarify your question a bit as to what it is you
are looking for.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 1 May 2020 at 13:57, vishnu murali
wrote:
> Hi G
How are you running Kafka? Do you mean when you shut it down you have to
reconfigure the connector?
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 29 Apr 2020 at 20:03, vishnu murali
wrote:
> Hi guys
> I am trying that JDBC source connector to ge
if Sybase supports JDBC then you can probably use the JDBC Source connector
for Kafka Connect
Ref:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 20 Apr 2020 at 17:31, Jonatan
published here (
https://airtable.com/shrzKAKFMcfIgFVK9/iCal?timeZone=Europe%2FLondon&userLocale=en-gb)
or an online view here (https://cnfl.io/online-community-meetups)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
I thought I'd share here a short blog I wrote up recently:
https://rmoff.net/2020/04/16/a-quick-and-dirty-way-to-monitor-data-arriving-on-kafka/
Enjoy :)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
No. You have you restart the worker.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 7 Apr 2020 at 18:24, nitin agarwal wrote:
> Hi,
>
> I have a use case where new connectors will keep on adding to existing
> running Kafka Connect cluster.
You probably want the Confluent Platform mailing list for this:
https://groups.google.com/forum/#!forum/confluent-platform (or Confluent
Platform slack group: http://cnfl.io/slack with the #control-center
channel). Or if you have a Confluent support contract, contact support :)
--
Robin
You need to make sure you've configured your listeners & advertised
listeners correctly. This should help:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 19 Mar 2020 at 01:49, Dan Hi
g-multiple-kafka-connect-workers/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 17 Mar 2020 at 17:58, mandeep gandhi
wrote:
> Gentle reminder.
>
> + users.
>
> On Mon, Mar 16, 2020 at 11:27 PM mandeep gandhi
> wrote:
>
> >
Hi Michael,
You can find the ASF trademark policies here:
https://www.apache.org/foundation/marks/#books
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Sun, 23 Feb 2020 at 19:47, Michi Bertschi
wrote:
> Hello
> I'm Michael
>
>
> I am writ
Hi,
Can you be a bit more specific about what you're looking for?
thanks, Robin.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 18 Feb 2020 at 00:28, Ajith Kumar Rajendran wrote:
> Hi team,
>
> Need a kafka compatibility metrics details
&
The error you get puts you on the right lines:
> Is your advertised.listeners (called advertised.host.name before Kafka
9) correct and resolvable?
This article explains why and how to fix it:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Senior Develo
#x27;s a useful list of projects to look at:
https://dev.to/guyshiloizy/kafka-administration-and-monitoring-ui-tools-hf4
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 23 Jan 2020 at 04:10, Sunil CHAUDHARI
wrote:
> Hi all,
> Please help me to get so
Not sure what you mean by "SQ", but Kafka Connect workers can indeed be
deployed on their own, connecting to a remote Kafka cluster.
Standalone would make sense in that case, yes.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 16 Jan 2020 at 03:
If spooldir doesn't suit, there's also
https://github.com/streamthoughts/kafka-connect-file-pulse to check out.
Also bear in mind tools like filebeat from Elastic support Kafka as a
target.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 15 Jan
Pretty sure WePay are working on this:
https://github.com/debezium/debezium-incubator
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 15 Jan 2020 at 13:55, Sachin Mittal wrote:
> Hi,
> I was looking for any cassandra source connector to read dat
f.dev/crunch19-zero-to-hero-kafka-connect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 15 Jan 2020 at 03:43, George wrote:
> Hi all.
>
> Please advise, a real noob here still, unpacking how the stack still
> works...
>
> if I have a mySQL
If you use a load balancer bear in mind the importance of the
advertised.listeners setting:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 15 Jan 2020 at 08:15, Himanshu Shukla
wrote:
> is
://www.confluent.io/blog/easy-ways-generate-test-data-kafka/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 8 Jan 2020 at 20:42, cool girl wrote:
> Hi ,
>
> I am trying to learn Kafka. Is there any free API which I can use like
> twitter? I created twitter accou
lse?
<https://hub.docker.com/r/confluentinc/cp-kafka/>
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Sat, 14 Dec 2019 at 04:18, Yu Watanabe wrote:
> Hello.
>
> I would like to ask question related to kafka on docker engine.
> Which container
Hi Karol,
Thanks for submitting these - I'll arrange for a PR to be created to add
them to the page.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 6 Dec 2019 at 08:50, Karol Galanciak wrote:
> Hi,
>
> Could you please add Book
Kafka Connect workers listen on the port defined in *rest.port* in the
worker configuration - typically 8083.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 25 Nov 2019 at 18:41, Johnson, Paul
wrote:
> Hello,
>
> I am working on setting u
We can try, but you'll have to tell us what the problem is :)
This is a good checklist for asking a good question:
http://catb.org/~esr/faqs/smart-questions.html#beprecise
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 14 Nov 2019 at 05:04, prashant
REST API after starting the worker.
See https://rmoff.dev/berlin19-kafka-connect for examples and discussion
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 12 Nov 2019 at 16:40, Miguel Silvestre wrote:
> Hi,
>
> I'm new to kafka (really new
column -s : -t| sed 's/\"//g'| sort
Which returns:
source | source-debezium-mysql-02 | RUNNING | RUNNING |
io.debezium.connector.mysql.MySqlConnector
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 24 Oct 2019 at 15:52, KhajaAsmath Mo
You can specify VALUE_FORMAT='AVRO' to use Avro serialisation and
the Schema Registry. See docs for more details
https://docs.confluent.io/current/ksql/docs/installation/server-config/avro-schema.html
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On
Do you get any output from *docker logs*? And does it work if you don't use
authentication?
How about if you try one of the dockerised Kafka Connect examples here?
https://github.com/confluentinc/demo-scene/tree/master/kafka-connect-zero-to-hero
--
Robin Moffatt | Senior Developer Adv
Hi Tom,
Can you link to which quickstart instructions you're following?
thanks.
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 23 May 2019 at 07:35, Tom Kwong wrote:
> Hi,
> Iโm getting the following error (NoNode for /brokers) on a fresh new
&
ntegration that can
be done in a better way.
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 13 May 2019 at 01:35, Vinay Jain wrote:
> Hi
>
> I would like to consume a Topic and save the AVRO messages in local
> directory in the AVRO file formats. As pe
mples/streams/interactivequeries/kafkamusic/KafkaMusicExample.java
Depending on the processing you want to do KSQL could also be useful,
writing the results of queries (e.g. spotting exceptions in the data) to a
Kafka topic that can be queried by your app.
--
Robin Moffatt | Developer Advocate
-transformations-not-transformations-youre-looking/
You might also want to look at Kafka Streams for applying logic to a stream
before you ingest it with Kafka Connect.
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 25 Jan 2019 at 13:29, Sรถnke Liebau
wrote:
>
It would help if you provide a bit more detail. For example, you mention an
OS upgrade - but what OS? from what version to what version?
Do you see any errors in the broker logs at the time at which they shut
down?
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Mon
lue (79 bytes):
{"uid":2,"name":"Nick","locale":"en_US","address_city":"Palo
Alto","elite":"G"}
Timestamp: 1520618381093Partition: 0Offset: 1
--
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @
xplained
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 6 Dec 2018 at 18:30, Marcos Juarez wrote:
> We're trying to use Kafka Connect to pull down data from Kafka, but we're
> having issues with the Avro deserialization.
>
> When we attempt t
If the properties are not available per-connector, then you will have to
set them on the worker and have independent Kafka Connect clusters
delineated by connector requirements. So long as you configure the ports
not to clash, there's no reason these can't exist on the same host.
Hi Rohan,
Please contact a...@confluent.io and she can arrange this.
thanks, Robin.
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 26 Oct 2018 at 18:26, Rohan Rasane wrote:
> Hi,
> What is the email address, if I want to add ServiceNow to the powe
This should help: https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 17 Sep 2018 at 12:18, XinYi Long wrote:
> Hello, Guys,
>
> I have a Kafka cluster, which is behind a NAT.
>
> I have
kafka-connect-s3/). There are also
options for pulling from the mainframe, depending on specific platform and
system.
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 12 Sep 2018 at 08:32, Chanchal Chatterji <
chanchal.chatte...@infosys.com> wrote:
> Hi,
>
Shameless plug for an article I wrote on understanding Kafka listeners
better, which might help in this case:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
On Thu, 30 Aug 2018 at 14:14, Andrew Otto wrote:
> The trouble is that the producer and consumer clients need to discover the
>
Compared to other managed solutions, or compared to running it yourself?
On Wed, 25 Jul 2018 at 12:44, Vaibhav Jain wrote:
> Hi There, Any pros/cons ? Regards, Vaibhav
--
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
inc/ksql/issues/620> (
https://github.com/confluentinc/ksql/issues/620)
--
Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 10 Jul 2018 at 03:48, ๅๆณข <1091643...@qq.com> wrote:
> Hi all,
> I'm new to kafak. I'm using kafka to build a ETL prog
92 matches
Mail list logo
