Currently, Kafka Connect experiences a spike in CPU usage which causes Kafka
Connect to crash. There is really no useful information from the logs to help
me understand what is causing this to happen. Is this a known issue? If it
matters, my configuration settings are as follows:
format.clas
I am trying to migrate from StreamX (https://github.com/qubole/streamx) to use
the official Confluent S3 connector
(https://github.com/confluentinc/kafka-connect-storage-cloud). Part of my
implementation of Kafka Connect requires a custom partitioner. This
partitioner originally extended the
I am looking to product ionize and deploy my Kafka Connect application.
However, there are two questions I have about the tasks.max setting which is
required and of high importance but details are vague for what to actually set
this value to.
My simplest question then is as follows: If I have a
I am working on setting up a Kafka Connect Distributed Mode application which
will be a Kafka to S3 pipeline. I am using Kafka 0.10.1.0-1 and Kafka Connect
3.1.1-1. So far things are going smoothly but one aspect that is important to
the larger system I am working with requires knowing offset in
1:02 PM
To: Phillip Mann
Cc: "users@kafka.apache.org"
Subject: Re: Creating a connector with Kafka Connect Distributed returning 500
error
The bug I was referring to was only in trunk for just a while. Thus, your issue
must be related to something else, even though the response st
ebugging, we are planning to post a step-by-step guide for Kafka and Kafka
> Connect soon.
>
> Regards,
> Konstantine
>
>> On Tue, Dec 6, 2016 at 11:22 AM, Phillip Mann wrote:
>>
>> I am working on migrating from Camus to Kafka Connect. I am working on the
>>
I am working on migrating from Camus to Kafka Connect. I am working on the
implementation of Kafka Connect and specifically focused on distributed mode. I
am able to start a worker successfully on my local machine which I assume
communicates with my Kafka cluster. I am further able to run two GE
Hello all,
This is a bit of a convoluted title but we are trying to set up monitoring on
our Kafka Cluster and Kafka Streams app. I currently have JMX port open on our
Kafka cluster across our brokers. I am able to use a Java JMX client to get
certain metrics that are helpful to us. However,
Hello Guozhang and Akshat,
We are doing the SIGTERM / shutdown hook in our Kafka streams. We will write a
blog post when we are done. Thanks for everything help.
Phillp
From: Guozhang Wang
Date: Tuesday, July 19, 2016 at 2:06 PM
To: "users@kafka.apache.org"
Cc: Phillip Mann
S
at 10:12 AM
To: "users@kafka.apache.org"
Cc: Phillip Mann
Subject: Re: Deploying Kafka Streams to production (Ubuntu 16.04 / systemd)
Hi Phillip,
In general, it is trivial to take an existing java -jar command and systemd-ify
it. All you need to do is to run it as an ExecStart in the
interested in systemd
because you are using it in your company, or are you interested in general
and OK with certain popular tools like YARN / Mesos / Chef / etc?
Guozhang
On Fri, Jul 15, 2016 at 3:57 PM, Phillip Mann wrote:
> Hello,
>
> There is currently no documentation how to dep
Hello,
There is currently no documentation how to deploy Kafka Streams to production.
We have built a cool Kafka Streams application and we wish to make it a part of
our production system. At the moment, we currently run the Kafka streaming
application with the java –jar command and we stop t
12 matches
Mail list logo
