Hello, today I my kafka producer stop working, here is the story:
Spark: v1.6.2
Kafka broker: v0.9.0.1
Kafka client: tried 0.9.x and 0.10.x
In a spark batch job, I created a kafka producer and tried to send some
messages to kafka broker, it works without any problem for > one month
until today :(
Hi All,
I'm dipping my toes into kafka security, I'm following the guide here:
http://kafka.apache.org/documentation.html#security_sasl_plain_brokerconfig
and http://kafka.apache.org/documentation.html#security_sasl_brokerconfig
My jaas config file looks like:
KafkaServer {
org.apac
Apologies, just to me clear, my broker settings are actually as below,
using PLAINTEXT throughout
listeners=SASL_PLAINTEXT://host.name:port
security.inter.broker.protocol=SASL_PLAINTEXT
sasl.mechanism.inter.broker.protocol=PLAIN
sasl.enabled.mechanisms=PLAIN
On Fri, Jul 15, 2016
Hi,
Which Kafka version you are using?
SASL/PLAIN support is available from Kafka 0.10.0.0 release onwards.
Thanks
Manikumar
On Fri, Jul 15, 2016 at 4:22 PM, cs user wrote:
> Apologies, just to me clear, my broker settings are actually as below,
> using PLAINTEXT throughout
>
> listeners=
Yep, tried 0.10.0.0, all working fine :-)
I was using 0.9.
Apologies for the spam!
On Fri, Jul 15, 2016 at 12:05 PM, Manikumar Reddy wrote:
> Hi,
>
> Which Kafka version you are using?
> SASL/PLAIN support is available from Kafka 0.10.0.0 release onwards.
>
>
> Thanks
> Manikumar
>
> On Fri, J
Hi all,
we are currently bitten by this bug
https://issues.apache.org/jira/browse/KAFKA-1194 whereby Kafka on
Windows cannot delete/compact the logs, because it has a file open while
trying to rename it.
This does not work on Windows. Its fine on *nixes. But we're stuck with
0.9 for now, so
Sorry, please ignore my stupidity, I found it's due to empty topic name,
the topic name was reset to empty string at some point in the application
code.
2016-07-15 15:46 GMT+08:00 王天鹏 :
> Hello, today I my kafka producer stop working, here is the story:
> Spark: v1.6.2
> Kafka broker: v0.9.0.1
>
Just to follow on from this, what is the difference between these two
broker parameters?
listeners Listener List - Comma-separated list of URIs we will listen on
and their protocols. Specify hostname as 0.0.0.0 to bind to all interfaces.
Leave hostname empty to bind to default interface. Examples
Hello All,
I'm curious if I can output to a .txt file after doing some stream processing
using Kafka Streams. The scenario I'm trying to implement is a simple web log
processing application with alerts on specific criteria. I know I can ingest
log files from the local filesystem into Kafka usin
Hi David,
One option would be to first output your info to a topic using Kafka Streams,
and then use Connect again (as a sink) to read from the topic and write to a
file in the file system.
Eno
> On 15 Jul 2016, at 08:24, David Newberger
> wrote:
>
> Hello All,
>
> I'm curious if I can out
Hi David,
As Eno said, you can use Kafka Streams to pipe the raw logs as well as
those anomaly events to two different topics, and use separate Kafka
Connect to read them into two files.
An alternative way to use Kafka Streams only, is to use the `printAsText`
operator in the Streams DSL, or you
I'm trying to get a basic Kafka Connect stack setup with docker-compose,
but the one offered by 1ambda,
https://hub.docker.com/r/1ambda/kafka-connect/ does not work. On my Mac,
the docker compose stack times out within a few dozen seconds.
Trace:
$ wget
https://raw.githubusercontent.com/1ambda/do
Hi Eno and Guozhang,
Thank you both! I'm glad to know it's possible now I'll work on implementing
the POC.
David Newberger
-Original Message-
From: Guozhang Wang [mailto:wangg...@gmail.com]
Sent: Friday, July 15, 2016 11:43 AM
To: users@kafka.apache.org
Subject: Re: Kafka Connect or S
I have tried putting the Public IP address of my instance and was getting the
same port bind issues, however when I tried Public DNS in the listener it
started fine.
Regards,
Muhammad S Tahir - VP - Engineering | e: muhammad.ta...@chimpchange.me
ChimpChange
| 7083 Hollywood Boulevard,
Hello,
There is currently no documentation how to deploy Kafka Streams to production.
We have built a cool Kafka Streams application and we wish to make it a part of
our production system. At the moment, we currently run the Kafka streaming
application with the java –jar command and we stop t
Hi,
Can Kakfa support multiple CA certs on broker.
If yes, can you please point me to an example.
Producer signed with second CA (CA2) is failing. Client signed with CA1 is
working fine.
kafka-console-producer --broker-list kafka.example.com:9093 --topic oem2-kafka
--producer.config /etc/kafka
Hi All,
I have Kafka setup with default settings and relatively large network delay
(up to dozens milliseconds) between a broker and consumer. This setup has
very poor performance (~30kbps per client) despite of no packet loss on the
way (the network is very reliable).
After investigation of the tr
Hello Phillip,
Thanks for your question. We are indeed working on write some guidance in
docs / blogs about how to deploy a written Kafka Streams app code with
different tools / frameworks. Are you particularly interested in systemd
because you are using it in your company, or are you interested i
18 matches
Mail list logo
