Hello Everyone,
Thank you for the time and help. I had the Kafka Producer running, but am
having some trouble now.
1) Using Maven, I wrote a Kafka Producer similar to the one found here:
https://github.com/pppsunil/HelloKafka/blob/master/src/main/java/com/spnotes/kafka/HelloKafkaProducer.java
2)
Hello All,
I posted a question last week (
http://mail-archives.apache.org/mod_mbox/kafka-users/201501.mbox/browser)
but I'm not able to respond to the thread for some reason?
The suggestion on the last post was that I am missing some jar files in my
classpath, but I am using the following jar fi
Hello Everyone,
Thank you for the help!
Preface: I've created producers/consumers before and they have worked. I
have also made consumers/producers using java programs, but they have all
been locally.
1) I have a Zookeeper/Kafka Server running on an EC2 instance called "A"
2) I started the Zook
ic.ip.of.A 9092
>
>
> -Jaikiran
>
> On Tuesday 20 January 2015 07:16 AM, Su She wrote:
>
>> Hello Everyone,
>>
>> Thank you for the help!
>>
>> Preface: I've created producers/consumers before and they have worked. I
>> have also made cons
Hello Everyone,
Sorry for the duplicate post, I hadn't subscribed to the list yet, so I
couldn't reply to suggestions. That has been fixed now.
1) Using Maven, I wrote a Kafka Producer similar to the one found here:
https://github.com/pppsunil/HelloKafka/blob/master/src/main/java/com/spnotes/kafk
Hello Everyone,
Sorry for asking multiple questions, but I am currently trying another
approach to run a kafka producer.
1) I started the kafka console producer as mentioned here in the background
(just added a & to the end of the producer script) :
http://kafka.apache.org/documentation.html#intr
ww.twitter.com/allthingshadoop>
> /
>
> On Tue, Jan 20, 2015 at 3:44 PM, Su She wrote:
>
> > Hello Everyone,
> >
> > Sorry for asking multiple questions, but I am currently trying another
> > approach to run a kafka producer.
> >
> > 1) I started t
ork. Alternatively, you can put the jar on the class path and then
> specify the exact class you want to run
>
> java -cp jar.with.dependencies.jar com.spnotes.kafka.HelloKafkaProducer
>
>
> On Tue, Jan 20, 2015 at 11:43 AM, Su She wrote:
>
> > Hello Everyone,
ng_the_stuff | kafkacat -b mybroker -t mytopic
>
> That will produce one kafka message to topic 'mytopic' for each line of
> input.
> See kafkacat -h for the full range of options (e.g., delimiter, specific
> partition, etc).
>
> Hope that helps,
> Magnus
>
> 20
Ahh okay got it. Thank you Magnus!
On Tue, Jan 20, 2015 at 1:55 PM, Magnus Edenhill wrote:
> If you pipe your java program to kafkacat then the java program's stdout
> (output)
> will be directed to kafkacat's stdin (input).
>
> java program | kafkacat
>
> 20
Hello Everyone,
I recently watched this video by Tim Kellogg:
https://www.youtube.com/watch?v=VoTclkxSago.
1) Has anyone integrated MQTT and Kafka? If so how did the architecture
look like? I am confused as to how to get messages from the MQTT broker to
the Kafka broker.
2) Has anyone used this
Hello All,
I have set up a cluster of EC2 instances using this method:
http://blogs.aws.amazon.com/bigdata/post/Tx2D0J7QOVRJBRX/Deploying-Cloudera-s-Enterprise-Data-Hub-on-AWS
As you can see the instances are w/in a private subnet. I was wondering if
anyone has any advice on how I can set up a K
ion correctly... You're asking how do you
> > establish connectivity to an instance in a private subnet from the
> outside
> > world? Are you thinking in terms of zookeeper or just general aws
> network
> > connectivity?
> >
> > On Wed, Jan 28, 2015 at 11
okers
> ?
>
>
>
> On Wed, Jan 28, 2015 at 10:56 PM, Su She wrote:
>
> > Thank you Dillian and Guozhang for the responses.
> >
> > Yes, Dillian you are understanding my issue correctly. I am not sure what
> > the best approach to this is...I'm not su
org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:116)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:78)
On Thu, Jan 29, 2015 at 9:44 AM, Su She wrote:
> Thank you Guozhang for an updated link.
>
> I read the answer for "Why can't my consumers/produ
Hello Everyone,
I previously had my EC2 instances in a private subnet, but I spun up a new
cluster in a public subnet. However, it seems to have taken me a step back
as now I can't even start the zookeeper. I am getting this error:
ERROR Unexpected exception, exiting abnormally
(org.apache.zookee
Engagement Engineer
> mobile: 609.577.1600 | linkedin <http://www.linkedin.com/in/nattyice>
>
>
> On Thu, Jan 29, 2015 at 11:47 AM, Su She wrote:
>
> > I tried a new approach and have started ec2 instances in a public subnet
> > rather than a private subnet. How
an either
> reconfigure your Zookeeper in CM, or stop the service, and start up a
> Zookeeper manually to try to bind to the public IPs.
>
> Thanks,
> Natty
>
> Jonathan "Natty" Natkins
> StreamSets | Customer Engagement Engineer
> mobile: 609.577.1600 | linkedin
:
> Responses inline
>
> Jonathan "Natty" Natkins
> StreamSets | Customer Engagement Engineer
> mobile: 609.577.1600 | linkedin <http://www.linkedin.com/in/nattyice>
>
>
> On Thu, Jan 29, 2015 at 12:47 PM, Su She wrote:
>
> > Thanks Jonathon!
> >
> &
If you mean setting up Kafka on ec2:
https://www.youtube.com/watch?v=ArUHr3Czx-8
the commands may differ depending on which type of ec2 instance you are
using.
Also: http://kafka.apache.org/documentation.html#introduction
On Mon, Feb 9, 2015 at 4:53 AM, Sharath N wrote:
> Hi, any one please h
I was looking at the documentation and I see that the
broker/server/consumer listen to ports 2181 and 9092, but can be configured
for other ports in that range. Are there any other ports that a kafka
producer/consumer use in the back-end to publish/consume messages?
Thank you!
Okay got it, thanks!
On Tue, Feb 10, 2015 at 12:45 PM, Zijing Guo
wrote:
> The kafka's port can be configured through server.properties, and if you
> use kafka's zk, then you can modify the zookeeper.properties file, for
> clientPort.
>
> On Tuesday, February
I usually got that exception if
a) there is a firewall issue
b) you are trying to consume messages from another node and have not set
your advertised host name to the public ip address in the kafka server
settings.
On Tue, Feb 24, 2015 at 12:07 PM, alexey yakubovich <
alexe...@yahoo.com.invali
Hello Everyone,
I'm wondering how to keep Zookeeper and Kafka Server up even when my
SSH (using putty) becomes inactive. I've tried running it in the
background (using &), but it seems like it stops sometimes after a
couple hours or so and I'll have to restart zookeeper and/or the kafka
server.
T
gt; *GitHub*: https://github.com/terryjbates
> *Linkedin*: http://www.linkedin.com/in/terryjbates/
>
>
> On Tue, Jun 16, 2015 at 3:30 PM, Mike Bridge wrote:
>
>> Have you tried using "nohup"
>>
>> nohup bin/zookeeper-server-start.sh config/zooke
Hello Everyone,
I am in a tricky situation.
I am running Kafka (downloaded via binary) on a private cloud behind NAT. I
am hoping to send messages to the broker from outside the cloud. Everything
else seems to be working fine, I can send messages from instances within
the private cloud. The insta
also what zookeeper uses to communicate to the broker, but if zookeeper
> is inside the NAT it might not have a route via that external IP.
> On Jul 7, 2015 2:10 PM, "Su She" wrote:
>
> > Hello Everyone,
> >
> > I am in a tricky situation.
> >
> >
Quick question,
so is there any way to set the advertised host name differently for the
zookeeper and clients?
Thanks,
Su
On Tue, Jul 7, 2015 at 5:33 PM, Su She wrote:
> Thank you Hawin and Mike for the answers.
>
> Having a public IP would be the easiest solution, but unfortunat
28 matches
Mail list logo
