Hello Ahmed,
I am new with Kafka myself, from my experience there are some things you
need to do before deploy Kafka in production
1. read Kafka documentation : key concepts, its architecture, etc
2. learn how to deploy Kafka cluster, this is additional but there are some
management tools that you might want to use to ease Kafka deployment e.g.
Ambari
3. learn how to configure Kafka producer, consumer, and broker properly,
e.g.
in producer : use send asynchronous and buffering for better write
performance, etc
in consumer : don't use auto offset commit, etc
in broker : set 2 or 3 as default topic replication factor, set unclean
leader election enable to false, etc
These information are just a glimpse of minimal knowledge you need to run
Kafka in production, you can find articles that can help you to find more
comprehensive tips.
Regards,
On Tue, Mar 29, 2016 at 9:55 AM, Rahul Jain <rahul...@gmail.com> wrote:
> You can certainly try out things in a development environment. You could
> also think of contributing to the project itself as that will encourage you
> to develop deeper skills.
>
> But you are right. Kafka is pretty straightforward to setup and get
> running. The real skill IMO is in the ability to troubleshoot when things
> go wrong. And that comes only when you see it running in a production
> environment.
> On 29 Mar 2016 8:10 a.m., "S Ahmed" <sahmed1...@gmail.com> wrote:
>
> > Hello,
> >
> > This may be a silly question for some but here goes :)
> >
> > Without real production experience, what steps do you suggest one take to
> > really have some solid skillz in kafka?
> >
> > I tend to learn in a structured way, but it just seems that since kafka
> is
> > a general purpose tool there isn't really a course per say that teaches
> you
> > all things kafka.
> >
> > There are books but the one I read was more of a tutorial on certain
> > aspects of kafka but it doesn't give you the insights of building a real
> > production system.
> >
> > Any suggestions or tips?
> >
>
--
Muqtafi Akhmad
Software Engineer
Traveloka
