Re: [KRaft] Clarification about Deploying Considerations (Kafka docs)

2023-07-06 Thread Luke Chen
navailable. This limitation will be addressed in a future >release of Kafka. > > Link to the related section on the docs: > https://kafka.apache.org/documentation/#kraft_deployment > > > Could you please clarify the following part? > *"More than 3 controllers is no

[KRaft] Clarification about Deploying Considerations (Kafka docs)

2023-07-05 Thread Grigorios Avgitidis
network failure it is possible for the cluster metadata quorum to become unavailable. This limitation will be addressed in a future release of Kafka. Link to the related section on the docs: https://kafka.apache.org/documentation/#kraft_deployment Could you please clarify the following part

Re: docs fixes

2022-05-18 Thread Guozhang Wang
Thanks for reporting this. Are you interested in submitting a PR to fix it? Guozhang On Wed, May 18, 2022 at 7:26 AM Владимир Савостин wrote: > In section https://kafka.apache.org/quickstart#quickstart_kafkaconnect > you should change plugin path from lib/connect-file-3.2.0.ja to > libs/connec

docs fixes

2022-05-18 Thread Владимир Савостин
In section https://kafka.apache.org/quickstart#quickstart_kafkaconnect you should change plugin path from lib/connect-file-3.2.0.ja to libs/connect-file-3.2.0.ja Have a nice day!

Docs: section "5.4 Log": diagram: wrong message offsets?

2021-06-28 Thread Paul Dest
In the docs, section "5.4 Log", there is a diagram with the title "Kafka Log Implementation". The right column of the diagram depicts "Segment Files": "topic/34477849968.kafka" at the top, "topic/82796232652.kafka" at the bottom. Inside the file

Protocol evolution/versioning docs are missing

2020-06-09 Thread Haruki Okada
Hi, Kafka. While reading through protocol docs, I found that doc about protocol evolution and versioning are missing in protocol.html, while toc contains a section for it. https://github.com/apache/kafka/blob/trunk/docs/protocol.html#L47-L50 Is there any plan to add a doc about protocol

Re: can't open site-docs index.html in Binary downloads package

2019-09-26 Thread Matthias J. Sax
You need to setup a local web server as described in the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Setup+Kafka+Website+on+Local+Apache+Server -Matthias On 9/26/19 8:28 AM, 944126367 wrote: > I downloads a Binary package(kafka_2.12-2.3.0) and index.html in > site-docs dir is

can't open site-docs index.html in Binary downloads package

2019-09-26 Thread 944126367
I downloads a Binary package(kafka_2.12-2.3.0) and index.html in site-docs dir is can't be effective. like these pics.

can't open site-docs index.html in Binary downloads package

2019-09-25 Thread 944126367
I downloads a Binary package(kafka_2.12-2.3.0) and index.html in site-docs dir is can't be effective. like these pics.

Re: Question regarding offset commits by Consumers - docs

2018-05-30 Thread M. Manna
That's what i was after! Thanks a lot. On 30 May 2018 at 17:29, Emmett Butler wrote: > From the docs <https://kafka.apache.org/documentation/#impl_offsettracking > > > : > > > The brokers periodically compact the offsets topic since it only needs to > > mai

Question regarding offset commits by Consumers - docs

2018-05-30 Thread M. Manna
Hello, I was trying to remember from docs (it's been a while) how the last committed offsets work i.e. whether it's being tracked per consumer group-basis or something else. This is specific to when auto.offset.reset is set to "earliest"/"latest" and the last

Re: Question regarding offset commits by Consumers - docs

2018-05-30 Thread Emmett Butler
>From the docs <https://kafka.apache.org/documentation/#impl_offsettracking> : > The brokers periodically compact the offsets topic since it only needs to > maintain the most recent offset commit per partition Offsets are maintained per partition per consumer group, so it doesn

Re: Ambiguous entry in docs

2018-02-11 Thread Kamal
A consumer can read data from multiple topics. The above line describes the usage of topic regex in which an existing consumer can read data from newly (yet-to) created topics. For more details, see https://kafka.apache.org/0100/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html#subscrib

Ambiguous entry in docs

2018-01-17 Thread Алекс Турс
Hi. I read (mostly) all documentation top to bottom and happened to stumble upon passage I cannot understand. It states: https://kafka.apache.org/documentation/#impl_consumerregistration "If the consumer creates a message stream using a topic filter, it also registers a watch on changes (new top

Re: Listeners and reference/docs

2017-11-11 Thread Thomas Stringer
Awesome, makes perfect sense thank you! On 11/10/2017 07:28 PM, Kaufman Ng wrote: I think "CLIENT" is just an example. The default for listener.security.protocol.map doesn't have it. If you look at the KIP link in my email there's a more complete example: listener.security.protocol.map=CLIENT:

Re: Listeners and reference/docs

2017-11-10 Thread Kaufman Ng
I think "CLIENT" is just an example. The default for listener.security.protocol.map doesn't have it. If you look at the KIP link in my email there's a more complete example: listener.security.protocol.map=CLIENT:SASL_PLAINTEXT,REPLICATION:PLAINTEXT,INTERNAL_PLAINTEXT:PLAINTEXT,INTERNAL_SASL:SASL_P

Re: Listeners and reference/docs

2017-11-10 Thread Thomas Stringer
Yep I'm familiar with that. Just curious where it's documented that, for instance, the CLIENT listener is for client connections. On Fri, Nov 10, 2017, 12:08 PM Kaufman Ng wrote: > This is related to another config "listener.security.protocol.map" (since > version 0.10.2.0). The CLIENT, PLAINTEX

Re: Listeners and reference/docs

2017-11-10 Thread Kaufman Ng
This is related to another config "listener.security.protocol.map" (since version 0.10.2.0). The CLIENT, PLAINTEXT, etc are defined as a name-protocol mapping. So what you have in the listeners property (e.g. CLIENT) must have an entry in the protocol map which determines which protocol to use (e.g

Listeners and reference/docs

2017-11-10 Thread Thomas Stringer
I've been working with Kafka broker listeners and I'm curious is there any documentation that explains what all of them apply to? Such as CLIENT, PLAINTEXT, SASL/SSL, etc. I see the encryption part of the documentation, but is it just inferred what these listeners apply to? Thank you in advance!

Re: kafka streams docs about topology picture only one source node

2017-06-08 Thread john cheng
Tks matthias, I did't consider about the situation you mentioned. you're right. one or more input topic can add to one single source node: builder.addSource("source-1", "topic-1", "topic-2"); Or they can add to different source node: builder.addSource("source-1", "topic-1"); builder.addSource("sou

Re: kafka streams docs about topology picture only one source node

2017-06-08 Thread Matthias J. Sax
Well. You can also ready multiple topics as a single KStream. > builder.stream("topic-1", "topic-2") Of course both topics must contain data with same key and value type. For this pattern, there is only one source node. There is no 1-to-1 relationship between input topics and source node, and th

kafka streams docs about topology picture only one source node

2017-06-08 Thread john cheng
Kafka streams topology can define one or many SourceNode. The picture on official document < http://kafka.apache.org/0102/documentation/streams#streams_architecture_tasks > only draw one source node in some place: 1. Stream Partitions and Tasks 2. Threading Model 3. Local StateStore And the topolo

Trevor Grant has shared a document on Google Docs with you

2017-05-03 Thread trevor . d . grant
Trevor Grant has invited you to view the following document: Open in Docs <https://accounts.google.com/o/oauth2/auth?client_id=1024674817942-fstip2shineo1lsego38uvsg8n2d3421.apps.googleusercontent.com&scope=https%3A%2F%2Fmail.google.com%2F+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fc

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Guozhang Wang
the address from the dev mailing list. This address is no longer a subscriber. Guozhang On Thu, Mar 23, 2017 at 11:23 AM, Zac Harvey wrote: > Hi how do I unsubscribe from this mailist list, the details in the docs > are not the correct set of steps. > &g

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Hi how do I unsubscribe from this mailist list, the details in the docs are not the correct set of steps. From: Zac Harvey Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Hi, how do I unsubscribe from this mailing list. From: Zac Harvey Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am trying to unsubscribe to this mailing list. When I go to

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Any ideas? From: Zac Harvey Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am trying to unsubscribe to this mailing list. When I go to: https://kafka.apache.org/contact Apache

Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
about Kafka™. To subscribe, send an ... The docs say: "To unsubscribe from any of these you just change the word "subscribe" in the above to "unsubscribe"." So if I try sending an email to users-unsubscr...@kafka.apache.org, I get SMTP errors/failures (is n

Re: Kafka docs for current trunk

2017-02-01 Thread James Cheng
pira wrote: >>> >>>> +1 >>>> >>>> On Tue, Jan 31, 2017 at 5:57 PM, Matthias J. Sax < >> matth...@confluent.io> >>>> wrote: >>>>> Hi, >>>>> >>>>> I want to collect feedback about the i

Re: Kafka docs for current trunk

2017-02-01 Thread Guozhang Wang
> > +1 > > > > > > On Tue, Jan 31, 2017 at 5:57 PM, Matthias J. Sax < > matth...@confluent.io> > > > wrote: > > > > Hi, > > > > > > > > I want to collect feedback about the idea to publish docs for current > > &g

Re: Kafka docs for current trunk

2017-02-01 Thread Damian Guy
i, > > > > > > I want to collect feedback about the idea to publish docs for current > > > trunk version of Apache Kafka. > > > > > > Currently, docs are only published for official release. Other projects > > > also have docs for current SNAPSHOT

Re: Kafka docs for current trunk

2017-01-31 Thread Michael Noll
Thanks for bringing this up, Matthias. +1 On Wed, Feb 1, 2017 at 8:15 AM, Gwen Shapira wrote: > +1 > > On Tue, Jan 31, 2017 at 5:57 PM, Matthias J. Sax > wrote: > > Hi, > > > > I want to collect feedback about the idea to publish docs for current >

Re: Kafka docs for current trunk

2017-01-31 Thread Gwen Shapira
+1 On Tue, Jan 31, 2017 at 5:57 PM, Matthias J. Sax wrote: > Hi, > > I want to collect feedback about the idea to publish docs for current > trunk version of Apache Kafka. > > Currently, docs are only published for official release. Other projects > also have docs for cur

Re: Kafka docs for current trunk

2017-01-31 Thread Sachin Mittal
+1 On 1 Feb 2017 07:27, "Matthias J. Sax" wrote: > Hi, > > I want to collect feedback about the idea to publish docs for current > trunk version of Apache Kafka. > > Currently, docs are only published for official release. Other projects > also have docs for c

Kafka docs for current trunk

2017-01-31 Thread Matthias J. Sax
Hi, I want to collect feedback about the idea to publish docs for current trunk version of Apache Kafka. Currently, docs are only published for official release. Other projects also have docs for current SNAPSHOT version. So the question rises, if this would be helpful for Kafka community, too

Kafka controller replica state docs outdated?

2016-06-12 Thread Stevo Slavić
Hello Apache Kafka community, Is it intentional that not all states (like ReplicaDeletionIneligible) are documented on https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Controller+Internals or is the page just outdated? Btw I see replica states documented in javadoc https://github.com/apach

Re: migrating the main-page docs to gitbook format

2016-03-07 Thread Christian Posta
All, Here's a first spike.. would love feedback.. happy to continue the convo here (https://issues.apache.org/jira/browse/KAFKA-2967) http://christianposta.com/kafka-docs/_book/index.html have the gitbook build integrated with the kafka gradle builds and rest of WIP here: https://githu

Re: migrating the main-page docs to gitbook format

2016-03-03 Thread Marcos Luis Ortiz Valmaseda
org/jira/browse/KAFKA-2967 ? > > > > Gwen > > > > On Wed, Mar 2, 2016 at 2:39 PM, Christian Posta > > > wrote: > > > Would love to have the docs in gitbook/markdown format so they can > easily > > > be viewed from the source repo (or mirro

Re: migrating the main-page docs to gitbook format

2016-03-02 Thread Christian Posta
> wrote: > > Would love to have the docs in gitbook/markdown format so they can easily > > be viewed from the source repo (or mirror, technically) on github.com. > They > > can also be easily converted to HTML, have a side-navigation ToC, and > still

Re: migrating the main-page docs to gitbook format

2016-03-02 Thread Gwen Shapira
Hey! Yes! We'd love that too! Maybe you want to help us out with https://issues.apache.org/jira/browse/KAFKA-2967 ? Gwen On Wed, Mar 2, 2016 at 2:39 PM, Christian Posta wrote: > Would love to have the docs in gitbook/markdown format so they can easily > be viewed from the sour

migrating the main-page docs to gitbook format

2016-03-02 Thread Christian Posta
Would love to have the docs in gitbook/markdown format so they can easily be viewed from the source repo (or mirror, technically) on github.com. They can also be easily converted to HTML, have a side-navigation ToC, and still be versioned along with the src code. Thoughts? -- *Christian Posta

Re: Unclean leader election docs outdated

2015-09-15 Thread Stevo Slavić
urability Guarantees", mentions ability to disable > > unclean leader election, so likely just this one reference needs to be > > updated. > > > > On Sat, Sep 12, 2015 at 1:05 AM, Guozhang Wang > wrote: > > > > > Hi Stevo, > > > > > &g

Re: Unclean leader election docs outdated

2015-09-14 Thread Guozhang Wang
2, 2015 at 1:05 AM, Guozhang Wang wrote: > > > Hi Stevo, > > > > Could you point me to the link of the docs? > > > > Guozhang > > > > On Fri, Sep 11, 2015 at 5:47 AM, Stevo Slavić wrote: > > > > > Hello Apache Kafka community, > >

Re: Unclean leader election docs outdated

2015-09-11 Thread Stevo Slavić
mentions ability to disable unclean leader election, so likely just this one reference needs to be updated. On Sat, Sep 12, 2015 at 1:05 AM, Guozhang Wang wrote: > Hi Stevo, > > Could you point me to the link of the docs? > > Guozhang > > On Fri, Sep 11, 2015 at 5:47 AM, Stev

Re: Unclean leader election docs outdated

2015-09-11 Thread Guozhang Wang
Hi Stevo, Could you point me to the link of the docs? Guozhang On Fri, Sep 11, 2015 at 5:47 AM, Stevo Slavić wrote: > Hello Apache Kafka community, > > Current unclean leader election docs state: > "In the future, we would like to make this configurable to better support

Unclean leader election docs outdated

2015-09-11 Thread Stevo Slavić
Hello Apache Kafka community, Current unclean leader election docs state: "In the future, we would like to make this configurable to better support use cases where downtime is preferable to inconsistency. " If I'm not mistaken, since 0.8.2, unclean leader election strategy (whet

Re: 0.8.2 consumer api docs

2015-09-06 Thread Ewen Cheslack-Postava
Those APIs are not implemented in 0.8.2. They were included because the APIs were being iterated on, but the implementation wasn't there yet. You can expect to see those APIs (with some modifications as they've been refined) in 0.8.3. -Ewen On Sun, Sep 6, 2015 at 10:42 AM, Phil Steitz wrote: >

0.8.2 consumer api docs

2015-09-06 Thread Phil Steitz
is the javadoc for the 0.8.2 Java consumer API published somewhere? All I can find on the website is the producer API, but there are some consumer classes mentioned on the website and more in the source distribution under src/main/java/org/apache/kafka/clients/consumer.

Re: Kafka API docs

2014-04-10 Thread Neha Narkhede
0.9, will look like http://people.apache.org/~nehanarkhede/kafka-0.9-consumer-javadoc/doc/ Hope that is useful! Thanks, Neha On Thu, Apr 10, 2014 at 8:14 PM, Jun Rao wrote: > We don't have good java docs right now. We are rewriting both the producer > and the consumer and will

Re: Kafka API docs

2014-04-10 Thread Jun Rao
We don't have good java docs right now. We are rewriting both the producer and the consumer and will have better javadoc then. For now, following the examples in the documentation is probably your best option. Thanks, Jun On Thu, Apr 10, 2014 at 11:43 AM, Manoj Khangaonkar wrote:

Kafka API docs

2014-04-10 Thread Manoj Khangaonkar
Hi, The API description at http://kafka.apache.org/documentation.html#api is rather thin -- when you are used to the API docs of other apache projects like hadoop , cassandra , tomcat etc etc. Is there a comprehensive API description somewhere (like javadocs) ? Besides looking at the source

Re: producer request.timeout.ms needs to be updated in docs

2013-10-07 Thread Jun Rao
Thanks for pointing this out. Updated the doc. The reason for the change is the following. If the timeout is caused by a problem at the broker, It's actually not very useful to set the timeout too small. After timing out, the producer is likely to resend the data. This adds more load to the broker

producer request.timeout.ms needs to be updated in docs

2013-10-06 Thread Jason Rosenberg
Seems the default for this is no 1 Online doc shows 1500 Just curious, why was this value updated? Jason

docs

2013-08-26 Thread Jay Kreps
Hey All, We've been trying to improve the Kafka docs over the last month. Two things that would really help: 1. If you see something answered that seems like it might be a common question, add it to the FAQ. Right now only a couple people are doing this, but it would be great if everyone d