Re: [GitHub] [kafka-site] mjsax commented on pull request #156: MINOR increasing queued.max.requests for production recommendations in 0.9 and newer.

2021-03-28 Thread M. Manna
Unsubscribe On Sun, 28 Mar 2021 at 20:44, GitBox wrote: > > mjsax commented on pull request #156: > URL: https://github.com/apache/kafka-site/pull/156#issuecomment-808948878 > > >Closing this PR as abandoned. (We can reopen if necessary.) > > > -- > This is an automated message from the Apa

Re: We want to remove Zookeeper from our Kafka cluster which version to use?

2021-01-19 Thread M. Manna
Manor, If you check the KIP it’s not yet implemented. Also, I believe we might see some update on ASF Kafka site and/or Confluent soon about this. In other words, you cannot just use it yet. Last I remember, Collin was PMing KIP-500 - so I would let them comment on this. Regards, On Tue, 19 J

Re: Why many "Load Bug xxx" JIRA bug by Tim?

2021-01-06 Thread M. Manna
I had to register this as spam and block them. I couldn’t disable it from ASF JiRA. I’m also curious to know how/why such surge occurred. Regards, On Wed, 6 Jan 2021 at 03:45, Luke Chen wrote: > Hi, > I received a lot of JIRA notification emails today, and they are all > titled: "Load Bug xxx

Re: [jira] [Created] (KAFKA-10930) Load Bug rsTheretuv 18

2021-01-05 Thread M. Manna
Can this be stopped ? Some spamming going on ? On Tue, 5 Jan 2021 at 18:27, Tim van der Kooi (Jira) wrote: > Tim van der Kooi created KAFKA-10930: > > > Summary: Load Bug rsTheretuv 18 > Key: KAFKA-10930 > UR

[jira] [Created] (KAFKA-10465) Potential Bug/Doc update in Transactional Producer and Isolation Level

2020-09-07 Thread M. Manna (Jira)
M. Manna created KAFKA-10465: Summary: Potential Bug/Doc update in Transactional Producer and Isolation Level Key: KAFKA-10465 URL: https://issues.apache.org/jira/browse/KAFKA-10465 Project: Kafka

Re: Broker side round robin on topic partitions when receiving messages

2020-06-14 Thread M. Manna
Vinicius, If you have an idea of what you want , and how it is going to improve current Kafka offering perhaps you could submit a KiP ? The guidelines are provided on Apache Kafka Wiki (Confluence). Thanks, On Sun, 14 Jun 2020 at 22:26, Vinicius Scheidegger < vinicius.scheideg...@gmail.com> wr

Re: [VOTE] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread M. Manna
+1 (binding). Thanks for the KIP. On Tue, 31 Mar 2020 at 14:17, Paolo Moriello wrote: > Hello, > > Thanks to everybody who has given feedback. I've incorporated the > suggestions and think that this is now ready for a vote. > > KIP 579: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-

Re: [DISCUSS] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-30 Thread M. Manna
consistent. But with "INCONSISTENT_REPLICATION_FACTOR" it's semantically closer to your KIP motivation. Also, users will likely and inherently, discover that it's ISR and replication factor that might've been wrong for them. Perhaps, someone else may have different ideas, but please feel fr

Re: How to change/increase ISR

2020-01-30 Thread M. Manna
Hey Upendra, https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools The above should guide you through the reassignment of partitions/replicas. Also, you should read about offset.topic.num.partitions offset.topic.replication.factor I hope this helps you. Regards, On Thu, 30 Ja

Re: [DISCUSS] KIP-566: Add rebalance callbacks to ConsumerInterceptor

2020-01-23 Thread M. Manna
Hey Thomas, On Thu, 23 Jan 2020 at 21:17, Thomas Becker wrote: > Hi folks, > I'd like to open the discussion for KIP-566: Add rebalance callbacks to > ConsumerInterceptor. We've been looking to implement some custom metrics > via ConsumerInterceptor, and not knowing when partition ownership chan

Re: [VOTE] KIP-553: Disable all SSL protocols except TLSV1.2 by default.

2020-01-22 Thread M. Manna
+1 (binding). A simple, and yet powerful enforcement of TLS version. Thanks for this KIP :) On Tue, 21 Jan 2020 at 20:39, Mickael Maison wrote: > +1 (binding) > Thanks > > On Tue, Jan 21, 2020 at 7:58 PM Ron Dagostino wrote: > > > > +1 (non-binding) > > > > Ron > > > > On Tue, Jan 21, 2020 at

Re: [VOTE] KIP-409: Allow creating under-replicated topics and partitions

2020-01-16 Thread M. Manna
020 at 4:10 PM Kamal Chandraprakash > wrote: > > > > +1 (non-binding). Thanks for the KIP! > > > > On Mon, Jan 13, 2020 at 1:58 PM M. Manna wrote: > > > > > Hi Mikael, > > > > > > Apologies for last minute question, as I just caught

Re: [VOTE] KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

2020-01-15 Thread M. Manna
+1 (non-binding) Thanks for this KIP Regards, On Wed, 15 Jan 2020 at 20:35, Mitchell wrote: > +1(non-binding) > > Very useful > -mitch > > On Wed, Jan 15, 2020, 3:29 PM Anna McDonald > wrote: > > > Greetings, > > I would like to propose a vote on KIP-399, extending the > > ProductionException

Re: [VOTE] KIP-555: An admin tools proposal to accomplish the deprecation of zookeeper access that is direct

2020-01-15 Thread M. Manna
+1 (Binding) - a long awaited KIP to have a simpler partition reassignment script (without ZK)> Kudos to you Colin :) On Wed, 15 Jan 2020 at 10:10, Viktor Somogyi-Vass wrote: > +1 (non-binding) > > Viktor > > On Wed, Jan 15, 2020 at 10:27 AM Manikumar > wrote: > > > +1 (binding) > > > > Thanks

Re: [VOTE] KIP-409: Allow creating under-replicated topics and partitions

2020-01-13 Thread M. Manna
Hi Mikael, Apologies for last minute question, as I just caught up with it. Thanks for your work on the KIP. Just trying to get your thoughts on one thing (I might have misunderstood it) - currently it's possible (even though I am strongly against it) to create Kafka topics which are under-replic

Re: [VOTE] KIP-551: Expose disk read and write metrics

2020-01-11 Thread M. Manna
Hey Colin, +1 - Really useful for folks managing a cluster by themselves. M. MAnna On Fri, 10 Jan 2020 at 22:35, Jose Garcia Sancio wrote: > +1, LGTM. > > On Fri, Jan 10, 2020 at 2:19 PM Gwen Shapira wrote: > > > +1, thanks for driving this > > > > On Fri,

[jira] [Created] (KAFKA-9363) Admin Script "kafka-topics" doesn't confirm on successful creation

2020-01-03 Thread M. Manna (Jira)
M. Manna created KAFKA-9363: --- Summary: Admin Script "kafka-topics" doesn't confirm on successful creation Key: KAFKA-9363 URL: https://issues.apache.org/jira/browse/KAFKA-9363

Re: [VOTE] KIP-531: Drop support for Scala 2.11 in Kafka 2.5

2019-12-18 Thread M. Manna
+1 (non-binding). Thanks, On Tue, 17 Dec 2019 at 22:14, Ewen Cheslack-Postava wrote: > +1 (binding), though there is definitely still some compatibility risk -- > regardless of updates, people are going to have apps that may need other > updates but upgrading between scala versions is still too

Re: Broker Interceptors

2019-12-02 Thread M. Manna
Hi Tom, On Mon, 2 Dec 2019 at 09:41, Thomas Aley wrote: > Hi Kafka community, > > I am hoping to get some feedback and thoughts about broker interceptors. > > KIP-42 Added Producer and Consumer interceptors which have provided Kafka > users the ability to collect client side metrics and trace th

Re: Kafka cluster issues

2019-11-28 Thread M. Manna
Hi On Thu, 28 Nov 2019 at 16:40, Uday Kiran A wrote: > Hi Team, > > > > We have setup the open source kafka_2.11 setup on ubuntu with 6 nodes . > we are facing issue with the subscribers(dotnet) .Messages are failed to > deliver and messages are missing. > > Can you help us in verifying the conf

Re: Kafka SSH Tunnel Connection without editing hostfile

2019-11-08 Thread M. Manna
Hi On Fri, 8 Nov 2019 at 11:13, Akshay Das wrote: > Hi Team, > > I'm trying to consume from a kafka cluster using java client, but the kafka > server can only be accessed via jumphost/ssh tunnel. But even after > creating ssh tunnel we are not able to read because once consumer fetches > metadata

Re: [VOTE] KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

2019-10-22 Thread M. Manna
+1 (non-bonding) it’s a helpful info. Thanks for the KIP. Regards, On Tue, 22 Oct 2019 at 23:45, Jason Gustafson wrote: > +1 Thanks Colin. > > On Tue, Oct 22, 2019 at 12:42 AM Tom Bentley wrote: > > > +1 (non-binding). Thanks! > > > > On Tue, Oct 22, 2019 at 1:03 AM Gwen Shapira wrote: > > >

Re: [VOTE] KIP-537: Increase default zookeeper session timeout

2019-10-22 Thread M. Manna
+1 binding. This kip will possibly fix a lot of extra line of configuration. Thanks, On Tue, 22 Oct 2019 at 09:06, Stanislav Kozlovski wrote: > Solid KIP. This also has the side-effect of bumping > zookeeper.connection.timeout.ms to a more reasonable default (the 18s > session timeout). Perhaps

Re: [DISCUSS] KIP-541: Create a fetch.max.bytes configuration for the broker

2019-10-21 Thread M. Manna
ote: > On Mon, Oct 21, 2019, at 15:52, M. Manna wrote: > > Hello Colin, > > > > The KIP looks concise. My comments are below. > > > > replica.fetch.max.bytes is relevant when there is replication involved, > so > > I am trying to understand how fetch.max.bytes

Re: [DISCUSS] KIP-541: Create a fetch.max.bytes configuration for the broker

2019-10-21 Thread M. Manna
Hello Colin, The KIP looks concise. My comments are below. replica.fetch.max.bytes is relevant when there is replication involved, so I am trying to understand how fetch.max.bytes for a broker will play a role here. Apologies for any limited assumptions (always trying to catchup with Kafka :). A

Re: How to stop partition rebalancing

2019-10-09 Thread M. Manna
Hi, If you choose not to close consumer, but only poll as a background thread it, the rebalance wouldn’t take place. This is only if you are sending heartbeats (via Poll() ) within the timeout period. Also, if one of the pod dies, rebalance has to happen. You’d want a fare share of work. An examp

[jira] [Resolved] (KAFKA-4941) Better definition/introduction to the term brokers

2019-10-03 Thread M. Manna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Manna resolved KAFKA-4941. - Resolution: Invalid > Better definition/introduction to the term brok

[jira] [Resolved] (KAFKA-5712) Expose ProducerConfig in the KafkaProducer clients

2019-10-03 Thread M. Manna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Manna resolved KAFKA-5712. - Reviewer: Bill Bejeck Resolution: Information Provided > Expose ProducerConfig in

Re: Kafka with kubernetes

2019-09-26 Thread M. Manna
Hi, 1) Assuming you are looking for helm chart - Confluent has it made available here - https://github.com/helm/charts/tree/master/incubator/kafka 2) Gwen Shapira published a very good white paper on Kafka with K8s - https://www.confluent.io/resources/recommendations-for-deploying-apache-kafka-o

Re: Kafka SSH Tunnel Connection without editing hostfile

2019-09-13 Thread M. Manna
? Thanks, On Fri, 13 Sep 2019 at 06:41, Akshay Das wrote: > We cannot use external endpoints because of security reasons. > Is there an option to tell zookeeper/broker not to send broker host detail > metadata to its clients? > > On Thu, Sep 12, 2019 at 3:05 PM M. Manna wrote: >

Re: Kafka SSH Tunnel Connection without editing hostfile

2019-09-12 Thread M. Manna
Have you tried using EXTERNAL endpoints for your Kafka broker to separate TLS from internal traffic? Also, have you checked zk admin whether the broker metadata is exposing your TLS endpoints to clients ? On Thu, 12 Sep 2019 at 10:23, Akshay Das wrote: > Hi Team, > > I'm trying to consume from

Re: [VOTE] KIP-520: Augment Consumer.committed(partition) to allow multiple partitions

2019-09-12 Thread M. Manna
Gushing, Good kip. +1 (binding) from me. Thanks, MAnna On Thu, 12 Sep 2019 at 09:55, Bruno Cadonna wrote: > Guozhang, Thanks for the KIP. > > +1 (non-binding) > > Best, > Bruno > > On Wed, Sep 11, 2019 at 9:17 AM Kamal Chandraprakash > wrote: > > > > Thanks for the KIP! > > > > LGTM, +1 (non-

Re: all tests passed but still got ‘Some checks were not successful’

2019-08-18 Thread M. Manna
Could you send a retest ? Add “Retest this please” comment. It’ll kick off. On Sun, 18 Aug 2019 at 16:16, hong mao wrote: > Hi all, > I submitted a PR and all testcases passed in Jenkins, but I still got a > 'Some checks were not successful' tip. Could anybody give some advices? > Here's the PR

Re: [DISCUSS] KIP-487: Automatic Topic Creation on Producer

2019-08-08 Thread M. Manna
Hi, If I may, perhaps you could simplify everything by using only 'auto.create.topics.enable' as a value along with true. In other words, the public interfaces section should only have [true,auto.create.topics.enable, false]. The reason for this is that auto.create.topics.enable is already known

[jira] [Created] (KAFKA-8759) Message Order is reversed when client run behind a VPN

2019-08-06 Thread M. Manna (JIRA)
M. Manna created KAFKA-8759: --- Summary: Message Order is reversed when client run behind a VPN Key: KAFKA-8759 URL: https://issues.apache.org/jira/browse/KAFKA-8759 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-480 : Sticky Partitioner

2019-07-14 Thread M. Manna
+1(na) On Sat, 13 Jul 2019 at 22:17, Stanislav Kozlovski wrote: > +1 (non-binding) > > Thanks! > > On Fri, Jul 12, 2019 at 6:02 PM Gwen Shapira wrote: > > > +1 (binding) > > > > Thank you for the KIP. This was long awaited. > > > > On Tue, Jul 9, 2019 at 5:15 PM Justine Olshan > > wrote: > > >

Re: [DISCUSS] KIP-480 : Sticky Partitioner

2019-07-10 Thread M. Manna
ed only in the DefaultPartitioner. > > regards, > Colin > > > On Tue, Jul 9, 2019, at 05:12, M. Manna wrote: > > Hello Justine, > > > > I have one item I wanted to discuss. > > > > We are currently in review stage for KAFKA- where we can choose > a

Re: [DISCUSS] KIP-480 : Sticky Partitioner

2019-07-09 Thread M. Manna
Hello Justine, I have one item I wanted to discuss. We are currently in review stage for KAFKA- where we can choose always RoundRobin regardless of null/usable key. If I understood this KIP motivation correctly, you are still honouring how the hashing of key works for DefaultPartitioner. Wou

Re: PR review

2019-07-09 Thread M. Manna
Hello Colin, I appreciate the time for reviewing this PR. I have now incorporated your (and Matthias's) comments and the PR has been resubmitted. Please let me know if there is more that we need to change. Thanks again, On Mon, 8 Jul 2019 at 23:50, Colin McCabe wrote: > Hi M. Mann

Re: PR review

2019-07-08 Thread M. Manna
Hello, A few requests have been sent already. Could this please be reviewed ? Our business implementation is holding due to this change. On Thu, 4 Jul 2019 at 13:33, M. Manna wrote: > https://github.com/apache/kafka/pull/6771 > > Could this be reviewed please ? > > On Wed, 3

Re: PR review

2019-07-04 Thread M. Manna
https://github.com/apache/kafka/pull/6771 Could this be reviewed please ? On Wed, 3 Jul 2019 at 11:35, M. Manna wrote: > https://github.com/apache/kafka/pull/6771 > > Bouncing both users and dev to get some activity going. We are waiting for > a while to get this KIP pr merge

Re: PR review

2019-07-03 Thread M. Manna
https://github.com/apache/kafka/pull/6771 Bouncing both users and dev to get some activity going. We are waiting for a while to get this KIP pr merged. Could someone please review? Thanks, On Sun, 30 Jun 2019 at 08:59, M. Manna wrote: > https://github.com/apache/kafka/pull/6771 > &

PR review

2019-06-30 Thread M. Manna
https://github.com/apache/kafka/pull/6771 Hello, Could the above PR can be reviewed? This has been waiting for a long time. Just to mention, the package name should have "internal". Round-robin partitioning should have been supported without/without a key from the beginning. It provides user a g

Re: [jira] [Created] (KAFKA-8604) kafka log dir was marked as offline because of deleting segments of __consumer_offsets failed

2019-06-26 Thread M. Manna
This is a known issue for Windows. See KAFKA-6188. Thanks, On Wed, 26 Jun 2019 at 14:46, songyingshuan (JIRA) wrote: > songyingshuan created KAFKA-8604: > > > Summary: kafka log dir was marked as offline because of > deleting segments of __consu

Re: PR review

2019-06-23 Thread M. Manna
I have updated it with my comments - @mjsax could you kindly comment I stopped watching the issue since it sends all updates to all issues to my inbox :) Thanks, On Sat, 22 Jun 2019 at 10:48, M. Manna wrote: > Thanks Matthias. Moved to dev DL now. > > I saw your comment on the PR

Re: PR review

2019-06-22 Thread M. Manna
Thanks Matthias. Moved to dev DL now. I saw your comment on the PR regarding imports. I’ll fix those and resubmit. Thanks, On Sat, 22 Jun 2019 at 01:22, Matthias J. Sax wrote: > I would recommend to move this discussion to the dev list. > > -Matthias > > On 6/20/19 7:42 PM,

Re: Preliminary blog post for the Apache Kafka 2.3.0 release

2019-06-18 Thread M. Manna
It’s asking for credentials...? On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > Hi all, > > I've written up a preliminary blog post about the upcoming Apache Kafka > 2.3.0 release. Take a look and let me know what you think. > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?

Re: message.max.bytes

2019-06-16 Thread M. Manna
Can you see anything from server logs whether this has been purged ? As far as I can remember, you are not supposed to just make it smaller without future issues. Let us here know what you can find from logs. Also, you should think about configuring request and server level max size to avoid such

Re: Newbie on lookout for work

2019-06-06 Thread M. Manna
Please send a separate email, asking for JIRA contributor permissions. As always, you’re welcome to read guidelines mentioned in confluence WIKI for apache Kafka and Kafka official site to understand the practices. Thanks, On Thu, 6 Jun 2019 at 11:57, Dulvin Witharane wrote: > Hi I’ve found a

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2019-05-20 Thread M. Manna
I have now submitted the PR for review. Thanks Matthias for pointing out that KAFKA- was raised to address the same. https://github.com/apache/kafka/pull/6771 if someone reviews after Jenkins build is complete, I would appreciate it. Thanks, On Fri, 17 May 2019 at 22:18, M. Manna wrote

[jira] [Created] (KAFKA-8394) Cannot Start a build with New Gradle Version

2019-05-20 Thread M. Manna (JIRA)
M. Manna created KAFKA-8394: --- Summary: Cannot Start a build with New Gradle Version Key: KAFKA-8394 URL: https://issues.apache.org/jira/browse/KAFKA-8394 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2019-05-17 Thread M. Manna
Apologies for the delay. As per the original thread, there have been 3 binding votes. I will be closing this and update the confluence page with the results. Also, I will be submitting the PR soon. Regards, On Fri, 5 Apr 2019 at 00:18, M. Manna wrote: > Thanks Harsha. > > As per your

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2019-04-04 Thread M. Manna
rom Matthias, Bill > Bejeck and myself you got 3 binding votes. > You can do the full tally of the votes and send out a close of vote thread. > > Thanks, > Harsha > > On Thu, Apr 4, 2019, at 12:24 PM, M. Manna wrote: > > Hello, > > > > Trying to revive this thread a

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2019-04-04 Thread M. Manna
Hello, Trying to revive this thread again. Would anyone be interested in having this KiP through Thanks, On Fri, 25 Jan 2019 at 16:44, M. Manna wrote: > Hello, > > I am trying to revive this thread. I only got 1 binding vote so far. > > Please feel free to revisit a

Re: Need help in setting up security in Kafka systems

2019-04-04 Thread M. Manna
Hi, Have you checked the section on security here? It's got a comprehensive guide https://kafka.apache.org/documentation/#security_sasl To answer your questions briefly - Broker to Broker should be plainTEXT (or SSL if inter-broker security is enabled then broker2brorker works as a client coms)

Kafka Broker Config (logs.dir) on Kubernetes

2019-04-04 Thread M. Manna
Hello, The question might trigger people to reply with "Confluent" - but it's not related to confluent as the kubernetes offering is not for publi/community edition. So, discussing Helm charts and intro to Confluent isn't our objective here. What I am trying to understand is how does the log fil

Re: [jira] [Created] (KAFKA-8149) ERROR Disk error while writing to recovery point file

2019-03-22 Thread M. Manna
This is probably a duplicate of Kafka-6188 and Kafka-1194 Please double check and verify. Thanks, On Fri, 22 Mar 2019 at 17:36, wade wu (JIRA) wrote: > wade wu created KAFKA-8149: > -- > > Summary: ERROR Disk error while writing to recovery point file >

Question on performance data for Kafka vs NATS

2019-03-21 Thread M. Manna
HI All, https://nats.io/about/ this shows a general comparison of sender/receiver throughputs for NATS and other messaging system including our favourite Kafka. It appears that Kafka, despite taking the 2nd place, has a very low throughput. My question is, where does Kafka win over NATS? is it t

Re: Kafka issue

2019-03-20 Thread M. Manna
3 broker with replication factor 2 ? Isn't that already problematic? Have you considered extending the partition as 3 (since you have 3 brokers), and give a try? Can you afford extension to 1 more broker? On Wed, 20 Mar 2019 at 16:02, Barguje, Bharat, Vodafone Group < bharat.barg...@vodafone.com>

Kafka Topic Volume and (possibly ACL) question

2019-02-18 Thread M. Manna
Hello, We have a requirement where, based on business requirementes, we need to publish data only for a specific set of clients. For example, an invoice update shouldn't go to all clients, only the specific client. But a company remittance info should be published to all clients. Also, in some cas

Re: [jira] [Created] (KAFKA-7913) Kafka broker halts and messes up the whole cluster

2019-02-09 Thread M. Manna
Are you saying it’s jdk 11 issue ? Does it work with jdk8 On Sat, 9 Feb 2019 at 10:31, Andrej Urvantsev (JIRA) wrote: > Andrej Urvantsev created KAFKA-7913: > --- > > Summary: Kafka broker halts and messes up the whole cluster > K

[jira] [Resolved] (KAFKA-7881) Inter.broker.procol.version is incorrect for Rolling Upgrade

2019-01-29 Thread M. Manna (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Manna resolved KAFKA-7881. - Resolution: Cannot Reproduce Assignee: M. Manna Duplicate jars were present - a delete and copy of

[jira] [Created] (KAFKA-7881) Inter.broker.procol.version is incorrect for Rolling Upgrade

2019-01-29 Thread M. Manna (JIRA)
M. Manna created KAFKA-7881: --- Summary: Inter.broker.procol.version is incorrect for Rolling Upgrade Key: KAFKA-7881 URL: https://issues.apache.org/jira/browse/KAFKA-7881 Project: Kafka Issue Type

Re: Rolling Upgrade failed after bumping version to 2.1 from 1.1

2019-01-29 Thread M. Manna
By investigating journalctl logs - I see that it says version 2.1 is not a valid version? So what is a valid version, does anyone know? Thanks, On Tue, 29 Jan 2019 at 11:37, M. Manna wrote: > Hello, > > I have recently upgraded to 2.12-2.1.0 from 2.11-1.1.0. Afte

Rolling Upgrade failed after bumping version to 2.1 from 1.1

2019-01-29 Thread M. Manna
Hello, I have recently upgraded to 2.12-2.1.0 from 2.11-1.1.0. After bumping inter.broker.protocol.version to 2.1 (and doing 2 bleed-and-restart from 1.1), my services are all failing to start. Slightly clueless at this stage regarding what to do other than reverting. I followed the steps in main

Kafka Version Detection for Rolling Upgrade

2019-01-28 Thread M. Manna
Hello, I am struggling a little bit to do the rolling upgrade. My confusion is mainly where the version numbers should be. I am verifying my steps using main site guidelines. Any help would be appreciated https://kafka.apache.org/documentation/#ecosystem I am upgrading from *2.11-1.1.0* to *2.12

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2019-01-25 Thread M. Manna
Hello, I am trying to revive this thread. I only got 1 binding vote so far. Please feel free to revisit and comment here. Thanks, On Thu, 25 Oct 2018 at 00:15, M. Manna wrote: > Hey IJ, > > Thanks for your interest in the KIP. > > My point was simply that the round-robin sho

Re: Kafka official docker image

2019-01-15 Thread M. Manna
There should be confluent enterprise image-it should work without control centre etc. and basic open source items should stay the same. Could you kindly check ? On Tue, 15 Jan 2019 at 23:06, Олег Иванов wrote: > Hi, > > Could you please create an official docker image of kafka? There are a lot

Re: [VOTE] KIP-379: Multiple Consumer Group Management

2019-01-14 Thread M. Manna
Hi, Thanks for this KIP. Could you kindly clarify why CSV format is useful, but not anything else? CSV format is ancient and the only reason it keep existing is various application is because legacy applications aren't moving away from using them. Would you would consider JSON or YAML? Also, if

Re: Windows Testing

2018-12-18 Thread M. Manna
There’s no specific test or setup for Windows. There are issues with file cleanup on windows, so your best bet is to run it on containers or Linux. Thanks, On Tue, 18 Dec 2018 at 17:06, Jacob Braaten wrote: > Hello, > > Quick question about your testing setup. I can't find where I read this > b

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-10-24 Thread M. Manna
the need for the key in > this case? The KIP simply states that the key is needed for metadata, but > doesn't give any more details. > > Ismael > > On Tue, Sep 4, 2018 at 3:39 AM M. Manna wrote: > > > Hello, > > > > I have made necessary changes as per the

Re: Java cluster vs Scala cluster

2018-10-19 Thread M. Manna
Not sure I got your question ? Kafka is written mainly in Scala with additional admin functionality and Client API available in Java. There are some subtle differences but they are not specific to Kafka? What is the context of your question? On Fri, 19 Oct 2018 at 21:32, wrote: > Hi, > what is

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-10-19 Thread M. Manna
Since this has gone quiet, could I prequest 1 more vote here - if anyone thinks it's worth doing? Thanks, On Wed, 3 Oct 2018 at 16:14, M. Manna wrote: > Thanks for reminding me about the "Binding" vote Bill. I remember some > people with non-binding vote, so jumped th

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-10-03 Thread M. Manna
s-Approvals. > > I haven't been tracking the vote results, but from what I can see in the > voting thread, this KIP still requires two more +1 binding votes. > > HTH, > BIll > > On Wed, Oct 3, 2018 at 8:58 AM M. Manna wrote: > > > Since this has been open for a while,

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-10-03 Thread M. Manna
e: > > +1 > > > > On Wed, Sep 5, 2018 at 2:39 AM Magesh Nandakumar > > wrote: > > > >> +1 ( non-binding) > >> > >> On Tue, Sep 4, 2018 at 3:39 AM M. Manna wrote: > >> > >>> Hello, > >>> > >>> I

Re: Help me to get Started !

2018-09-22 Thread M. Manna
8, 12:02 AM $uMe$h, <1cool.1...@gmail.com> wrote: > > > Thanks a lot ! > > > > I will start doing the same as suggested ! > > > > On Sat 22 Sep, 2018, 11:58 PM M. Manna, wrote: > > > >> You are on the same boat as I was a year ago. > >> > &

Re: Help me to get Started !

2018-09-22 Thread M. Manna
You are on the same boat as I was a year ago. Before you do anything, try to visit wiki of apache Kafka. Also, try to visit JIRA and see a list of all minor bugs being raised. These are not necessarily blockers, but useful to understand why something should change. >From there you should be able t

[VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-09-04 Thread M. Manna
Hello, I have made necessary changes as per the original discussion thread, and would like to put it for votes. Thank you very much for your suggestion and guidance so far. Regards,

Could not find or load main class kafka.Kafka (Eclipse Startup)

2018-09-03 Thread M. Manna
Hello, I completed set up according to cwiki instruction - https://cwiki.apache.org/confluence/display/KAFKA/Developer+Setup I have also built all the sources and jars using `gradlew jarAll` After that, I created a Scala application configuration in Eclipse to debug. I provided the sources to lo

Re: KAFKA-1194

2018-09-03 Thread M. Manna
Hi Stephan, https://jira.apache.org/jira/browse/KAFKA-7278 This might (according to Dong) be a better fix for the issue. Could you kindly apply to patch to your kafka (assuming that your version is reasonably close to the latest), and see if that helps? Regards, On Mon, 3 Sep 2018 at 02:27, Ism

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-09-02 Thread M. Manna
#x27;m a novice with Scala. Please let me know your thoughts, and I'll update the status accordingly (and start working on the JIRA once it's approved). Regards, On Fri, 31 Aug 2018, 10:22 M. Manna, wrote: > Yes I’m more than happy to change it to a more appropriate name. > >

Re: [jira] [Created] (KAFKA-7370) Enhance FileConfigProvider to read a directory

2018-08-31 Thread M. Manna
Do you want to raise a KIP and explain the motivation behind it ? Please ignore if you’re doing that already. Thanks , On Sat, 1 Sep 2018 at 00:15, Robert Yokota (JIRA) wrote: > Robert Yokota created KAFKA-7370: > > > Summary: Enhance FileConfi

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-31 Thread M. Manna
e compacted and you do not want > > to > > > > have partitioning based on that key. IMHO, it qualifies more as a > > header > > > > than a key. What do you think about building records with a specific > > > header > > > > and consumers to exe

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread M. Manna
Partitioner.java#L28 > > . > > Use your custom partitioner to be configured in your producer clients. > > > > Thanks, > > Harsha > > > > On Thu, Aug 30, 2018, at 1:45 AM, M. Manna wrote: > > > Hello, > > > > > > I opened a very simple KIP and there exists a JIRA for it. > > > > > > I would be grateful if any comments are available for action. > > > > > > Regards, > > >

Re: [DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread M. Manna
ote: > Hi there, > > I can't see this KIP on the KIP wiki, could you double check? > > Thanks > Eno > > On Thu, Aug 30, 2018 at 9:56 AM, M. Manna wrote: > > > Hello, > > > > I opened a very simple KIP and there exists a JIRA for it. > > >

[DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread M. Manna
Hello, I opened a very simple KIP and there exists a JIRA for it. I have already sent it to users' list - but the mail thread doesn't seem to get updated. I would be grateful if any comments are available for action. Regards,

[jira] [Created] (KAFKA-7358) Extended Partitioner to Support "Always Round Robin" Selection

2018-08-30 Thread M. Manna (JIRA)
M. Manna created KAFKA-7358: --- Summary: Extended Partitioner to Support "Always Round Robin" Selection Key: KAFKA-7358 URL: https://issues.apache.org/jira/browse/KAFKA-7358 Project: Kafka

Re: Kafka Producer Partition Key Selection

2018-08-29 Thread M. Manna
Why can't we override the DefaultPartitioner, and simply override paritition() method, such that it will redistribute to all partitions in round robin fashion. Round-Robin partitioner and StickyAssignor (consumer) should work nicely for any publish subscribe system. On Wed, 29 Aug 2018 at 09:39,

Re: Can't start kafka

2018-08-14 Thread M. Manna
You know people are still trying to find your error message, right :) ? On 14 August 2018 at 15:19, Mohamed Salah Baccouche wrote: > hello , i was trying to connect kafka and cassandra when i finally > succeeded kafka stopped and i got this error message that i sent you with > the email , and fr

Re: Running Kafka locally - no logs

2018-05-22 Thread M. Manna
I have managed to load the broker from within Eclipse Scala IDE. I only needed to put server.properties and -Dlog4j.configuration in program arguments area. How did you set up classpath? You need to set up classpath such that it can find all the jars necessary. And you shouldn’t have to remove any

Re: Making sure all of you know about Kafka Summit

2017-08-18 Thread M. Manna
I guess It's kinda late since I am already in transit for work. Is there any plan to do something in Europe e.g. London or some other place? On 18 Aug 2017 4:41 pm, "Gwen Shapira" wrote: > Hi, > > I figured everyone in this list kinda cares about Kafka, so just making > sure you all know. > > K

Re: Usage of SSL_ENDPOINT_IDENTIFICATION_ALGORITHM_CONFIG

2017-08-09 Thread M. Manna
Thanks got it :) On 10 Aug 2017 7:02 am, "Manikumar" wrote: > check here: > https://github.com/apache/kafka/blob/trunk/clients/src/ > main/java/org/apache/kafka/common/security/ssl/SslFactory.java#L84 > > On Thu, Aug 10, 2017 at 3:49 AM, M. Manna wrote: > > >

Usage of SSL_ENDPOINT_IDENTIFICATION_ALGORITHM_CONFIG

2017-08-09 Thread M. Manna
Hello, I have been trying to find the usage of this property within Kafka source. All I am trying to understand is how this is looked up for hostname verification. I used notepad++ to search for this and only link was in KafkaConfig.scala file - after that I cannot see this scala property being u

Re: Kafka issues during Developement

2017-07-17 Thread M. Manna
This is a know issue. You cannot delete shared (or opened files) on Windows, but UNIX/Linux is okay. Please read Kafka online documentation on WIndows usage. A relevant jira case is KAFKA-1194. On 17 July 2017 at 11:31, Dharma Raj wrote: > Hi, > > I am using kafka as the messaging queue for m

Re: Delete Kafka Topic After Enable Ranger Plugin

2017-07-14 Thread M. Manna
Hi, You got any log for this? Also, which platform are you running this on? KR, On Fri, 14 Jul 2017 at 11:26 pm, amazon wrote: > Hi: > > Recently I develop some applications about kafka under ranger. But > when I set enable ranger kafka plugin I can not delete kafka topic > completely eve

Re: Clarification on KafkaConsumer manual partition assignment

2017-07-13 Thread M. Manna
"A consumer doesn't need to be part of a consumer group" - where do you see this documented please ? On 13 Jul 2017 6:36 pm, "Paolo Patierno" wrote: Assigning partitions manually has no relation with consumer groups. I mean ... a consumer doesn't need to be part of a consumer group (so specifyin

[jira] [Created] (KAFKA-5583) Provide a "OS independent" file rename and delete mechanism

2017-07-11 Thread M. Manna (JIRA)
M. Manna created KAFKA-5583: --- Summary: Provide a "OS independent" file rename and delete mechanism Key: KAFKA-5583 URL: https://issues.apache.org/jira/browse/KAFKA-5583 Project: Kafka