Re: Batch size, linger-ms not working as intended

2020-05-18 Thread Christopher Smith
Honestly, I'm not sure why you'd want to have it send only one message at a time, but yes, this does not guarantee that it will not batch. It only guarantees that it won't wait before sending, which is not the same thing. --Chris On Mon, May 18, 2020 at 4:03 PM Bibek Shrestha wrote: > Hi All, >

Batch size, linger-ms not working as intended

2020-05-18 Thread Bibek Shrestha
Hi All, I am working on a research work where I have to tweak a few things about how Kafka works. Goal: Suppose I am to send messages to the broker. Let us consider that each alphabet is a single message that needs to be sent (A-Z). My goal is to be able to send the message in such a way that I c

Re: ACLs - How To Allow Anyone To Access of A Topic

2020-05-18 Thread Jun Wang
I am testing in a dev. environment, maybe it does not make sense in production. See my detail explanation below and rephrase of the question: 1. I have mixed authenticated and unauthenticated user in the system. For example: listeners=PLAINTEXT://localhost:9092,SASL_PLAINTEXT://localhost:9093 U

Re: ACLs - How To Allow Anyone To Access of A Topic

2020-05-18 Thread Andrew Otto
If I understand correctly, if your client authenticates, there must be an ACL for that principal, otherwise it will fail authorization. If you are going to allow everything anyway, perhaps you don't need to authenticate?

ACLs - How To Allow Anyone To Access of A Topic

2020-05-18 Thread Jun Wang
Hi I would like to allow anyone to access the a topic even for authenticated user, I assume following ACLs should be sufficient. Current ACLs for resource `ResourcePattern(resourceType=TOPIC, name=test3, patternType=LITERAL)`: (principal=User:ANONYMOUS, host=*, operation=ALL, permissionType=ALL

users@kafka.apache.org

2020-05-18 Thread 18624049226
Hi community, in the https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/ Here it says: This can also be seen when using JSON with schema enabled, and the|amount|value is a Base64-encoded bytes string: If you get the corresponding Base64 encoded string, how can you

Re: MM2 Message Handlers

2020-05-18 Thread Jamie
Hi Ryanne, Great, thanks  Jamie Sent from AOL Mobile Mail Get the new AOL app: mail.mobile.aol.com On Monday, 18 May 2020, Ryanne Dolan  wrote: Jamie, MM2 uses Connect, so you can use Connect's SMTs for the same effect. Ryanne On Mon, May 18, 2020, 6:17 AM Jamie wrote: > Hi All, > Does MM2 c

Exception in SFTP CSV SOURCE

2020-05-18 Thread vishnu murali
Hi Guys By Trying SFTP CSV SOURCE i am getting this exception by using this configuration. what is the issue and how to resolve it? can anyone know? *Config:* { "name": "CsvSFTP1", "config": { "tasks.max": "1", "connector.class": "io.confluent.connect.sftp.SftpCsvSource

SFTP Connector

2020-05-18 Thread vishnu murali
Hey Guys, Now i am trying to implement SFTP connector by using this configurations. i am using windows system. so i am having doubts like how to set a path? i tried to set like this in *config *as well as */mnt/c/users/vmuralidharan* but it doesn't work. so what i need to do ? { "name":

Re: MM2 Message Handlers

2020-05-18 Thread Ryanne Dolan
Jamie, MM2 uses Connect, so you can use Connect's SMTs for the same effect. Ryanne On Mon, May 18, 2020, 6:17 AM Jamie wrote: > Hi All, > Does MM2 currently support message handlers, the same way MM1 did? If not, > are there any plans to support this in future? > Many Thanks, > Jamie

MM2 Message Handlers

2020-05-18 Thread Jamie
Hi All, Does MM2 currently support message handlers, the same way MM1 did? If not, are there any plans to support this in future? Many Thanks,  Jamie

Re: Kafka upgrade from 0.10 to 2.3.x

2020-05-18 Thread Xiangyuan LI
hi praveen: we had done upgrade from 0.10.0.1 to 2.3.0 lasy year, it's feasible to do a roll upgrade, just follow official upgrade document. although we have met some serious problem during the process(it's such a big change that all clients and related packages such as spring,springboot should

Re: Kafka upgrade from 0.10 to 2.3.x

2020-05-18 Thread Praveen
Thanks guys. We went with rolling upgrade since we couldn't redo the upgrade test on our test and staging envs. They were already upgraded in rolling fashion and we didn't want to spend cycles redoing the test for downtime upgrade again. If this is possible, it would have been nice to have had the

swagger/openapi spec for Kafka-Connect REST API?

2020-05-18 Thread Aki Yoshida
I am looking for the openapi spec for Kafka-Connect API but I couldn't find one. If it is available somewhere, could someone tell me where I can find it? regards, aki