Kafka Connect - REST API security

2022-05-13 Thread Vignesh
below. https://github.com/strimzi/strimzi-kafka-operator/issues/3229 please advise. Thanks, Vignesh

Re: Internal Connect REST endpoints are insecure

2021-09-23 Thread Vignesh
I worked on this space.. But I didn't take *https options within kafka connect instead I deployed kafka connect in the kubernetes cluster so I leveraged Ingress exposed https to allow clients access to my kafka connect rest api. Thanks, Vignesh On Fri, Sep 17, 2021 at 10:31 AM Kuchansky, V

Kafka Connect REST HTTPS

2020-08-05 Thread Vignesh
onnect.log file. Please advise. Thanks, Vignesh

Kafka Connect - REST API https

2020-08-01 Thread Vignesh
s on what i'm missing here?? Thanks !!! - Vignesh

Re: Kafka Source Connector to Event Streams

2020-02-04 Thread Vignesh
Schofield > > On 04/02/2020, 18:24, "Vignesh" wrote: > > Hi, > > I doing a proof of concept to read messages from IBM MQ queue in > on-perm > and write it to Event Stream topic in bluemix. > > I few questions, > To run Kafka connect

Kafka Source Connector to Event Streams

2020-02-04 Thread Vignesh
Hi, I doing a proof of concept to read messages from IBM MQ queue in on-perm and write it to Event Stream topic in bluemix. I few questions, To run Kafka connect , do i need a Kafka cluster or an instance running ? I downloaded Kafka binaries and extracted in a linux box and following jar is bui

upgrading kafka & zookeeper

2019-08-05 Thread Vignesh
his affect if it is going to install in a new directory with new server.properties ? How can i merge server.properties & do the upgrade ? please share if you have documents or steps.. Thanks, Vignesh

Topic - "Summed Recent offsets" property question

2018-10-04 Thread Vignesh
oups.sh --zookeeper hostname:port --describe --group sub1* *Note: This will only show information about consumers that use ZooKeeper (not those using the Java consumer API).* *Error: The consumer group 'sub1' does not exist. * Thanks, Vignesh

Re: Kafka Broker down - no space left on device

2018-06-28 Thread Vignesh
data folder, it will start catching up with replica leaders and > eventually join in-sync replicas. The catchup traffic impact the overall > cluster perf based on the retention time. Since you already reduced > retention to 1hour you should be good. > > Thanks > Zakee > >

Kafka Broker down - no space left on device

2018-06-28 Thread Vignesh
Hello kafka users, How to recover a kafka broker from disk full ? I updated the log retention period to 1 hour from 7 days.. but this would take effect only when broker is started. Any ways other than increasing the disk space? Thanks, Vignesh

Re: Kafka & ZooKeeper IDs

2018-03-27 Thread Vignesh
Hi Chritophe, Thank you...This helps!! It is User IDs. I untarred and set appropriate permissions. - Vignesh On Mon, Mar 26, 2018 at 5:32 PM, Christophe Schmitz < christo...@instaclustr.com> wrote: > Hi Vignesh > > I am not sure what you mean by UNIX IDs is. Do you mean User

Re: Kafka & ZooKeeper IDs

2018-03-26 Thread Vignesh
Hi Christophe, No, not the PIDs... UNIX IDs. Are they(kafka & zookeeper) suppose to run under root ? or can i define my own Ids? Thanks, Vignesh On Mon, Mar 26, 2018 at 4:09 PM, Christophe Schmitz < christo...@instaclustr.com> wrote: > Hi Vignesh, > > Are you talking about

Re: Kafka & ZooKeeper IDs

2018-03-26 Thread Vignesh
> > broker.id=1 > > broker.id=2 > > > > Thanks > > Uttam > > > > -Original Message- > From: Vignesh [mailto:davidviki...@gmail.com] > Sent: Monday, March 26, 2018 10:31 AM > To: users@kafka.apache.org > Subject: Kafka & ZooKeeper IDs > &

Kafka & ZooKeeper IDs

2018-03-26 Thread Vignesh
ndatory IDs it should be running under? Like "mqm" for IBM MQ. Thanks, Vignesh

Re: Debugging invalid_request response from a .10.2 server for list offset api using librdkafka client

2017-09-27 Thread Vignesh
ListOffset) > > -hans > > /** > * Hans Jespersen, Principal Systems Engineer, Confluent Inc. > * h...@confluent.io (650)924-2670 > */ > > On Wed, Sep 27, 2017 at 10:20 AM, Vignesh wrote: > > > Correction in above mail, we get

Re: Debugging invalid_request response from a .10.2 server for list offset api using librdkafka client

2017-09-27 Thread Vignesh
get invalid_request? Thanks, Vignesh. On Wed, Sep 27, 2017 at 9:51 AM, Vignesh wrote: > Hi, > > We are using LibrdKafka library version .11.0 and calling List Offset API > with a timestamp on a 0.10.2 kafka server installed in a windows machine. > > This request returns

Debugging invalid_request response from a .10.2 server for list offset api using librdkafka client

2017-09-27 Thread Vignesh
able to use the library successfully. Are there any settings on this specific server that is causing this error? Which logs can we enable and look at to get additional details about what is wrong with the request? Thanks, Vignesh.

Re: In which scenarios would "INVALID_REQUEST" be returned for "Offset Request"

2017-09-26 Thread Vignesh
We see even when we use https://github.com/edenhill/librdkafka nuget version .11.0, https://www.nuget.org/packages/librdkafka.redist/ -Vignesh. On Tue, Sep 26, 2017 at 11:03 AM, Vignesh wrote: > I am just sending the request directly using my own client, Protocol api > version I used

Re: In which scenarios would "INVALID_REQUEST" be returned for "Offset Request"

2017-09-26 Thread Vignesh
o, is this error level enabled by default? If not, How can I enable it? Thanks, Vignesh. On Sun, Sep 24, 2017 at 12:52 PM, James Cheng wrote: > Your client library might be sending a message that is too old or too new > for your broker to understand. > > What version is your Kafka cl

In which scenarios would "INVALID_REQUEST" be returned for "Offset Request"

2017-09-22 Thread Vignesh
; This most likely occurs because of a request being malformed by the client library or the message was sent to an incompatible broker. See the broker logs for more details. " Thanks, Vignesh.

Offsets across brokers

2017-08-28 Thread Vignesh
Hi, If a topic partition is replicated and leader switches from broker 1 to broker 2 , are the offsets for messages in broker 2 same as broker1 ? If not, how can applications that store offsets outside of Kafka handle the difference? Thanks, Vignesh.

Re: Does offsetsForTimes use createtime of logsegment file?

2017-01-19 Thread Vignesh
n Fri, Jan 6, 2017 at 1:26 PM, Ewen Cheslack-Postava wrote: > It would return the earlier one, offset 0. > > -Ewen > > On Thu, Jan 5, 2017 at 10:15 PM, Vignesh wrote: > > > Thanks. I didn't realize ListOffsetRequestV1 is only available 0.10.1 > > (which has KIP-33

Re: Does offsetsForTimes use createtime of logsegment file?

2017-01-05 Thread Vignesh
vided timestamp? For example, in below scenario Message1, Timestamp = T1, Offset = 0 Message2, Timestamp = T0 (or T2), Offset = 1 Message3, Timestamp = T1, Offset = 2 Would offsetForTimestamp(T1) return offset for earliest message with timestamp T1 (i.e. Offset 0 in above example) ? -Vignesh. On Thu

Does offsetsForTimes use createtime of logsegment file?

2017-01-05 Thread Vignesh
0.10.0 and 0.10.1 ? Thanks, Vignesh.