2.3.1 - Both broker & clients upgrade
On Sun, Apr 5, 2020 at 8:52 PM Ismael Juma wrote:
> Hi Nitay,
>
> What version were you running before the upgrade? And was this a broker
> upgrade? I would suggest filing a JIRA ticket, including as much
> information as possible and ideally consumer and br
Opened a Jira ticket: https://issues.apache.org/jira/browse/KAFKA-9824
On Mon, Apr 6, 2020 at 10:43 AM Nitay Kufert wrote:
> 2.3.1 - Both broker & clients upgrade
>
> On Sun, Apr 5, 2020 at 8:52 PM Ismael Juma wrote:
>
>> Hi Nitay,
>>
>> What version were you running before the upgrade? And was
Hello,
I'm here to get some advice regarding Kafka topics naming.
If I name my topic "users" and I publish Avro events with a schema registry
using a given compatibility mode.
One day, due to business reasons, I have to break my schema, what would you
do?
add a new topic (let's call it "users-v1
Hello All,
I need below information about Apache Kafka tool for data integration and
ETL needs:
Development effort:
The development effort , time and complexity is more in general?
Maintainability:
Is it less maintainable?
Error Handling:
Only possesses a single log file? or possesses a lo
If the schema is no longer compatible I think it makes sense to create a
new topic.
Offsets wise you can just have the consumer finish consuming from the old
topic/schema (i.e. migrate all producers to use the new schema format
first) and then migrate consumers to use the new schema format (and th
We are running Kafka on AWS EC2 instances (m5.2xlarge) with mounted EBS st1
volume (one on each machine).
Occasionally, we have noticed that the write ops/second goes through the
roof and we get throttled by AWS while the data throughput wouldn't have
changed much. As far as our observation goes, i
Are you using log compaction?
On Tue, Apr 7, 2020 at 6:29 PM Soumyajit Sahu
wrote:
> We are running Kafka on AWS EC2 instances (m5.2xlarge) with mounted EBS st1
> volume (one on each machine).
> Occasionally, we have noticed that the write ops/second goes through the
> roof and we get throttled
We too have a similar setup but we never observed any such spikes.
Are you sure your disk IOPS is good enough? Check if that is throttling.
After a broker restarts, there might be more traffic as well because of
followers trying to catch up with the leader.
-Suman
On Tue, Apr 7, 2020 at 11:59 A
