pproach we have taken is to implement event sourcing using a database
and Kafka.
For instance: see
https://blog.eventuate.io/2016/10/06/eventuate-local-event-sourcing-and-cqrs-with-spring-boot-apache-kafka-and-mysql/
Chris
--
Signature
Michal Borowiecki <http://www.openbet.com/>
data from kafka via druid/tranquility
and they have clients of version 0.8.x implemented but my broker is running
0.10.x.
Also if such a table can be posted on kafka documentation page or github
page that would be great.
Thanks
Sachin
--
Signature
<http://www.openbet.com/>
://stackoverflow.com/a/44345374/7897191
Please let me know if you have a better design for this?
Cheers,
Michal
On 27/05/17 21:16, Jay Kreps wrote:
This is great!
-Jay
On Sat, May 27, 2017 at 12:47 PM, Michal Borowiecki
mailto:michal.borowie...@openbet.com>>
wrote:
Hi all,
am not sure whether this can be solved using Kafka.Any help is
appreciated
Regards,
Abhimanyu
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
E: mi
Did I miss something?
-Matthias
On 6/20/17 1:02 AM, Michal Borowiecki wrote:
I didn't know you could write to state stores from outside a
processor/transformer. Interesting to hear that it is working although
I'd be careful as KIP-67 warns it can introduce undefined behaviour:
http
2017 at 2:38 PM, Vahid S Hashemian <
vahidhashem...@us.ibm.com <mailto:vahidhashem...@us.ibm.com>> wrote:
Hi Michal,
Thanks a lot for your feedback.
Your statement about Heartbeat is fair and makes sense. I'll update
the
KIP accordingly.
--Vahid
From: Michal Borowi
l else fails you could
always consider producing to a topic rather than trying to forward directly,
then you don't have to touch the relatively delicate Processor semantics.
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 2
transactions
support it with only minor changes to the API (do not fail
automatically dangling transactions on Producer restart)? Flushing
is already there so that _should_ handle the pre-commit. Again,
maybe I'm missing something and for sure I am not familiar with
t or might not depend on wall clock time. Perhaps this is in
fact what you are proposing?
-Jay
On Fri, Jun 16, 2017 at 2:38 AM, Michal Borowiecki
mailto:michal.borowie...@openbet.com>>
wrote:
I wonder if it's a frequent enough use case that Kafka Streams
should consider
ct to be able to commit "flushed"/"pre-committed" data for such
transactions.
2. making sure that committing already committed transactions doesn't brake
anything
Or maybe there is some other way to integrate Kafka into such two phase
commit system that I'
o
Paolo Patierno
Senior Software Engineer (IoT) @ Red Hat
Microsoft MVP on Windows Embedded & IoT
Microsoft Azure Advisor
Twitter : @ppatierno<http://twitter.com/ppatierno>
Linkedin : paolopatierno<http://it.linkedin.com/in/paolopatierno>
Blog : DevExperience<http://paolopatier
gestions are welcome!
Thanks.
--Vahid
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
E: michal.borowie...@openbet.com
W:
njay wrote:
Can someone please share some thoughts whether we can do synchronous call
(request response) using kafka similar to JMS
Thanks
Sanjay
913-221-9164
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
For production
clusters, I'd recommend to always have 5 ZK nodes, but for Kafka, you
can scale well past that, or keep it small while you are starting out.
Thanks,
Tom Crayford
Heroku Kafka
On Sat, Jun 3, 2017 at 8:20 AM, Michal Borowiecki
mailto:michal.borowie...@openbet.com>>
eeper on the same server as Kafka vs having a separate zookeeper
cluster ?
Thanks,
Meghana
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
ins a quick example on "how to compute average". Hope
we can collect more example like this!
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Stream+Usage+Patterns
-Matthias
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer
tions for each topic - and
we're worried about how far this will scale.
Thank you
Mike G
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
E:
Hi Sini,
This is beyond the score of KIP-138 but
https://issues.apache.org/jira/browse/KAFKA-3514 exists to track such
improvements
Thanks,
Michal
On 17 May 2017 5:10 p.m., Peter Sinoros Szabo
wrote:
Hi,
I see, now its clear why the repeated punctuations use the same time value
in that
downsides to that?
Cheers,
Michał
On 09/05/17 09:17, Michal Borowiecki wrote:
Hi Matthias,
Yes, the ever growing stores were my concern too. That was the
intention behind my TODO note in the first reply just didn't want to
touch on this until I've dug deeper into it.
I understand
Michal,
that's an interesting idea. In an ideal world, Kafka Streams should have
an optimizer that is able to to this automatically under the hood. Too
bad we are not there yet.
@Garret: did you try this out?
This seems to be a question that might affect many users, and it might
we worth t
sting idea. In an ideal world, Kafka Streams should have
an optimizer that is able to to this automatically under the hood. Too
bad we are not there yet.
@Garret: did you try this out?
This seems to be a question that might affect many users, and it might
we worth to document it somewhere as a recomme
ffect many users, and it might
we worth to document it somewhere as a recommended pattern.
-Matthias
On 5/8/17 1:43 AM, Michal Borowiecki wrote:
Apologies,
In the code snippet of course only oneMinuteWindowed KTable will have a
Windowed key (KTable, Value>), all others would be just
KTabl
Apologies,
In the code snippet of course only oneMinuteWindowed KTable will have a
Windowed key (KTable, Value>), all others would be just
KTable, Value>.
Michał
On 07/05/17 16:09, Michal Borowiecki wrote:
Hi Garrett,
I've encountered a similar challenge in a project I'm
in addition
to. Does the high level api handle that construct and let me do that? For
a simple sum it would have to hold each of the latest values for say the 5
1 minute sum's in a given window, to perform the 5 minute sum. Reading the
docs which are awesome, I cannot determine if the KTa
loop time
and linger?
If a timeout would be localized only to a single batch send request for some
reason, does it affect the next batch (assuming this batch can go through
successfully)?
Many thanks,
Petr
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software E
not return any result.
-Matthias
On 4/30/17 7:23 AM, Michal Borowiecki wrote:
I have something working on the same principle (except not using
connect), that is, I put ids to filter on into a ktable and then (inner)
join a kstream with that ktable.
I don't believe the value can be null t
go to three.
2017-04-30 15:41 GMT+02:00 Michal Borowiecki
mailto:michal.borowie...@openbet.com>>:
Hi Jan,
Correct. As I said before it's not common or recommended practice
to run an even number, and I wouldn't recommend it myself. I hope
it didn't sound a
x27;m wondering:
1. How do we figure out the cause of the connect failures?
2. What's the controller anyway?
3. Are there some command-line diagnostic tools for inspecting the health of
the system?
Thanks for any help,
Chuck
--
Signature
<http://www.openbet.com/> Mich
ocess the messages.
Should I just cache all ids on all nodes (which may be a large amount),
or
is there a way to only cache the id on the same kafka streams node which
will receive data for that id?
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Softwar
tml>
cheers
jan
On 30/04/2017, Michal Borowiecki wrote:
Svante, I don't share your opinion.
Having an even number of zookeepers is not a problem in itself, it
simply means you don't get any better resilience than if you had one
fewer instance.
Yes, it's not common or recomm
s alive for
[mytopicOLD,18]. Select 2 from ISR 2 to be the leader.
(kafka.controller.OfflinePartitionLeaderSelector)*
Typical broker config attached.. Please do share some valid inputs...
Abhi
!wq
*-- *
If you can't succeed, call it version 1.0
--
If you can't succeed, call it version 1.0
--
Signature
<
ail this way...
--
James Brown
Engineer
--
James Brown
Engineer
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
E: michal.borowie...@openb
://www.confluent.io/blog>
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
E: michal.borowie...@openbet.com
W: www.openbet
ger | Confluent
650.450.2760 | @gwenshap
Follow us: Twitter | blog
--
Signature
<http://www.openbet.com/> Michal Borowiecki
Senior Software Engineer L4
T: +44 208 742 1600
+44 203 249 8448
E: michal.borowie...@
34 matches
Mail list logo
