Hi Talat,
Since in the job.properties the task.checkpoint.factory is set to
FileSystemCheckpointManagerFactory
and not org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory.
That is why its writing checkpoints to the filesystem (with its. location
controlled by task.checkpoint.path).
ht
Hi Pedro,
Thanks for reaching out.
A Samza app using KVStores can expect read-your-writes guarantee because
a. in the failure free case, rocksdb provides that, and b. in case of
failures, samza resumes input (and state) consumption
from the last complete checkpoint (at which everything written to
I'm trying to put together a Samza subsystem that is able to auto-size a
Samza job
by looking at metrics. Here are some initial thoughts:
https://docs.google.com/document/d/1gqGuc2PGBvjbpE2wP-DbOTujSuDQjPwpYN9guWZde00/edit?usp=sharing
It'd be great to get your feedback.
--
thanks
rayman
e, copying, distribution, or use of the
> contents of this message is prohibited. The information contained in this
> message is intended only for the personal and confidential use of the
> recipient(s) named above. If you have received this message in error,
> please notify the sender i
he
> contents of this message is prohibited. The information contained in this
> message is intended only for the personal and confidential use of the
> recipient(s) named above. If you have received this message in error,
> please notify the sender immediately and delete the origi
to stall, and no more output is produced.
>
> Also, I couldn't see you diagram (it's possible my company's email filters
> attachments); can I see that on the web anywhere?
>
> Cheers,
> Malcolm
>
> On Wed, May 22, 2019 at 4:30 PM rayman preet wrote:
>
> >
Hi Malcolm,
This figure (attached) gives an overview of the flow. Is
this something you were looking for?
Also, by "don't fully start up" do you mean that
applications are missing some containers (but the ApplicationMaster is
running)?
Or the application is missing entirely.
--
thanks
rayman
[im
+1 (Non-binding)
--
thanks
rayman
On Wed, Mar 13, 2019 at 7:17 PM Daniel Chen wrote:
> Hi,
>
> I performed the following verifications:
>
> 1. ./bin/check-all.sh succeeded.
>
> 2. Verified both ./bin/integration-tests.sh yarn-integration-tests and
> ./bin/integration-tests.sh standalone-integra
Hi all,
We have added a number of major features and changes to master since 0.14.1
that warrants
a major 1.0 release.
Within LinkedIn, some of these features have already been tested as part of
our test suites. We plan to continue our testing in coming weeks to
validate the stability prio
