>>
>>>> As far as I know, it depends on whether you are using spark streaming
>>>> or structured streaming.
>>>> In spark streaming you can write your own code to checkpoint.
>>>> But in case of structured streaming it should be file loca
ark streaming or
>>> structured streaming.
>>> In spark streaming you can write your own code to checkpoint.
>>> But in case of structured streaming it should be file location.
>>> But main question in why do you want to checkpoint in
>>> Nosql, as it
nt.
>> But in case of structured streaming it should be file location.
>> But main question in why do you want to checkpoint in
>> Nosql, as it's eventual consistence.
>>
>>
>> Regards
>> Amit
>>
>> On Sunday, September 27, 2020, Debabrata Gh
2020, Debabrata Ghosh
> wrote:
>
>> Hi,
>> I had a query around Spark checkpoints - Can I store the checkpoints
>> in NoSQL or Kafka instead of Filesystem ?
>>
>> Regards,
>>
>> Debu
>>
>
x27;s eventual consistence.
Regards
Amit
On Sunday, September 27, 2020, Debabrata Ghosh
wrote:
> Hi,
> I had a query around Spark checkpoints - Can I store the checkpoints
> in NoSQL or Kafka instead of Filesystem ?
>
> Regards,
>
> Debu
>
Hi,
I had a query around Spark checkpoints - Can I store the checkpoints in
NoSQL or Kafka instead of Filesystem ?
Regards,
Debu
