Hi,
There are number of messages floating on the internet suggesting that Kafka
cannot persist messages infinitely ?
Primarily that Kafka partitions are pinned to a node and they can’t
outgrow the storage capacity of a node..
Can someone help me understand this limitation and how it can be overco
; such persistence I think you should use cassandra /mongo db type of no sql
> db.
>
> thanks
> Ashutosh
>
> On Wed, Jun 1, 2016 at 9:06 AM, VG wrote:
>
> > Hi,
> >
> > There are number of messages floating on the internet suggesting that
> Kafka
> > cannot
ing per node log, there is no reason why you
> can not store it for ever.
> On 1 Jun 2016 9:07 a.m., "VG" wrote:
>
> > Hi,
> >
> > There are number of messages floating on the internet suggesting that
> Kafka
> > cannot persist messages infinitely ?
(SingleThreadEventExecutor.java:111)
... 1 more
16/06/15 19:47:07 INFO RetryingBlockFetcher: Retrying fetch (2/3) for 1
outstanding blocks after 5000 ms
Appreciate some help.
Regard
VG
Apologies. Sent to a wrong mailing group.
On Wed, Jun 15, 2016 at 7:48 PM, VG wrote:
> I have a very simple driver which loads a textFile and filters a
> sub-string from each line in the textfile.
> When the collect action is executed , I am getting an exception. (The
> file i
