It looks like the SQL client does not configure enable checkpoint while
submitting the streaming job query. Did anyone notice this behavior? FYI, I am
using 1.6.x branch.
RegardsVijay
configured with one of these HCFS as state backend
store.
Hope this helps.
RegardsVijay
On Wednesday, August 23, 2017 11:06 AM, Ted Yu wrote:
Would HDFS-6584 help with your use case ?
On Wed, Aug 23, 2017 at 11:00 AM, Vijay Srinivasaraghavan <
vijikar...@yahoo.com.invalid>
Hello,
Is it possible for a Flink cluster to use multiple HDFS repository (HDFS-1 for
managing Flink state backend, HDFS-2 for syncing results from user job)?
The scenario can be viewed in the context of running some jobs that are meant
to push the results to an archive repository (cold storage)
Hello,
I would like to know if we have any latency requirements for choosing
appropriate state backend?
For example, if an HCFS implementation is used as Flink state backend (instead
of stock HDFS), are there any implications that one needs to know with respect
to the performance?
- Frequency o
Hello,
I am seeing below error when I try to use ElasticsearchSink. It complains about
serialization and looks like it is leading to "IndexRequestBuilder"
implementation. I have tried the suggestion as mentioned in
http://stackoverflow.com/questions/33246864/elasticsearch-sink-seralizability
(c
FS) in terms of
the scenarios/usecase that needs to be tested? Is there any general guidance on
this?---
RegardsVijay
On Wednesday, February 15, 2017 11:28 AM, Vijay Srinivasaraghavan
wrote:
Hello,
Regarding the Filesystem abstraction support, we are planning to use a
distributed file s
Hello,
Regarding the Filesystem abstraction support, we are planning to use a
distributed file system which complies with Hadoop Compatible File System
(HCFS) standard in place of standard HDFS.
According to the documentation
(https://ci.apache.org/projects/flink/flink-docs-release-1.3/internals
6:28 PM, Vinay Patil <[hidden email]> wrote:
Hi Vijay,
That's a good news for me. Eagerly waiting for this change so that I can
integrate and test it before going live.
Regards,Vinay Patil
On Tue, Aug 30, 2016 at 4:06 PM, Vijay Srinivasaraghavan [via Apache Flink User
Mailing List ar
Hi Stephan,
The dev work is almost complete except the Yarn mode deployment stuff that
needs to be patched. We are expecting to send a PR in a week or two.
RegardsVijay
On Tuesday, August 30, 2016 12:39 AM, Stephan Ewen wrote:
Let me loop in Vijay, I think he is the one working on this
Hi Trevor,
I am seeing similar issue for a JIRA that I am working now. I am yet to trace
the Yarn Web UI code to find out how the "tracking URL" is being handled. To
ublock, you could use the tracking URL (Flink UI URL) directly to access Flink
Web UI to by-pass Yarn UI redirection. You can find
. Does this work?
– Ufuk
On Thu, Mar 10, 2016 at 1:35 AM, Vijay Srinivasaraghavan
wrote:
> Hi Ufuk,
>
> I have increased the sampling size to 1000 and decreased the refresh
> interval by half. In my Kafka topic I have pumped million messages which is
> read by KafkaConsumer pipe
am testing the backpressure scenario properly or not?
RegardsVijay
On Monday, March 7, 2016 3:19 PM, Ufuk Celebi wrote:
Hey Vijay!
On Mon, Mar 7, 2016 at 8:42 PM, Vijay Srinivasaraghavan
wrote:
> 3) How can I simulate and verify backpressure? I have introduced some delay
> (Thread S
Hello,
I am writing a small application to understand how checkpoint and recovery
works in Flink.
Here is my setup.
Flink 3 node cluster (1 JM, 2 TM) built from latest github codebaseHDP 2.4
deployed with just HDFS for checkpoint and sinkKafka 0.9x
The sample code pulls Kafka topic (1 partition)
13 matches
Mail list logo
