It is a very useful optimization in large scale development. In blink we
use a thread pool to launch container, and a flink cluster with more than
5000 Yarn containers could work well. Hope Xintong Song could contribute it
to flink soon.
Xintong Song 于2019年7月10日周三 下午2:20写道：
> Thanks for the kind
Thanks for the kindly offer, Qi.
I think this work should not take much time, so I can take care of it. It's
just the community is currently under feature freeze for release 1.9, so we
need to wait until the release code branch being cut.
Thank you~
Xintong Song
On Wed, Jul 10, 2019 at 1:55
Thanks Xintong and Haibo, I’ve found the fix in the blink branch.
We’re also glad to help contribute this patch to community version, in case you
don’t have time.
Regards,
Qi
> On Jul 10, 2019, at 11:51 AM, Haibo Sun wrote:
>
> Hi, Qi
>
> Sorry, by talking to Xintong Song offline, I made su
Hi Timo,
Thanks for the clarification.
It reassuring to hear that my code does the right thing.
I'll just ignore these messages for now.
Niels
On Mon, 8 Jul 2019, 15:09 Timo Walther, wrote:
> Hi Niels,
>
> the type handling evolved during the years and is a bit messed up
> through the differe
After deploying Flink 1.8.0 with docker, logger page for jobManager and
taskManager doesn't work.
I try to run flink with background mode instead of
start-foreground(docker-entrypoint.sh) , but the container can't be started.
Anyone can help?
I'm trying to catch exception throws by the kafka source, and I've got the
answer that exception in source or sink cannot be caught.
Thanks
Haibo Sun 于2019年7月8日周一 下午3:54写道：
> Hi, Zhechao
>
> Usually, if you can, share your full exception stack and where you are
> trying to capture exceptions
Yes, Mans. You can use both processing-time and event-time timers if you set
the time characteristic to event-time. They'll be triggered by their own time
semantics, separately. (actually there’s no watermark for processing time)
Cheers,
Xingcan
> On Jul 9, 2019, at 11:40 AM, M Singh wrote:
>
Thanks Bekir Oguz and Chesnay!
Sorry for that, I forgot push the tag, I've pushed the tag to the repo
now. https://github.com/apache/flink/tree/release-1.8.1
Thanks again, and I'm very sorry for my negligence has caused confusion in
your use.
Thanks,
Jincheng
Bekir Oguz 于2019年7月10日周三 上午12:50写道
Ok so when the sink fails on the 5th record then there's no chance that the
checkpoint can be at 6th event right?
On Tue, 9 Jul 2019 at 13:51, Konstantin Knauf
wrote:
> Hi John,
>
> this depends on your checkpoint interval. When enabled checkpoints are
> triggered periodically [1].
>
> Cheers,
>
Hi John,
this depends on your checkpoint interval. When enabled checkpoints are
triggered periodically [1].
Cheers,
Konstantin
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/stream/state/checkpointing.html
On Tue, Jul 9, 2019 at 7:30 PM John Smith wrote:
> Ok so just t
Ok so just to be clear. Let's say we started at day 0...
1- Producer inserted 10 records into Kafka.
2- Kafka Flink Consumer consumed 5 records.
3- Some transformations applied to those records.
4- 4 records sinked, 1 failed.
5- Flink Job restarts because of above failure.
When does the checkpoin
Thanks Yun for your answers.
Does this mean that we can use processing and event timers (in processors or
triggers) regardless of the time characteristic ? Also, is possible to use
both together and will they both fire at the appropriate watermarks for
processing and event times ?
Mans
O
Hi Felipe,
Yes, we are short of such tutorials. Probably you can take a look at the
code of Flink-9713[1](checking the changelog in IDE is more convenient).
The code shows how to create a logical node and how to use a rule to
convert it into a FlinkLogicalRel and then convert into a DataStream
Rel
Hi Hequn,
it has been very hard to find even a very small tutorial of how to create
my on rule in Calcite+Flink. What I did was copy a Calcite rule to my
project and try to understand it. I am working with the FilterJoinRule [1]
which is one rule the Flink is modifying it. In the end I want to cre
Hi Venn,
I think `AsyncFunction#asyncInvoke` should be used to submit asynchronous
tasks for the input records instead of executing the tasks directly. However,
it seems that in the code fragment, the query is executed directly in the
asyncInvoke method.
I think you may also find mor
Hi Felipe,
> what is the relation of RelFactories [1] when I use it to create the
INSTANCE of my rule?
The `RelFactories.LOGICAL_BUILDER` can be used during the rule
transformation, i.e., the `RelFactories.LOGICAL_BUILDER` is a
`RelBuilderFactory` which contains a `create` method can be used to cr
Hi Venn,
I think `AsyncFunction#asyncInvoke` should be used to submit asynchronous
tasks for the input records instead of executing the tasks directly. However,
it seems that in the code fragment, the query is executed directly in the
asyncInvoke method.
I think you may also find more
Hi Flink experts,
I’m working flink async io program for stream join outer
database(mysql)，but found sync，please give some advice, or provide some
async demo. thanks
asyncInvoke method are as follow:
@Override
public void asyncInvoke(AsyncUser asyncUser, ResultFuture
resultFutur
Hi Hequn,
what is the relation of RelFactories [1] when I use it to create the
INSTANCE of my rule? For example:
public static final MyFilterRule INSTANCE = new MyFilterRule(Filter.class,
RelFactories.LOGICAL_BUILDER);
then I create a CalciteCOnfigBuilder using "new
CalciteConfigBuilder().addLog
19 matches
Mail list logo
