Hi Alex,
Which Flink version are you using?
AFAIK, since Flink 1.8+, the config option: "-yn" for Flink on YARN job
cluster mode does not take effect(always 1 and would be overridden).
So, the config option "-ys" and "-p" will decide the number of TM.
The first example: -p(20)/-ys(3) should be
My sql is regular insert like “insert into sink_table select c1,c2,c3 from
source_table”,
I want to know which case it will judge to append only? Does it has doc for
this?
Many thanks!
> 在 2019年11月14日，上午10:05，张万新 写道：
>
> Yes it's related to your sql, flink checks the plan of your sql to
Hi all,
Could you list details how Flink job on Yarn resources managed ?
I used command “-p 20 -yn 5 -ys 3 -yjm 2048m -ytm 2048m” to run flink job. I
got
containers vcores
8 22
Task Managers 7 Total Task Slots 21
I used command “-p 20 -yn 7 -ys 4 -yjm 2048m -ytm 2048m” to
Hi Vasily,
Currently, Flink did not do the coordination between a general stream and
broadcast stream, they are both streams. Your scene of using the broadcast
state is a special one. In a more general scene, the states need to be
broadcasted is an unbounded stream, the state events may be broadca
Hi all.
In our task we have two Kafka topics:
- one with fact stream (web traffic)
- one with dimension
We would like to put dimension data into broadcast state and lookup on int
with facts. But we see that not all dimension records are put into state
before first fact record is processed, so loo
It is because MiniCluster start a SystemResourcesCounter for gathering
metrics but no
logic for shutdown. Thus on cluster exist the thread leak.
Best,
tison.
tison 于2019年11月14日周四 上午10:21写道：
> We found this issue previous.
>
> In our case where leak thread comes from is tracked as
> https://iss
We found this issue previous.
In our case where leak thread comes from is tracked as
https://issues.apache.org/jira/browse/FLINK-14565
Best,
tison.
vino yang 于2019年11月14日周四 上午10:15写道：
> Hi Theo,
>
> If you think there is a thread leakage problem. You can create a JIRA
> issue and write a deta
Hi Theo,
If you think there is a thread leakage problem. You can create a JIRA issue
and write a detailed description.
Ping @Gary Yao and @Zhu Zhu to
help to locate and analyze this problem?
Best,
Vino
Theo Diefenthal 于2019年11月14日周四 上午3:16写道：
> I included a Solr End2End test in my project,
Yes it's related to your sql, flink checks the plan of your sql to judge
whether your job is append only or has updates. If your job is append only,
that means no result need to be updated.
If you still have problems, please post your sql and complete error message
to help people understand your u
I included a Solr End2End test in my project, inheriting from Junit 4
SolrCloudTestCase.
The solr-test-framework for junit 4 makes use of
com.carrotsearch.randomizedtesting which automatically tests for thread
leakages on test end. In my other projects, that tool doesn't produce any
problems.
Respected Sir,
This is my code of flink gelly:
for(Vertex vertex : node_set) {
System.out.println(vertex);
graph_copy.removeVertex( vertex);
temp.add(vertex);
}
For some reason .removeVertex is not working even on giving correct parameters.
Please help. Given a list of edges, remove vert
Respected Sir,
This is my code of flink gelly:
for(Vertex vertex : node_set) {
System.out.println(vertex);
graph_copy.removeVertex( vertex);
temp.add(vertex);
}
For some reason .removeVertex is not working even on giving correct parameters.
Please help. Given a list of edges, remove vert
Hi
When I use flink-jdbc JDBCUpsertTableSink for sink to mysql, the isAppendOnly
is modified to ture, and keyFields is modified to null by StreamExecSink, but i
want to upsert,
Does this related to sql?
the stack as follows:
at sink.JDBCUpsertTableSink.setIsAppendOnly(JDBCUpsertTableSink.java:1
13 matches
Mail list logo
