Congrats! Thank you all for making this release happen.
Best,
tison.
rui fan <1996fan...@gmail.com> 于2022年6月5日周日 17:19写道：
> Thanks Yang for driving the release, and thanks to
> all contributors for making this release happen!
>
> Best wishes
> Rui Fan
>
> On Sun,
Please send email with any content to -subscr...@flink.apache.org
for subscription.
For example, mailto:user-zh-subscr...@flink.apache.org to subscribe
user...@flink.apache.org
Best,
tison.
葛春法-18667112979 于2020年10月8日周四 下午8:45写道：
> I want to subscribe flink mail.
Thanks for your explanation. It would be fine if only checking leadership &
actually write information is atomic.
Best,
tison.
Yang Wang 于2020年9月30日周三 下午3:57写道：
> Thanks till and tison for your comments.
>
> @Till Rohrmann
> 1. I am afraid we could not do this if we are goin
re consistency for extension.
Best,
tison.
[1]
https://lists.apache.org/x/thread.html/594b66ecb1d60b560a5c4c08ed1b2a67bc29143cb4e8d368da8c39b2@%3Cuser.zookeeper.apache.org%3E
Till Rohrmann 于2020年9月29日周二 下午9:25写道：
> For 1. I was wondering whether we can't write the leader connection
&
Could you try to download binary dist from flink download page and
re-execute the job? It seems like something wrong with flink-dist.jar.
BTW, please post user question on only user mailing list(not dev).
Best,
tison.
Guowei Ma 于2020年5月25日周一 上午10:49写道：
> Hi
> 1. You could check wheth
To be precise, the cancel command would succeed on cluster side but the
response *might* lost so that client throws with TimeoutException. If it is
the case, this is the root which will be fixed in 1.10.1.
Best,
tison.
tison 于2020年4月23日周四 上午1:20写道：
> 'flink cancel' broken becau
'flink cancel' broken because of
https://issues.apache.org/jira/browse/FLINK-16626
Best,
tison.
Yun Tang 于2020年4月23日周四 上午1:18写道：
> Hi
>
> I think you could still use ./bin/flink cancel to cancel the job.
> What is the exception throw
You can change flink-conf.yaml "jobmanager.address" or "jobmanager.port"
options before run the program or take a look at RemoteStreamEnvironment
which enables configuring host and port.
Best,
tison.
Som Lima 于2020年4月19日周日 下午5:58写道：
> Hi,
>
> After running
>
&g
ce a number of config options and keys, which should
have been configured in few of common options and validated at the runtime.
Best,
tison.
Yang Wang 于2020年4月17日周五 下午11:42写道：
> Hi tison,
>
> For #3, if you mean registering remote HDFS file as local resource, we
> should make the
If you run a program using "flink run" in dist/bin, dependencies should be
taken care of.
Could you describe detailedly how you "start a flink program"? Did you
write an entrypoint, compile it and run by "java YouProgram"? If so, you
should configure class
Hi,
Could you share the stack traces?
Best,
tison.
forideal 于2020年4月18日周六 上午12:33写道：
> Hello friend
> I have two SQL, checkpoint fails all the time. One task is to open a
> sliding window for an hour, and then another task consumes the output data
> of the previous task. Ther
Hi Alexander,
What do you mean exactly? Could you describe it in pseudo code? I'm not
quite sure where Java-Time used in env.
Best,
tison.
Alexander Borgschulze 于2020年4月17日周五 下午9:21写道：
> Can I use Joda-Time instead of Java-Time and set it up in the
> StreamExecutionEnvironment?
>
ion for only remote libs. Is this clarification satisfy your proposal?
Best,
tison.
Till Rohrmann 于2020年4月17日周五 下午7:49写道：
> Hi Yang,
>
> from what I understand it sounds reasonable to me. Could you sync with
> Tison on FLINK-14964 on how to proceed. I'm not super deep int
Thanks for your inputs and sorry that I said Schema doesn't support
DataType to register a field because I was looking into Flink 1.9 codes...
Best,
tison.
Jark Wu 于2020年4月17日周五 下午2:42写道：
> Hi Tison,
>
> Migration from TypeInformation to DataType is a large work and will
. Schema in Table API currently support only TypeInformation to register a
field, shall we support
the DataType way as well?
Best,
tison.
s/out/our/
Hi guys,
Right now when I click "JavaDocs" in out docsite[1] it jumps to a page[2] I
think is definitely not
out api documentation. Any thoughts?
Best,
tison.
[1] https://ci.apache.org/projects/flink/flink-docs-master/
[2] https://ci.apache.org/projects/flink/flink-docs-master/api/java/
l log
Starting ZooKeeperLeaderRetrievalService ...
so that I suspect whether the retrieval service normally started.
Best,
tison.
Bajaj, Abhinav 于2020年3月23日周一 下午1:55写道：
> Hi Yang, Tison,
>
>
>
> I think I was to reproduce the issue with a simpler job with DEBUG l
Hi Sidney,
For the case, you can exactly write
stream.
...
.window()
.apply()
.addSink()
Operator chain will chain these operators into one so that you don't have
to worry about the efficiency.
Best,
tison.
Sidney Feiner 于2020年3月22日周日 下午10:03写道：
> Hey,
> I wanted to k
ish the leader info or the listener didn't get notified.
Best,
tison.
tison 于2020年3月18日周三 上午10:40写道：
> Hi Abhinav,
>
> The problem is
>
> Curator: Background operation retry gave up
>
> So it is the ZK ensemble too unstable to get recovery in time so that
> Curator
Hi Abhinav,
The problem is
Curator: Background operation retry gave up
So it is the ZK ensemble too unstable to get recovery in time so that
Curator stopped retrying and threw a fatal error.
Best,
tison.
Xintong Song 于2020年3月18日周三 上午10:22写道：
> I'm not familiar with ZK either.
JIRA created as https://jira.apache.org/jira/browse/FLINK-16637
Best,
tison.
Till Rohrmann 于2020年3月17日周二 下午5:57写道：
> @Tison could you create an issue to track the problem. Please also link
> the uploaded log file for further debugging.
>
> I think the reason why it worked in Fli
edit: previously after the cancellation we have a longer call chain to
#jobReachedGloballyTerminalState which does the archive job & JM graceful
showdown, which might take some time so that ...
Best,
tison.
tison 于2020年3月17日周二 上午10:13写道：
> Hi Weike & Till,
>
> I agree with Ti
alization logics that clear these outstanding future
with best effort before the cluster(RestServer) down.
Best,
tison.
Till Rohrmann 于2020年3月17日周二 上午4:12写道：
> Hi Weike,
>
> could you share the complete logs with us? Attachments are being filtered
> out by the Apache mail server but i
Hi,
You'd better use English in user mailing list.
If you prefer Chinese, you can post the email to user...@flink.apache.org .
Best,
tison.
tison 于2020年3月16日周一 下午4:25写道：
> 从 flink/ 根目录运行 mvn clean install -DskipTests
>
> 你这个问题是因为 impl 那些类是生成类，一般来说从根目录运行一次全量编译可以解决各种疑难杂症
>
从 flink/ 根目录运行 mvn clean install -DskipTests
你这个问题是因为 impl 那些类是生成类，一般来说从根目录运行一次全量编译可以解决各种疑难杂症
Best,
tison.
吴志勇 <1154365...@qq.com> 于2020年3月16日周一 下午4:23写道：
> 您好，
> 我从github上下载了最新的代码。在IDEA中尝试编译，但是flink-table项目flink-sql-parser编译报错，
>
> test中也同样报错，
>
> 请问该如何解决呢？flink-sql-parser像是缺少了impl包呀。
>
IIRC Flink on Kubernetes doesn't support configure rest port as port range.
Maybe Yang(in cc) can give more information and if so, our current logic
only take care of RestOptions.PORT but not RestOptions.BIND_PORT, which
will be a bug.
Best,
tison.
LakeShen 于2020年3月15日周日 上午11:25写道：
The StoppableFunction is gone.
See also https://issues.apache.org/jira/browse/FLINK-11889
Best,
tison.
LakeShen 于2020年3月12日周四 下午5:44写道：
> Hi community,
> now I am seeing the FLIP-45 , as I see the stop command only suit
> for the sources that implement the Stoppabl
FLINK-13938 seems a bit different than your requirement. The one totally
matches is FLINK-14964 <https://issues.apache.org/jira/browse/FLINK-14964>.
I'll appreciate it if you can share you opinion on the JIRA ticket.
Best,
tison.
tison 于2020年3月7日周六 上午2:35写道：
> Yes your requirem
Yes your requirement is exactly taken into consideration by the community.
We currently have an open JIRA ticket for the specific feature[1] and works
for loosing the constraint of flink-jar schema to support DFS location
should happen.
Best,
tison.
[1] https://issues.apache.org/jira/browse
eak user interface so we firstly **MUST** start a
discussion and see whether the community think of it and if so, how to
integrate it. For me, read the doc is an easy solution to save us from
breaking user interface. I don't stick to loose the constraint.
Best,
tison.
Jingsong Li 于2020年3月6日
s and runs a program.
Syntax: run [OPTIONS]
that explicit explains the format.
Best,
tison.
tison 于2020年3月6日周五 下午10:22写道：
> I think the problem is that --classpath should be before the user jar,
> i.e., /opt/flink/job/kafkaDemo19-1.0-SNAPSHOT.jar
>
> Best,
> tison.
>
>
I think the problem is that --classpath should be before the user jar,
i.e., /opt/flink/job/kafkaDemo19-1.0-SNAPSHOT.jar
Best,
tison.
Aljoscha Krettek 于2020年3月6日周五 下午10:03写道：
> Hi,
>
> first a preliminary question: does the jar file contain
> com.alibaba.fastjson.JSON? Could yo
Congrats Jingsong, well deserved!
Best,
tison.
Xintong Song 于2020年2月21日周五 上午11:09写道：
> Congratulations, Jingsong. Well deserved~！
>
>
> Thank you~
>
> Xintong Song
>
>
>
> On Fri, Feb 21, 2020 at 11:05 AM Kurt Young wrote:
>
>> Hi everyone,
>>
&g
strategies
above just
restart the application, which means all tasks will be killed and restarted.
Best,
tison.
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/jobmanager_high_availability.html#configuration-1
KristoffSC 于2020年2月7日周五 下午11:34写道：
> Hi,
> In [1] where we ca
I guess it is a jm internal error which crashes the dispatcher or race
condition so that the returning future never completed, possibly related to
jdk bug. But again, never have a log in the case I cannot conclude anything.
Best,
tison.
tison 于2020年1月22日周三 上午10:49写道：
> It is a known is
It is a known issue reported multiple times that if you are in an early jdk
1.8.x version, upgrade the bugfix version and the issue will vanish.
I don't ever have a log on jm side when this issue reported so I'm sorry
unable to explain more...
Best,
tison.
Yang Wang 于2020年1月22日周三
Good to know :-)
Best,
tison.
Aaron Langford 于2020年1月22日周三 上午10:44写道：
> My apologies, I ended up resolving this through experimentation. AWS
> replaces master nodes with the same internal DNS names, so configurations
> need not be changed.
>
> Aaron
>
>
> On Tue, Ja
community keep digging out a safe
upgrade path.
Best,
tison.
Yang Wang 于2020年1月22日周三 上午10:34写道：
> Hi Aaron,
>
> I think it is not the responsibility of Flink. Flink uses zookeeper
> curator to connect the zk server. If
> multiple zk server are specified, it has an automatic retry m
Congratulations! Dian
Best,
tison.
Zhu Zhu 于2020年1月17日周五 上午10:47写道：
> Congratulations Dian.
>
> Thanks,
> Zhu Zhu
>
> hailongwang <18868816...@163.com> 于2020年1月17日周五 上午10:01写道：
>
>>
>> Congratulations Dian !
>>
>> Best,
>> Hailong Wan
A public way to get JSON plan of a JobGraph is, with an existing Flink
Cluster, use REST API JarPlan[1].
Best,
tison.
[1]
https://ci.apache.org/projects/flink/flink-docs-master/monitoring/rest_api.html#jars-jarid-plan
tison 于2020年1月8日周三 上午11:08写道：
> Hi Zhang,
>
> I just notice t
Hi Zhang,
I just notice that it is sent to user list. Please send to user-zh list(in
cc) next time if you want to discuss in Chinese.
Best,
tison.
tison 于2020年1月8日周三 上午11:06写道：
> 如果你是流作业的话，参考这个页面[1]搞到 JobGraph 之后可以
>
> JsonPlanGenerator.generatePlan(jobGraph)
>
> 拿到 JobGraph 的
如果你是流作业的话，参考这个页面[1]搞到 JobGraph 之后可以
JsonPlanGenerator.generatePlan(jobGraph)
拿到 JobGraph 的 JSON。不过这个是非常内部的逻辑，没有任何兼容性保障。
Best,
tison.
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/deployment/mesos.html#flink-job-cluster-on-mesos
张江 于2020年1月8日周三 上午11:01写道：
> 大家好，
>
It possibly fails with incompatibility. Flink doesn't promise such
compatibility but it MIGHT work.
Best,
tison.
wangl...@geekplus.com.cn 于2019年12月30日周一 下午3:17写道：
>
> The flink cluster version is 1.8.2
> The application source code needs some feature only supported in 1.9
Forward to user list.
Best,
tison.
Abdul Qadeer 于2019年12月20日周五 下午12:57写道：
> Around submission time, logs from jobmanager:
>
> {"timeMillis":1576764854245,"thread":"flink-akka.actor.default-dispatcher-1016","level":"INFO","logge
ent-server connection.
Best,
tison.
Yang Wang 于2019年12月20日周五 上午11:02写道：
> It seems that not because the timeout of rest client. It is a server side
> akka timeout exception.
> Could you share the jobmanager logs?
>
> Best,
> Yang
>
> Abdul Qadeer 于2019年12月20日周五 上午10:59写道
In previous version there is an "akka.client.timeout" option but it is only
used for timeout the future in client side so I don't think it change akka
scope timeout.
Best,
tison.
Abdul Qadeer 于2019年12月20日周五 上午10:44写道：
> Hi!
>
> I am using Flink 1.8.3 and facing an is
l. Is it possible we do the recovery in respective case?
Best,
tison.
rovement using "init
container" and other technologies. However, so far I regard it is an
improvement different from one storage to another so that we achieve then
individually.
Best,
tison.
Stephan Ewen 于2019年11月20日周三 上午12:34写道：
> Would that be a feature specific to Yarn? (an
with FLINK-13938. I'd like to put the
discussion on our
mailing list first.
Are you looking forward to such a feature?
@Yang Wang: this feature is different from that we discussed offline, it
only focuses on flink jar, not
all ship files.
Best,
tison.
It is because MiniCluster start a SystemResourcesCounter for gathering
metrics but no
logic for shutdown. Thus on cluster exist the thread leak.
Best,
tison.
tison 于2019年11月14日周四 上午10:21写道：
> We found this issue previous.
>
> In our case where leak thread comes from is tracked a
We found this issue previous.
In our case where leak thread comes from is tracked as
https://issues.apache.org/jira/browse/FLINK-14565
Best,
tison.
vino yang 于2019年11月14日周四 上午10:15写道：
> Hi Theo,
>
> If you think there is a thread leakage problem. You can create a JIRA
> issue
document, in fact PackagedProgram is unnecessary
to be a class
in flink-client. With related Exceptions move to flink-runtime it can be a
flink-runtime concept
now. And thus we don't suffer from dependency conflict actually.
Best,
tison.
tison 于2019年11月1日周五 下午2:17写道：
> Hi all,
>
> T
t with a dedicated cluster, I propose a workflow as below. It acts
like
>starting a drive on cluster but is NOT a general driver solution as
proposed
>here[3], the main purpose of the workflow below is for providing a
"per-program"
>semantic mode.
I'm reading detailedly your
. For compilation part, I think it could be a workaround that you upload
those
resources in a commonly known address such as HDFS so that compilation
can read from either client or cluster.
Best,
tison.
[1]
https://issues.apache.org/jira/browse/FLINK-14051?focusedCommentId=16927430
m"
mode.
It happens that current per-job mode would be useless if we have such
"per-program" mode so that we possibly deprecate it for preferring the
other.
I'm glad to discuss more into details if you're interested in, but let's say
we'd better first reach a
56 matches
Mail list logo
