Great work! Congratulations to everyone involved!
Best,
Yangze Guo
On Fri, Oct 27, 2023 at 10:23 AM Qingsheng Ren wrote:
>
> Congratulations and big THANK YOU to everyone helping with this release!
>
> Best,
> Qingsheng
>
> On Fri, Oct 27, 2023 at 10:18 AM Benchao Li wr
.
They are stable across patch releases (1.17.0 and 1.17.1), but can be
changed across minor releases (1.17.0 and 1.18.0).
You can refer to [1] for more details.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-196%3A+Source+API+stability+guarantees
Best,
Yangze Guo
On Wed, May 3
AFAIK, it is not under discussion now.
Best,
Yangze Guo
On Fri, Nov 12, 2021 at 9:16 PM Morten Gunnar Bjørner Lindeberg
wrote:
>
> Hi again
>
> Ok, thanks then I understand:) Do you know if there is a plan to support this
> with elastic scaling in a later release?
>
> Re
want some of the TaskManagers to have GPU, you may set up
a standalone cluster and then manually start a TaskManager with GPU
and let it register to the cluster.
Best,
Yangze Guo
On Thu, Nov 11, 2021 at 9:57 PM Chesnay Schepler wrote:
>
> The external resource documentation should c
s how many slots your job needs.
Best,
Yangze Guo
On Thu, Nov 4, 2021 at 5:58 PM Deniz Koçak wrote:
>
> Hi,
>
> We have been running our job on flink image
> 1.13.2-stream1-scala_2.12-java11. It's a standalone deployment on a
> Kubernetes cluster (EKS on AWS which uses EC2 nod
Thank Chesnay, Martijn, and everyone involved!
Best,
Yangze Guo
On Fri, Oct 22, 2021 at 4:25 PM Yun Tang wrote:
>
> Thanks for Chesnay & Martijn and everyone who made this release happen.
>
> Best
> Yun Tang
>
> From: JING ZHANG
> Se
/native_kubernetes/#stop-a-running-session-cluster
Best,
Yangze Guo
On Thu, Oct 21, 2021 at 6:37 AM Weiqing Yang wrote:
>
>
> Hi,
>
> Per the doc, `kubernetes.jobmanager.owner.reference` can be used to set up
> the owners of the job manager Deployment. If the owner is deleted, then
Hi, Pavel.
>From my understanding of the doc[1], you need to set it in
flink-conf.yaml instead of your job.
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/filesystems/s3/#hadooppresto-s3-file-systems-plugins
Best,
Yangze Guo
On Sat, Oct 16, 2021 at 5:46 AM Pa
Would
you like to take a look at [2]?
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/yarn/#per-job-cluster-mode
[2]
https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/table/sqlclient/
Best,
Yangze Guo
On Tue, Oct 12, 2021 at 10:52
Thanks, Xintong, Joe, Dawid for the great work, thanks to everyone involved!
Best,
Yangze Guo
On Thu, Sep 30, 2021 at 12:02 AM Rion Williams wrote:
>
> Great news all! Looking forward to it!
>
> > On Sep 29, 2021, at 10:43 AM, Theo Diefenthal
> > wrote:
> >
> &
/deployment/resource-providers/standalone/overview/#starting-a-standalone-cluster-session-mode
Best,
Yangze Guo
On Wed, Sep 29, 2021 at 1:02 PM Qihua Yang wrote:
>
> Hi Yangze,
>
> Thanks a lot for your reply. References are very helpful!
> Another quick question. Reference 1 can sta
-providers/native_kubernetes/#session-mode
[3]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/yarn/#session-mode
Best,
Yangze Guo
On Wed, Sep 29, 2021 at 5:57 AM Qihua Yang wrote:
>
> Hi,
>
> Is that possible to run a flink app without a job? What
I'm not an expert on S3. If it is not a credential issue, have you
finish the checklist of this doc[1]?
[1]
https://aws.amazon.com/premiumsupport/knowledge-center/emr-s3-403-access-denied/?nc1=h_ls
Best,
Yangze Guo
On Wed, Sep 22, 2021 at 3:39 PM Dhiru wrote:
>
>
> Not sure @y
You might need to configure the access credential. [1]
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/filesystems/s3/#configure-access-credentials
Best,
Yangze Guo
On Wed, Sep 22, 2021 at 2:17 PM Dhiru wrote:
>
>
> i see org.apache.hadoop.fs.FileSyst
AFAIK there is not. Flink will just skip the invalid lines.
Best,
Yangze Guo
On Sat, Sep 18, 2021 at 7:00 AM Dan Hill wrote:
>
> Hi. I noticed my flink-config.yaml had an error in it. I assumed a bad
> config would stop Flink from running (to catch errors earlier). Is there a
&g
Hi, Mason
AFAIK the JM does not report the total number of metrics it has. Maybe
you can stats it of each entity through [1]?
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/ops/metrics/#rest-api-integration
Best,
Yangze Guo
On Thu, Sep 16, 2021 at 9:30 AM Mason Chen wrote
ps://github.com/apache/bahir-flink/blob/master/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/descriptor/RedisValidator.java
Best,
Yangze Guo
On Wed, Sep 15, 2021 at 11:34 AM Osada Paranaliyanage
wrote:
>
> Hi David,
>
>
>
> What about the bah
Job) ?
I would also pull Yang Wang.
Best,
Yangze Guo
On Mon, Sep 6, 2021 at 10:10 AM Caizhi Weng wrote:
>
> Hi!
>
> There is a message saying "java.lang.NoClassDefFound Error:
> org/apache/hadoop/hdfs/HdfsConfiguration" in your log file. Are you visiting
> H
you can search the "CANCELING" in jm and tm
logs.
Best,
Yangze Guo
On Wed, Aug 18, 2021 at 1:20 AM Abhishek Rai wrote:
>
> Before these message, there is the following message in the log:
>
> 2021-08-12 23:02:58.015 [Canceler/Interrupts for Source: MASKED])
> (1/1)#29
Hi, Jin
IIUC, the DataStream connector `RedisSink` can still be used. However,
the Table API connector `RedisTableSink` might not work (at least in
the future) because it is implemented based on the deprecated Table
connector abstraction. You can still give it a try, though.
Best,
Yangze Guo
On
Hi, Abhishek,
Do you see something like "Fatal error occurred while executing the
TaskManager" in your log or would you like to provide the whole task
manager log?
Best,
Yangze Guo
On Tue, Aug 17, 2021 at 5:17 AM Abhishek Rai wrote:
>
> Hello,
>
> In our production envi
>From my understanding, what you want is actually a management system
for Flink jobs. I think it might be good to submit the job(with `flink
run`) and retrieve the WebUI in another process.
Best,
Yangze Guo
On Mon, Aug 2, 2021 at 10:39 PM Hailu, Andreas [Engineering]
wrote:
>
> Hi Yan
AFAIK, the ClusterClient should not be exposed through the public API.
Would you like to explain your use case and why you need to get the
web UI programmatically?
Best,
Yangze Guo
On Fri, Jul 30, 2021 at 9:54 PM Hailu, Andreas [Engineering]
wrote:
>
> Hello Yangze, thanks for resp
/flink/flink-docs-master/docs/deployment/resource-providers/standalone/overview/#starting-and-stopping-a-cluster
Best,
Yangze Guo
On Fri, Jul 30, 2021 at 1:41 AM Hailu, Andreas [Engineering]
wrote:
>
> Hi team,
>
>
>
> Is there a method available to obtain the JobManager’s REST url
In your case, the entry point is the `cleanUpInvoke` function called
by `StreamTask#invoke`.
@ro...@apache.org Could you take another look at this?
Best,
Yangze Guo
On Thu, Jul 29, 2021 at 2:29 AM Ivan Yang wrote:
>
> Hi Yangze,
>
> I deployed 1.13.1, same problem exists. It see
Hi, Ivan
My gut feeling is that it is related to FLINK-22535. Could @Yun Gao
take another look? If that is the case, you can upgrade to 1.13.1.
Best,
Yangze Guo
On Tue, Jul 27, 2021 at 9:41 AM Ivan Yang wrote:
>
> Dear Flink experts,
>
> We recently ran into an issue during a job
The ticket cache will be expired after its lifespan. You can try to
set the security.kerberos.login.use-ticket-cache to false as you
provide the keytab.
Best,
Yangze Guo
On Tue, Jul 6, 2021 at 10:02 AM 谢扬成 wrote:
>
> Hi,
>
> I processed data with flink which version is 1.12.2, data
a replacement but the progress has not been
started yet. As a workaround for your testing purpose, you can submit
a warmup job(e.g. WordCount with required parallelism) and increase
the "slotmanager.taskmanager-timeout" to ensure the TM will not
timeout fast.
[1] http://issues.apache.org/
ase refer
to taskmanager.numberOfTaskSlots [1].
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/config/#taskmanager-numberoftaskslots
Best,
Yangze Guo
Best,
Yangze Guo
On Thu, Jul 1, 2021 at 3:57 PM vtygoss wrote:
>
> Hi,
>
>
> i have some questions
&
Sorry for the belated reply. In 1.12, you just need to make sure that
the HADOOP_CLASSPATH environment variable is set up. For more details,
please refer to [1].
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/yarn/
Best,
Yangze Guo
On Mon, Jun 28
e-backends-latency-tracking-options
Best,
Yangze Guo
On Fri, Jun 18, 2021 at 3:39 PM Chen-Che Huang wrote:
>
> Hi,
>
> The 1.13 release note
> (https://flink.apache.org/news/2021/05/03/release-1.13.0.html) mentions that
> we can set state.backend.rocksdb.latency-track-enabled to o
Thanks for the report, Yidan.
It will be fixed in FLINK-23024 and hopefully fixed in 1.13.2.
Best,
Yangze Guo
On Fri, Jun 18, 2021 at 10:00 AM yidan zhao wrote:
>
> Yeah, I also think it is a bug.
>
> Arvid Heise 于2021年6月17日周四 下午10:13写道：
> >
> > Hi Yidan,
> &
way to configure the connection/socket timeout in
Elasticsearch SQL connector. However, if the root cause is a network
jitter, you may increase the sink.bulk-flush.backoff.delay and the
sink.bulk-flush.backoff.max-retries.
Best,
Yangze Guo
On Sat, Jun 5, 2021 at 2:28 PM Kai Fu wrote:
>
> With
ework.
[1] https://github.com/nexmark/nexmark
Best,
Yangze Guo
On Sun, Jun 6, 2021 at 7:35 AM luck li wrote:
>
> Hi flink community,
>
> Is there any test framework that we can use to test flink jobs performance?
> We would like to automate process for regression tests during flin
Thanks, Dawid for the great work, thanks to everyone involved.
Best,
Yangze Guo
On Mon, May 31, 2021 at 4:14 PM Youngwoo Kim (김영우) wrote:
>
> Got it.
> Thanks Dawid for the clarification.
>
> - Youngwoo
>
> On Mon, May 31, 2021 at 4:50 PM Dawid Wysakowicz
>
Hi, Rober,
To mitigate this issue, you can increase the "heartbeat.interval" and
"heartbeat.timeout". However, I think we should first figure out the
root cause, would you like to provide the log of
10.42.0.49:6122-e26293?
Best,
Yangze Guo
On Thu, May 27, 2021 at 10:44 PM
Hi, Marco,
The root cause is NoResourceAvailableException. Could you provide the
following information?
- How many slots each TM has?
- Your job's topology, it would also be good to share the job manager log.
Best,
Yangze Guo
On Tue, May 25, 2021 at 12:10 PM Marco Villalobos
wrote:
>
Jacky is right. It's a known issue and will be fixed in FLINK-21511.
Best,
Yangze Guo
On Tue, May 25, 2021 at 8:40 AM Jacky Yin 殷传旺 wrote:
>
> If you are using es connector 6.*, actually there is a deadlock bug if the
> backoff is enabled. The 'retry' and 'flush
system properties at the TaskManager will be used.
If that is the case, you can initiate the `serviceName` field in the
map/flatMap or open function. Then, it will read the TM's envs or
properties instead.
Best,
Yangze Guo
On Fri, May 21, 2021 at 5:40 AM Milind Vaidya wrote:
>
> This i
still be
called.
Best,
Yangze Guo
On Fri, May 21, 2021 at 5:53 AM Qihua Yang wrote:
>
> Thank you for the reply!
> Yes, we did config bulk.flush.backoff.enable.
> So, ES BulkProcessor retried after bulk request was partially rejected. And
> eventually that request was sent s
Hi, it seems to be related to FLINK-22276. Thus, I'd involve Matthias
to take a look.
@Matthias My gut feeling is that not all execution who has failureInfo
has been deployed?
Best,
Yangze Guo
On Wed, May 12, 2021 at 10:12 PM Gary Wu wrote:
>
> Hi,
>
> We have upgraded our F
Hi, Fan
Flink loaded the custom reporter through the service loader mechanism.[1]
Do you add the service file in the "resources/META-INF/services" directory?
[1] https://docs.oracle.com/javase/9/docs/api/java/util/ServiceLoader.html
Best,
Yangze Guo
On Wed, May 12, 2021 at 7:53
K-15959, we will introduce the min number of slots of the
cluster. With this feature, you can configure how many TMs needed
before submitting the jobs.
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/standalone/kubernetes/
Best,
Yangze Guo
On Tue, May 11,
/docs/deployment/resource-providers/yarn/
[3]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/resource-providers/standalone/overview/#starting-and-stopping-a-cluster
Best,
Yangze Guo
Best,
Yangze Guo
On Fri, May 7, 2021 at 7:34 PM Tamir Sagi wrote:
>
> Hey
>
&
Hi,
I think the checkpointing is not the root cause of your job failure.
As the log describes, your job failed caused by the authorization
issue of Kafka. "Caused by:
org.apache.kafka.common.errors.TransactionalIdAuthorizationException:
Transactional Id authorization failed."
Best,
Thanks, Dawid & Guowei for the great work, thanks to everyone involved.
Best,
Yangze Guo
On Thu, May 6, 2021 at 5:51 PM Rui Li wrote:
>
> Thanks to Dawid and Guowei for the great work!
>
> On Thu, May 6, 2021 at 4:48 PM Zhu Zhu wrote:
>>
>> Thanks Dawid and
ps://ci.apache.org/projects/flink/flink-docs-stable/ops/state/checkpoints.html
[3]
https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/resource-providers/native_kubernetes.html
[4] https://issues.apache.org/jira/browse/FLINK-17709
[5]
https://ci.apache.org/projects/flink/flink-docs
If the GenericCLI is selected, then the execution.target should have
been overwritten to "yarn-application" in GenericCLI#toConfiguration.
It is odd that why the GenericCLI#isActive return false as the
execution.target is defined in both flink-conf and command line.
Best,
Yangze Guo
O
,
Yangze Guo
On Mon, Apr 26, 2021 at 4:48 PM Till Rohrmann wrote:
>
> Hi Tony,
>
> I think you are right that Flink's cli does not behave super consistent at
> the moment. Case 2. should definitely work because `-t yarn-application`
> should overwrite what is defined in the F
/kubernetes.html
Best,
Yangze Guo
On Thu, Apr 22, 2021 at 10:46 PM Matthias Pohl wrote:
>
> Hi Gil,
> I'm not sure whether I understand you correctly. What do you mean by
> deploying the job manager as "job" or "deployment"? Are you referring to the
> dif
Hi, Tony.
What is the version of your flink-dist. AFAIK, this issue should be
addressed in FLINK-15852[1]. Could you give the client log of case
2(set the log level to DEBUG would be better).
[1] https://issues.apache.org/jira/browse/FLINK-15852
Best,
Yangze Guo
On Sun, Apr 25, 2021 at 11:33
-docs-master/docs/ops/rest_api/#jobs-overview
Best,
Yangze Guo
On Sun, Apr 25, 2021 at 4:17 PM Barak Ben Nathan
wrote:
>
>
>
> Hi all,
>
>
>
> I am building an application that launches Flink Jobs and monitors them.
>
>
>
> I want to use the JobListener inter
IIUC, your program will finally generate 100 ChildFirstClassLoader in
a TM. But it should always be GC when job finished. So, as Arvid said,
you'd better check who is referencing those ChildFirstClassLoader.
Best,
Yangze Guo
On Thu, Apr 8, 2021 at 5:43 PM 太平洋 <495635...@qq.com> wr
I went through the JM & TM logs but could not find any valuable clue.
The exception is actually thrown by kafka-producer-network-thread.
Maybe @Qingsheng could also take a look?
Best,
Yangze Guo
On Thu, Apr 8, 2021 at 10:39 AM 太平洋 <495635...@qq.com> wrote:
>
> I have configu
me TM will share the same
classloader. The classloader will be removed if there is no more task
running on the TM. Classloader without reference will be finally
cleanup by GC. Could you share JM and TM logs for further analysis?
I'll also involve @Guowei Ma in this thread.
Best,
Yangze Guo
On
I think you can try to increase the JVM metaspace option for
TaskManagers through taskmanager.memory.jvm-metaspace.size. [1]
[1]
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/memory/mem_trouble/#outofmemoryerror-metaspace
Best,
Yangze Guo
Best,
Yangze Guo
On Tue, Apr
+1
Best,
Yangze Guo
On Mon, Mar 29, 2021 at 11:31 AM Xintong Song wrote:
>
> +1
> It's already a matter of fact for a while that we no longer port new features
> to the Mesos deployment.
>
> Thank you~
>
> Xintong Song
>
>
>
> On Fri, Mar 26, 2021 at 10
Thanks Xintong for the great work!
Best,
Yangze Guo
On Tue, Jan 19, 2021 at 4:47 PM Till Rohrmann wrote:
>
> Thanks a lot for driving this release Xintong. This was indeed a release with
> some obstacles to overcome and you did it very well!
>
> Cheers,
> Till
>
> On T
,
Yangze Guo
On Sun, Jan 17, 2021 at 6:43 PM penguin. wrote:
>
> Hello,
>
>
> In the Flink cluster,
>
> How to monitor each taskslot of taskmanager? For example, the CPU and memory
> usage of each slot and the traffic between slots.
>
> What is the way to get the tr
ill be placed into different slots and have their own Elasticsearch
sink instance.
[1]
https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-elasticsearch-base/src/main/java/org/apache/flink/streaming/connectors/elasticsearch/ElasticsearchSinkBase.java#L204.
Best,
Yangze Guo
I think you can try the application mode[1].
[1]
https://ci.apache.org/projects/flink/flink-docs-master/deployment/#application-mode
Best,
Yangze Guo
On Tue, Jan 12, 2021 at 5:23 PM bat man wrote:
>
> Thanks Yangze Gua.
> Is there a way these can be redirected to a yarn logs.
>
The main function of your WordCountExample is executed in your local
environment. So, the logs you are looking for ("Entering
application.") are be located in your console output and the "log/"
directory of your Flink distribution.
Best,
Yangze Guo
On Tue, Jan 12, 2021 at 4:
My gut feeling is your "vmArgs" does not take effect.
Best,
Yangze Guo
On Mon, Dec 7, 2020 at 10:32 AM Yangze Guo wrote:
>
> Hi, Rex,
>
> Can you share more logs for it. Did you see something like "The
> configuration option taskmanager.cpu.cores required fo
Hi, Rex,
Can you share more logs for it. Did you see something like "The
configuration option taskmanager.cpu.cores required for local
execution is not set, setting it to" in your logs?
Best,
Yangze Guo
Best,
Yangze Guo
On Sat, Dec 5, 2020 at 6:53 PM David Ander
Hi,
There is a login operation in
YarnEntrypointUtils.logYarnEnvironmentInformation without the keytab.
One suspect is that Flink may access the HDFS when it tries to build
the PackagedProgram.
Does this issue only happen in the application mode? If so, I would cc
@kkloudas.
Best,
Yangze Guo
Hi,
AFAIK, Flink does exclude the HDFS_DELEGATION_TOKEN in the
HadoopModule when user provides the keytab and principal. I'll try to
do a deeper investigation to figure out is there any HDFS access
before the HadoopModule installed.
Best,
Yangze Guo
On Tue, Nov 17, 2020 at 4:36 PM Kien T
Hi, Kien,
Do you config the "security.kerberos.login.principal" and the
"security.kerberos.login.keytab" together? If you only set the keytab,
it will not take effect.
Best,
Yangze Guo
On Tue, Nov 17, 2020 at 3:03 PM Kien Truong wrote:
>
> Hi all,
>
> We
Hi, Sidney,
What is the data generation rate of your Kafka topic? Is it a lot
bigger than 6000?
Best,
Yangze Guo
Best,
Yangze Guo
On Tue, Nov 3, 2020 at 8:45 AM Sidney Feiner wrote:
>
> Hey,
> I'm writing a Flink app that does some transformation on an event consumed
> fr
Hi,
As the error message said, it could not find the flink-dist.jar in
"/cygdrive/d/Apacheflink/dist/apache-flink-1.9.3/deps/lib". Where is
your flink distribution and do you change the directory structure of
it?
Best,
Yangze Guo
On Mon, Sep 21, 2020 at 5:31 PM saksham sapra wro
Sorry that the community decided to not maintain it anymore, you could
take a look at [1].
[1]
https://lists.apache.org/thread.html/r7693d0c06ac5ced9a34597c662bcf37b34ef8e799c32cc0edee373b2%40%3Cdev.flink.apache.org%3E
Best,
Yangze Guo
On Thu, Sep 17, 2020 at 5:21 PM saksham sapra wrote
,
Yangze Guo
On Thu, Sep 17, 2020 at 4:53 PM saksham sapra wrote:
>
> HI Yangze,
>
> I tried to run start-cluster.sh and i can see in host , when flink tries to
> run second task manager or executor, pop up or host gets closed.
> Please find attached logs for two command : st
information to figure out what happened.
- What is the output when you execute ./bin/start-cluster.sh, could
you see two "Starting taskexecutor daemon on host" lines?
- Could you see two flink-xxx-taskexecutor-xxx.log in $FLINK_DIST/log?
If so, could you share these two log files?
Best,
Yangz
ocalhost' to it. Then, execute the
$FLINK_DIST/bin/start-cluster.sh, you could see a standalone cluster
with two TM in your local machine.
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/cluster_setup.html#configuring-flink
Best,
Yangze Guo
On Thu, Sep 17, 20
our job indeed requests.
And probably help to figure out what the ExecutionGraph finally looks
like.
Best,
Yangze Guo
On Thu, Sep 10, 2020 at 10:47 AM Ken Krugler
wrote:
>
> Hi Til,
>
> On Sep 3, 2020, at 12:31 AM, Till Rohrmann wrote:
>
> Hi Ken,
>
> I believe that we don
aused by the following reasons:
- The MinIO is not well configured.
- Maybe you need to create a bucket for it first. In my case, I create
a bucket called "flink" first.
Best,
Yangze Guo
On Wed, Sep 9, 2020 at 9:33 AM Rex Fenley wrote:
>
> Hello!
>
> I'm trying to
it.
Best,
Yangze Guo
On Thu, Sep 3, 2020 at 4:39 AM Ken Krugler wrote:
>
> Hi all,
>
> I’ve got a streaming workflow (using Flink 1.11.1) that runs fine locally
> (via Eclipse), with a parallelism of either 3 or 6.
>
> If I set up part of the workflow to use a specific
Congrats Dian!
Best,
Yangze Guo
On Thu, Aug 27, 2020 at 6:26 PM Zhu Zhu wrote:
>
> Congratulations Dian!
>
> Thanks,
> Zhu
>
> Zhijiang 于2020年8月27日周四 下午6:04写道：
>
> > Congrats, Dian!
> >
> > --
Thanks a lot for being the release manager Zhu Zhu!
Congrats to all others who have contributed to the release!
Best,
Yangze Guo
On Tue, Aug 25, 2020 at 2:42 PM Dian Fu wrote:
>
> Thanks ZhuZhu for managing this release and everyone else who contributed to
> this release!
>
>
ent/kubernetes.html
Best,
Yangze Guo
On Mon, Aug 24, 2020 at 9:33 PM Sakshi Bansal wrote:
>
> The flink version is 1.9 and it is a standalone k8s
>
> On Mon 24 Aug, 2020, 17:17 Yangze Guo, wrote:
>>
>> Hi, Sakshi
>>
>> Could you provide more in
flink-docs-release-1.11/ops/memory/mem_migration.html
[2]
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/cluster_setup.html
[3]
https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/deployment/kubernetes.html
Best,
Yangze Guo
On Mon, Aug 24, 2020 at 6:31
/config.html#slotmanager-number-of-slots-max
[2] https://issues.apache.org/jira/browse/FLINK-15959
Best,
Yangze Guo
On Tue, Aug 18, 2020 at 12:21 PM 范超 wrote:
>
> Thanks Yangze
>
> 1. Do you meet any problem when deploying on Yarn or running Flink job?
> My job works well
>
>
Hi,
Flink can control how many TM to start, but where to start the TMs
depends on Yarn.
Do you meet any problem when deploying on Yarn or running Flink job?
Why do you need to start the TMs on all the three machines?
Best,
Yangze Guo
On Tue, Aug 18, 2020 at 11:25 AM 范超 wrote:
>
>
deploying a standalone cluster instead?
Best,
Yangze Guo
On Tue, Aug 18, 2020 at 10:24 AM 范超 wrote:
>
> Thanks Yangze
>
> All 3 machines NodeManager is started.
>
> I just don't know why not three machines each running a Flink TaskManager and
> how to achieve this
>
&
Hi,
Do you start the NodeManager in all the three machines? If so, could
you check all the NMs correctly connect to the ResourceManager?
Best,
Yangze Guo
On Tue, Aug 18, 2020 at 10:01 AM 范超 wrote:
>
> Hi, Dev and Users
> I’ve 3 machines each one is 8 cores and 16GB memory.
> Follo
Hi,
When deploying Flink on Yarn, you could ship krb5.conf by "--ship"
command. Notice that this command only supports to ship folders now.
Best,
Yangze Guo
On Fri, Aug 14, 2020 at 11:22 AM Vijayendra Yadav wrote:
>
> Any inputs ?
>
> On Tue, Aug 11, 2020 at 10:34 AM Vija
ml and override
variables by dynamic options(-Dxxx=xxx). Or just contain all the
necessary configuration in your custom flink-conf.yaml.
Best,
Yangze Guo
On Fri, Aug 7, 2020 at 4:02 AM Vijayendra Yadav wrote:
>
> Hi Team,
>
> How can I override flink default conf/flink-conf.yaml from
Hi, Richard
Before the session has been terminated, you could not fetch the
terminated TM logs. One possible solution could be leveraging the
log4j2 appenders[1]. Flink uses log4j2 as default in the latest
release 1.11.
[1] https://logging.apache.org/log4j/2.x/manual/appenders.html
Best,
Yangze
Congrats!
Thanks Dian Fu for being release manager, and everyone involved!
Best,
Yangze Guo
On Wed, Jul 22, 2020 at 3:14 PM Wei Zhong wrote:
>
> Congratulations! Thanks Dian for the great work!
>
> Best,
> Wei
>
> > 在 2020年7月22日，15:09，Leonard Xu 写道：
> >
>
Hi Harshvardhan,
You need to send an email to user-unsubscr...@flink.apache.org to unsubscribe.
Best,
Yangze Guo
On Tue, Jul 21, 2020 at 7:12 PM Harshvardhan Agrawal
wrote:
>
> --
> Regards,
> Harshvardhan
] https://issues.apache.org/jira/browse/FLINK-17862
[2]
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-do-I-get-the-IP-of-the-master-and-slave-files-programmatically-in-Flink-td35299.html
Best,
Yangze Guo
On Tue, Jul 21, 2020 at 4:42 PM Si-li Liu wrote:
>
> I figu
Hi,
AFAIK, there is no official image with Java 11. However, I think you
could simply build a custom image by changing the base layer[1] to
openjdk:11-jre.
[1]
https://github.com/apache/flink-docker/blob/949e445006c4fc288813900c264847d23d3e33d4/1.11/scala_2.12-debian/Dockerfile
Best,
Yangze
Thanks, Zhijiang and Piotr. Congrats to everyone involved!
Best,
Yangze Guo
On Wed, Jul 8, 2020 at 10:19 AM Jark Wu wrote:
>
> Congratulations!
> Thanks Zhijiang and Piotr for the great work as release manager, and thanks
> everyone who makes the release possible!
>
> Best,
&g
Hi, there,
As Flink 1.11.0 released, we provide a new calculator[1] for this
version. Feel free to try it and any feedback or suggestion is
welcomed!
[1]
https://github.com/KarmaGYZ/flink-memory-calculator/blob/master/calculator-1.11.sh
Best,
Yangze Guo
On Wed, Apr 1, 2020 at 9:45 PM Yangze
Hi, Mu,
AFAIK, this feature is added to 1.9.2. If you use 1.9.0, would you
like to upgrade your Flink distribution?
Best,
Yangze Guo
On Tue, Jul 7, 2020 at 8:33 PM Mu Kong wrote:
>
> Hi, Guo,
>
> Thanks for helping out.
>
> My application has a kafka source with 60 subtasks
from ResourceManager. This has been discussed in
https://issues.apache.org/jira/browse/FLINK-12122 .
Best,
Yangze Guo
On Tue, Jul 7, 2020 at 5:44 PM Mu Kong wrote:
>
> Hi community,
>
> I'm running an application to consume data from kafka, and process it then
> put da
Congrats, Yu!
Best,
Yangze Guo
On Wed, Jun 17, 2020 at 9:35 AM Xintong Song wrote:
>
> Congratulations Yu, well deserved~!
>
> Thank you~
>
> Xintong Song
>
>
>
> On Wed, Jun 17, 2020 at 9:15 AM jincheng sun wrote:
>>
>> Hi all,
>>
>> On beh
om/apache/flink/blob/216f65fff10fb0957e324570662d075be66bacdf/flink-yarn/src/main/java/org/apache/flink/yarn/YarnClusterDescriptor.java#L770
Best,
Yangze Guo
On Wed, Jun 10, 2020 at 11:29 PM John Mathews wrote:
>
> Hello,
>
> I have a custom filesystem that I am trying to migrate to the
Amend: for release 1.10.1, please refer to this guide [1].
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/ops/deployment/native_kubernetes.html#log-files
Best,
Yangze Guo
On Thu, Jun 4, 2020 at 9:52 AM Yangze Guo wrote:
>
> Hi, Kevin,
>
> Regarding logs, you
t.
[1]
https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/native_kubernetes.html#log-files
Best,
Yangze Guo
On Thu, Jun 4, 2020 at 2:28 AM kb wrote:
>
> Hi
>
> We are using 1.10.1 with native k8s and while the service appears to be
> created and I can submit
It sounds good to me. If your job keeps running (longer than the
expiration time), I think it implies that Krb5LoginModule will use
your newly generated cache. It's my pleasure to help you.
Best,
Yangze Guo
On Mon, Jun 1, 2020 at 10:47 PM Nick Bendtner wrote:
>
> Hi Guo,
> Th
1 - 100 of 131 matches
Mail list logo
