Re: History Server Not Showing Any Jobs - File Not Found?

2020-07-12 Thread Chesnay Schepler
e future J *// *ah** *From:*Chesnay Schepler *Sent:* Tuesday, June 2, 2020 3:55 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? 1) It downloads all archives and stores them on disk; the only thing stored in memory

RE: History Server Not Showing Any Jobs - File Not Found?

2020-07-11 Thread Hailu, Andreas
application ID (ala Spark) would ease the burden on the dev + ops side. Perhaps a feature for the future :) // ah From: Chesnay Schepler Sent: Tuesday, June 2, 2020 3:55 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Fo

Re: History Server Not Showing Any Jobs - File Not Found?

2020-06-02 Thread Chesnay Schepler
only keep the latest X archives in the dir - or is this something we need to manage ourselves? Thanks. *// *ah** *From:*Hailu, Andreas [Engineering] *Sent:* Friday, May 29, 2020 8:46 AM *To:* 'Chesnay Schepler' ; user@flink.apache.org *Subject:* RE: History Server Not Showing Any Jobs -

RE: History Server Not Showing Any Jobs - File Not Found?

2020-06-01 Thread Hailu, Andreas
ative retention of policy? E.g. only keep the latest X archives in the dir - or is this something we need to manage ourselves? Thanks. // ah From: Hailu, Andreas [Engineering] Sent: Friday, May 29, 2020 8:46 AM To: 'Chesnay Schepler' ; user@flink.apache.org Subject: RE: History Server Not S

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-29 Thread Hailu, Andreas
us to know if we're encountering some kind of resource problem. // ah From: Hailu, Andreas [Engineering] Sent: Thursday, May 28, 2020 12:18 PM To: 'Chesnay Schepler' <mailto:ches...@apache.org>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: RE: History

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-29 Thread Chesnay Schepler
lem. *// *ah** *From:*Hailu, Andreas [Engineering] *Sent:* Thursday, May 28, 2020 12:18 PM *To:* 'Chesnay Schepler' ; user@flink.apache.org *Subject:* RE: History Server Not Showing Any Jobs - File Not Found? Okay, I will look further to see if we’re mistakenly using a version that

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Hailu, Andreas
Andreas [Engineering] Sent: Thursday, May 28, 2020 12:18 PM To: 'Chesnay Schepler' ; user@flink.apache.org Subject: RE: History Server Not Showing Any Jobs - File Not Found? Okay, I will look further to see if we're mistakenly using a version that's pre-2.6.0. However, I don't

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Hailu, Andreas
4j12-1.7.15.jar Are the files within /lib. // ah From: Chesnay Schepler Sent: Thursday, May 28, 2020 11:00 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? Looks like it is indeed stuck on downloading the archive. I

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Chesnay Schepler
jar being included introduce? *// *ah** *From:*Chesnay Schepler *Sent:* Thursday, May 28, 2020 9:26 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? If it were a class-loading issue I would think that we'd

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Hailu, Andreas
ecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) What problems could the flink-shaded-hadoop jar being included introduce? // ah From: Chesnay Schepler Sent: Thursday, May 28, 2020 9:26 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject:

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-28 Thread Chesnay Schepler
ngineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? yes, exactly; I want to rule out that (somehow) HDFS is the problem. I couldn't reproduce the issue locally myself so far. On 01/05/2020 22:31, Hailu, Andreas wrote: Hi Chesnay,

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-27 Thread Hailu, Andreas
Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? yes, exactly; I want to rule out that (somehow) HDFS is the problem. I couldn't reproduce the issue locally myself so far. On 01/05/2020 22:31, Hailu, Andreas wrote: Hi Ch

Re: History Server Not Showing Any Jobs - File Not Found?

2020-05-03 Thread Chesnay Schepler
user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? hmm...let's see if I can reproduce the issue locally. Are the archives from the same version the history server runs on? (Which I supposed would be 1.9.1?) Just for the sake of narrowing things down, it wou

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-01 Thread Hailu, Andreas
ctory? // ah From: Chesnay Schepler Sent: Wednesday, April 29, 2020 8:26 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? hmm...let's see if I can reproduce the issue locally. Are the archives from the same version t

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-29 Thread Chesnay Schepler
nk_hs/0004be6ce01ba9677d1eb619ad0fa757 ... *// *ah** *From:*Chesnay Schepler *Sent:* Monday, April 27, 2020 10:28 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not Showing Any Jobs - File Not Found? If historyserver.web.tmpdir is not set then java.io.tmpdir is use

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Hailu, Andreas
l 27, 2020 10:28 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? If historyserver.web.tmpdir is not set then java.io.tmpdir is used, so that should be fine. What are the contents of /local/scratch/flink_historyserver

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Chesnay Schepler
/ historyserver.web.tmpdir: /local/scratch/flink_historyserver_tmpdir/ Did you have anything else in mind when you said pointing somewhere funny? *// *ah** *From:*Chesnay Schepler *Sent:* Monday, April 27, 2020 5:56 AM *To:* Hailu, Andreas [Engineering] ; user@flink.apache.org *Subject:* Re: History Server Not

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Hailu, Andreas
k.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? overview.json is a generated file that is placed in the local directory controlled by historyserver.web.tmpdir. Have you configured this option to point to some non-local filesystem? (Or if not, is the java.io.tmpd

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-27 Thread Chesnay Schepler
u, Andreas [Engineering] ; user@flink.apache.org *Subject:* RE: History Server Not Showing Any Jobs - File Not Found? Hi Chesnay, thanks for responding. We’re using Flink 1.9.1. I enabled DEBUG level logging and this is something relevant I see: 2020-04-22 13:25:52,566 [Flink-HistoryServer-Arch

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-24 Thread Hailu, Andreas
as [Engineering] ; user@flink.apache.org Subject: RE: History Server Not Showing Any Jobs - File Not Found? Hi Chesnay, thanks for responding. We're using Flink 1.9.1. I enabled DEBUG level logging and this is something relevant I see: 2020-04-22 13:25:52,566 [Flink-HistoryServer-ArchiveFet

RE: History Server Not Showing Any Jobs - File Not Found?

2020-04-22 Thread Hailu, Andreas
esday, April 22, 2020 2:16 AM To: Hailu, Andreas [Engineering] ; user@flink.apache.org Subject: Re: History Server Not Showing Any Jobs - File Not Found? Which Flink version are you using? Have you checked the history server logs after enabling debug logging? On 21/04/2020 17:16, Hailu, An

Re: History Server Not Showing Any Jobs - File Not Found?

2020-04-21 Thread Chesnay Schepler
Which Flink version are you using? Have you checked the history server logs after enabling debug logging? On 21/04/2020 17:16, Hailu, Andreas [Engineering] wrote: Hi, I’m trying to set up the History Server, but none of my applications are showing up in the Web UI. Looking at the console, I s

Re: History server UI not working

2020-03-10 Thread Yadong Xie
Hi pwestermann I believe this is related to https://issues.apache.org/jira/browse/FLINK-13799 It seems that the configuration.features['web-submit'] is missed from the api when you upgrading from 1.7 to 1.9.2 Do you have the same problem when upgrading to 1.10? feel free to ping me if you still

Re: History server UI not working

2020-03-09 Thread pwestermann
Hey Robert, I just tried Flink 1.10 and the history server UI works for me too. Only Flink 1.9.2 is not loading. Since we were already looking into upgrading to 1.10, I might just do that now. Thanks, Peter -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: History server UI not working

2020-03-07 Thread Robert Metzger
Hey Peter, I tried reproducing the error, and for a second, I though the 1.10 release really broke the web ui, because I saw a pretty similar error. However after clearing the cache, the error was gone. Are you sure that you cleared the cache of your browser? I have also asked the main contributo

Re: History server UI not working

2020-03-06 Thread pwestermann
I am seeing this error in firefox: ERROR TypeError: "this.statusService.configuration.features is undefined" t http://10.25.197.60:8082/main.177039bdbab11da4f8ac.js:1 qr http://10.25.197.60:8082/main.177039bdbab11da4f8ac.js:1 Gr http://10.25.197.60:8082/main.177039bdbab11da4f8ac.js:1

Re: History server UI not working

2020-03-06 Thread Robert Metzger
I'm also suspecting a problem with the UI updated Do the Developer Tools of the browser show any error messages? On Thu, Mar 5, 2020 at 7:00 AM Yang Wang wrote: > If all the rest api could be viewed successfully, then the reason may be > js cache. > You could try to force a refresh(e.g. Cmd+Shf

Re: History server UI not working

2020-03-04 Thread Yang Wang
If all the rest api could be viewed successfully, then the reason may be js cache. You could try to force a refresh(e.g. Cmd+Shft+R for Mac). It solved my problem before. Best, Yang pwestermann 于2020年3月4日周三 下午8:40写道: > We recently upgraded from Flink 1.7 to Flink 1.9.2 and the history server >

Re: History Server in Kubernetes

2018-08-30 Thread Till Rohrmann
Hi Encho, currently, the existing image does not support to start a HistoryServer. The reason is simply that it has not been exposed because the image contains everything needed. In order to do this, you would need to extend the docker-entrypoint.sh script with an additional history-server option.

Re: History Server

2018-01-17 Thread Chesnay Schepler
The HS isn't aware of running jobs at all, so yes users would have to switch once the job is done. On 17.01.2018 00:45, Eron Wright wrote: As a follow-up question, how well does the history server work for observing a running job? I'm trying to understand whether, in the cluster-per-job mode

Re: History Server

2018-01-16 Thread Eron Wright
As a follow-up question, how well does the history server work for observing a running job? I'm trying to understand whether, in the cluster-per-job model, a user would be expected to hop from the Web UI to the History Server once the job completed. Thanks On Wed, Oct 4, 2017 at 3:49 AM, Stepha

Re: History Server

2017-10-04 Thread Stephan Ewen
To add to this: The History Server is mainly useful in cases where one runs a Flink-cluster-per-job. One the job finished, the processes disappear. The History Server should be longer lived to make past executions' stats available. On Mon, Sep 25, 2017 at 3:44 PM, Nico Kruber wrote: > Hi Elias,

Re: History Server

2017-09-25 Thread Nico Kruber
Hi Elias, in theory, it could be integrated into a single web interface, but this was not done so far. I guess the main reason for keeping it separate was probably to have a better separation of concerns as the history server is actually independent of the current JobManager execution and merely