Hello,
I have some code which compiles correctly (Flink 1.4) under Java 8.
It uses generic types.
While it compiles correctly, the execution fails with the error:
org.apache.flink.api.common.functions.InvalidTypesException: Type of
TypeVariable 'K' in 'class X' could not be determined.
This is m
Hello,
I'm having difficulty reading the status (such as time taken for each
dataflow operator in a job) of jobs that have completed.
First, when I click on "Completed jobs" on the web interface (by default at
8081), no job shows up.
I see jobs that exist as "Running", but as soon as they finish,
WebUI can _appear_ as still working since all the files, and data
> about the job, is cached in the browser.
>
> On 05.09.2018 17:39, Miguel Coimbra wrote:
>
> Hello,
>
> I'm having difficulty reading the status (such as time taken for each
> dataflow operator in a job)
ling execute(), at the end of which it is shut down.
>
> For explicitly creation and shutdown of a cluster I would suggest to
> execute your jobs as a test that contains a MiniClusterResource.
>
> On 05.09.2018 20:59, Miguel Coimbra wrote:
>
> Thanks for the reply.
>
>
using 8081 instead, which is the REST port.
>
> On 06.09.2018 18:24, Miguel Coimbra wrote:
>
> Hello Chesnay,
>
> Thanks for the information.
>
> Decided to move straight away to launching a standalone cluster.
> I'm now having another problem when trying to submit a jo
Dear community,
I have a problem which I hope you'll be able to help with.
I apologize in advance for the verbosity of the post.
I am running the Flink standalone cluster (not even storing to the
filesystem) with 2 Docker containers.
I set the image of the Dockerfile for Flink 1.1.2, which was th
Hello,
I have a problem for which I hope someone will be able to give a hint.
I am running the Flink *standalone* cluster with 2 Docker containers (1
TaskManager and 1 JobManager) using 1 TaskManager with 30 GB of RAM.
The dataset is a large one: SNAP Friendster, which has around 1800 M edges.
ht
r setup.
> You can configure the temp dir using the taskmanager.tmp.dirs config key.
> Please see the configuration documentation for details [1].
>
> Hope this helps,
> Fabian
>
> [1] https://ci.apache.org/projects/flink/flink-docs-release-1.1/
> setup/config.html#jobmanager-amp-taskman
Dec 2016 08:40:04 +0100
> Subject:
>
> Re: Thread 'SortMerger spilling thread' terminated due to an exception: No
> space left on device
> Hi Miguel,
>
> have you found a solution to your problem?
> I'm not a docker expert but this forum thread loo
three
> slots, either 3 three slots in one TM or 1 slot in each of three TMs.
>
> Best,
> Fabian
>
> 2016-12-05 17:20 GMT+01:00 Miguel Coimbra :
>
>> Hello Fabian,
>>
>> Thanks for the attention. Still haven't solved this.
>> I did set up a cron
Hello,
If I missed the answer to this or some essential step of the documentation,
please do tell.
I am having the following problem while trying out the
org.apache.flink.graph.library.CommunityDetection algorithm of the Gelly
API (Java).
Specs: JDK 1.8.0_102 x64
Apache Flink: 1.1.4
Suppose I ha
Hello,
I created the JIRA issue at:
https://issues.apache.org/jira/browse/FLINK-5506
Is it possible to submit suggestions to the documentation?
If so, where can I do so?
I actually did this based on the example at this page (possible Flink
versions aside):
https://flink.apache.org/news/2015/08/
January 2017 at 17:12, Miguel Coimbra
wrote:
Hello,
If I missed the answer to this or some essential step of the documentation,
please do tell.
I am having the following problem while trying out the
org.apache.flink.graph.library.CommunityDetection algorithm of the Gelly
API (Java).
Specs: JDK
Hello,
In the documentation of the LocalClusteringCoefficient algorithm, it is
said:
*The local clustering coefficient measures the connectedness of each
vertex’s neighborhood.Scores range from 0.0 (no edges between neighbors) to
1.0 (neighborhood is a clique).*
https://ci.apache.org/projects/f
between neighbors.
>>
>> I'm sorry that you this is not clear in the docs. We should definitely
>> improve them to explain what is the output and how to retrieve the actual
>> clustering coefficient values. I have opened a JIRA for this [1].
>>
>> Cheers,
Hello,
I'm facing a problem in an algorithm where I would like to constantly
update a DataSet representing a graph, perform some computation, output one
or more DataSink (such as a file on the local system) and then reuse
the DataSet
for a next iteration.
I want to avoid spilling the results to d
plain the increasing execution time of 15 seconds.
>
> Best, Fabian
>
> 2017-11-26 17:45 GMT+01:00 Miguel Coimbra :
>
>> Hello,
>>
>> I'm facing a problem in an algorithm where I would like to constantly
>> update a DataSet representing a graph, perform s
7;t been
> major additions to the DataSet API and runtime in the last releases.
>
> Best, Fabian
>
>
>
> 2017-11-28 9:14 GMT+01:00 Miguel Coimbra :
>
>> Hello Fabian,
>>
>> Thank you for the reply.
>> I was hoping the situation had in fact changed.
>&
//stackoverflow.com/questions/33691612/apache-
> flink-stepwise-execution/33691957#33691957
>
>
>
> 2017-11-29 0:44 GMT+01:00 Miguel Coimbra :
>
>> Hello,
>>
>> You're right, I was overlooking that.
>> With your suggestion, I now just define a different
>
> You could take a stacktrace of the client process to identify at which
> part the client gets stuck.
>
> Best, Fabian
>
> 2017-12-06 3:01 GMT+01:00 Miguel Coimbra :
>
>> Hello Fabian,
>>
>> Thanks for the help.
>> I am interested in the duration of
s should have an effect on the plan enumeration.
>
> If this doesn't help, the only solution might be to cut the program into
> multiple pieces and spill intermediate results to disk.
>
> Best, Fabian
>
> [1] https://ci.apache.org/projects/flink/flink-docs-
> release-1.
Hello,
I am running into a situation where the Flink threads responsible for my
operator execution are all stuck on WAITING mode.
Before anything else, this is my machine's spec:
Linux 4.4.88 #1 SMP x86_64 Intel(R) Xeon(R) CPU E7- 4830 @ 2.13GHz
GenuineIntel GNU/Linux
256 GB RAM
I am running i
consult the UI or logs. You said you were
> dumping the input DataSets into files, but were they actually complete?
>
> A deadlock in the network stack should appear as all existing operator
> threads being blocked.
> We can probably rule out a problem with the join logic by removing
ging and search for something along the lines of
> "http://: was granted leadership"
>
> Sorry for the inconvenience.
>
> On 16.04.2018 15:04, Miguel Coimbra wrote:
>
> Thanks for the suggestions Chesnay, I will try them out.
>
> However, I have already tried
> James C.-C.Yu
> +886988713275
>
> 2018-04-18 6:57 GMT+08:00 Miguel Coimbra :
>
>> Chesnay, following your suggestions I got access to the web interface and
>> also took a closer look at the debugging logs.
>> I have noticed one problem regarding the web interface po
uel.e.coim...@gmail.com
On 17 April 2018 at 22:52, Miguel Coimbra
wrote:
> Hello James,
>
> Thanks for the information.
> I noticed something suspicious as well: I have chains of operators where
> the first operator will ingest the expected amount of records but will not
> emi
Hello,
Perhaps just a mistake on my part, but at
http://flink.apache.org/downloads.html#binaries for the 1.2.0 binaries, all
the download links seem to be broken:
http://www.apache.org/dyn/closer.lua/flink/flink-1.2.0/flink-1.2.0-bin-hadoop2-scala_2.10.tgz
http://www.apache.org/dyn/closer.lua/fli
> The set of 4 pages you linked load the list of mirrors to download from.
>
> On Mon, Apr 10, 2017 at 6:50 AM, Miguel Coimbra <
> miguel.e.coim...@gmail.com> wrote:
>
>> Hello,
>>
>> Perhaps just a mistake on my part, but at http://flink.apache.org/downlo
>
28 matches
Mail list logo
