Hi Kostas,
my question is related to the fact that now Flink is available as Cascading
engine.
So, if I had to write a general purpose dataflow UI I think I'd use
Cascading or Dataflow,
so that I could draw my pipeline with the UI and write the execution code
using just one API.
Obviously this int
That depends on your requirements.
A common interface is usually less feature rich than the abstracted
processing engines. For example, Cascading does not support iterations or
streaming.
If you are fine with the features (and limitations) of the common
interface, your approach might make sense.
C
Dear community,
Please vote on releasing the following candidate as Apache Flink version
0.10.0-milestone-1. This is a milestone release that contains several
features of Flink's next major release version 0.10.0.
This is the first RC for this release.
---
Chengxiang Li created FLINK-2743:
Summary: Add new RNG based on XORShift algorithm
Key: FLINK-2743
URL: https://issues.apache.org/jira/browse/FLINK-2743
Project: Flink
Issue Type: Improvement
The tests use a ZooKeeper mini cluster and multiple Kafka MiniClusters.
It appears that these are not very stable in our test setup. Let's see what
we can do to improve reliability there.
1) As a first step, I would suggest to reduce the number of concurrent
tests to one for this project, as it w
Stephan Ewen created FLINK-2744:
---
Summary: Reduce number of concurrent test forks to 1 for the Kafka
connector project
Key: FLINK-2744
URL: https://issues.apache.org/jira/browse/FLINK-2744
Project: Flin
Chengxiang Li created FLINK-2745:
Summary: Create a new module for all Flink micro benchmark.
Key: FLINK-2745
URL: https://issues.apache.org/jira/browse/FLINK-2745
Project: Flink
Issue Type:
@Stephan, have you pushed that fix for SocketClientSinkTest? Local builds
still hang for me :S
On 21 September 2015 at 22:55, Vasiliki Kalavri
wrote:
> Yes, you're right. BarrierBufferMassiveRandomTest has actually finished
> :-)
> Sorry for the confusion! I'll wait for your fix then, thanks!
>
Stephan Ewen created FLINK-2746:
---
Summary: Add RetryOnException annotation for tests
Key: FLINK-2746
URL: https://issues.apache.org/jira/browse/FLINK-2746
Project: Flink
Issue Type: Improvement
I have pushed it, yes. If you rebase onto the latest master, it should work.
If you can verify that it still hangs, can you post a stack trace dump?
Thanks,
Stephan
On Wed, Sep 23, 2015 at 12:37 PM, Vasiliki Kalavri <
vasilikikala...@gmail.com> wrote:
> @Stephan, have you pushed that fix for S
Hi,
It's the latest master I'm trying to build, but it still hangs.
Here's the trace:
-
2015-09-23 13:48:41
Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.75-b04 mixed mode):
"Attach Listener" daemon prio=5 tid=0x7faeb984a000 nid=0x3707 waiting
on conditio
Aljoscha Krettek created FLINK-2747:
---
Summary: TypeExtractor does not correctly analyze Scala Immutables
(AnyVal)
Key: FLINK-2747
URL: https://issues.apache.org/jira/browse/FLINK-2747
Project: Flink
Hi everybody,
I guess we all have noticed that the Flink community is quickly growing and
more and more contributions are coming in. Recently, a few contributions
proposed new features without being discussed on the mailing list. Some of
these contributions were not accepted in the end. In other c
Hi,
I just encountered a problem in the WebClient. If I upload multiple
jars, only the first jar that is uploaded is shown. Can anybody verify
my observation?
-Matthias
On 09/23/2015 10:54 AM, Fabian Hueske wrote:
> Dear community,
>
> Please vote on releasing the following candidate as Apache
Big +1.
For (1), a discussion in JIRA would also be an option IMO
For (2), let us come up with few examples on what constitutes a feature
that needs a design doc, and what should be in the doc (IMO
architecture/general approach, components touched, interfaces changed)
On Wed, Sep 23, 2015 at 2
Same here.
> On 23 Sep 2015, at 13:50, Vasiliki Kalavri wrote:
>
> Hi,
>
> It's the latest master I'm trying to build, but it still hangs.
> Here's the trace:
>
> -
> 2015-09-23 13:48:41
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.75-b04 mixed mode):
>
Okay, will look into this is a bit today...
On Wed, Sep 23, 2015 at 4:04 PM, Ufuk Celebi wrote:
> Same here.
>
> > On 23 Sep 2015, at 13:50, Vasiliki Kalavri
> wrote:
> >
> > Hi,
> >
> > It's the latest master I'm trying to build, but it still hangs.
> > Here's the trace:
> >
> > --
I had a closer look, found the bug, and have a fix ready.
https://github.com/mjsax/flink/tree/hotfixWebClient
The bug was introduced by FLINK-2175. It seems, something went wrong
when I tested this back than. :/
-Matthias
On 09/23/2015 02:27 PM, Matthias J. Sax wrote:
> Hi,
>
> I just encount
It hangs for me too at the same test when doing "clean verify"
> On 23 Sep 2015, at 16:09, Stephan Ewen wrote:
>
> Okay, will look into this is a bit today...
>
> On Wed, Sep 23, 2015 at 4:04 PM, Ufuk Celebi wrote:
>
>> Same here.
>>
>>> On 23 Sep 2015, at 13:50, Vasiliki Kalavri
>> wrote:
Thank you for immediately providing a fix.
I would suggest to do some more testing to reduce the number of RCs we need
to create
On Wed, Sep 23, 2015 at 4:26 PM, Matthias J. Sax wrote:
> I had a closer look, found the bug, and have a fix ready.
>
> https://github.com/mjsax/flink/tree/hotfixWebC
Ufuk Celebi created FLINK-2748:
--
Summary: Accumulator fetch failure leads to duplicate job result
response
Key: FLINK-2748
URL: https://issues.apache.org/jira/browse/FLINK-2748
Project: Flink
I
Hi,
I agree with you Fabian. Clarifying these issues in the "How to Contribute"
guide will save lots of time both to reviewers and contributors. It is a
really disappointing situation when someone spends time implementing
something and their PR ends up being rejected because either the feature
was
Fabian Hueske created FLINK-2749:
Summary: CliFrontendAddressConfigurationTest fails on GCE
Key: FLINK-2749
URL: https://issues.apache.org/jira/browse/FLINK-2749
Project: Flink
Issue Type: Bu
I agree with continued testing before creating a new RC.
I build Flink from the source distribution:
- mvn clean install : works!
- mvn clean install -Dscala-2.11 : works!
- mvn clean install -Dhadoop.version=2.7.0 : fails (FLINK-2651)
- mvn clean install -Dhadoop.version=2.6.0 : fails (FLINK-275
Fabian Hueske created FLINK-2750:
Summary: FileStateHandleTest fails when building for Hadoop 2.6.0
Key: FLINK-2750
URL: https://issues.apache.org/jira/browse/FLINK-2750
Project: Flink
Issue
I found another issue: The source release contains the ".git" directory.
On Wed, Sep 23, 2015 at 5:27 PM, Fabian Hueske wrote:
> I agree with continued testing before creating a new RC.
>
> I build Flink from the source distribution:
>
> - mvn clean install : works!
> - mvn clean install -Dscala
Maximilian Michels created FLINK-2752:
-
Summary: Documentation is not easily differentiable from the Flink
homepage
Key: FLINK-2752
URL: https://issues.apache.org/jira/browse/FLINK-2752
Project: F
Maximilian Michels created FLINK-2751:
-
Summary: Quickstart is in documentation but only linked through
the Flink homepage
Key: FLINK-2751
URL: https://issues.apache.org/jira/browse/FLINK-2751
Pro
Thanks, Fabian for driving this!
I agree with your points.
Concerning Vasia's comment to not raise the bar too high:
That is true, the requirements should be reasonable. We can definitely tag
issues as "simple" which means they do not require a design document. That
should be more for new feature
Thanks again, Fabian for starting the discussions.
For (1) and (2) I think it is good idea and will help people to
understand and follow the author thought process.
Following up with Stephan's reply, some new features solutions could
be explained thoroughly in the PR descriptions but some requires
I would like to propose that Flink include a selection of graph generators
in Gelly. Generated graphs will be useful for performing scalability,
stress, and regression testing as well as benchmarking and comparing
algorithms, both for Flink users and developers. Generated data is
infinitely scalabl
I’ve pushed a fix.
> On 23 Sep 2015, at 16:28, Paris Carbone wrote:
>
> It hangs for me too at the same test when doing "clean verify"
>
>> On 23 Sep 2015, at 16:09, Stephan Ewen wrote:
>>
>> Okay, will look into this is a bit today...
>>
>> On Wed, Sep 23, 2015 at 4:04 PM, Ufuk Celebi wrot
Turned out it was due to different behavior of Sockets under Ubuntu
(Debian) and OS/X (BSD)
That why it did not happen for Travis and me...
+1 for OS diversity among committers :-)
On Wed, Sep 23, 2015 at 7:50 PM, Ufuk Celebi wrote:
> I’ve pushed a fix.
>
> > On 23 Sep 2015, at 16:28, Paris Ca
Stephan Ewen created FLINK-2753:
---
Summary: Add new window API to streaming API
Key: FLINK-2753
URL: https://issues.apache.org/jira/browse/FLINK-2753
Project: Flink
Issue Type: Sub-task
Thank you both! I verify that it's solved now :)
On 23 September 2015 at 20:00, Stephan Ewen wrote:
> Turned out it was due to different behavior of Sockets under Ubuntu
> (Debian) and OS/X (BSD)
>
> That why it did not happen for Travis and me...
>
> +1 for OS diversity among committers :-)
>
>
Chengxiang Li created FLINK-2754:
Summary: FixedLengthRecordSorter can not write to output cross
MemorySegments.
Key: FLINK-2754
URL: https://issues.apache.org/jira/browse/FLINK-2754
Project: Flink
36 matches
Mail list logo
