Stephan
Humm... I see.
Back off one step, how do Flink deal with corrupted input data right now,
like a dead letter queue?
Thanks,
Chen
On Thu, Aug 11, 2016 at 5:40 AM, Stephan Ewen wrote:
> Hi!
>
> This is a very big change, both on the semantics, the runtime classes.
> These changes are tric
Hi Ufuk,
Thanks for the great proposal I think this will be a very cool feature :)
Option 1:
I think the main problem here is sending all the state everywhere will not
scale at all. I think this will even fail for some internal Flink operators
(window timers I think are kept like this, maybe Im w
Stephan Ewen created FLINK-4386:
---
Summary: Add as way to assert that code runs in the RpcEndpoint's
Main Thread
Key: FLINK-4386
URL: https://issues.apache.org/jira/browse/FLINK-4386
Project: Flink
Timo Walther created FLINK-4385:
---
Summary: Union on Timestamp fields does not work
Key: FLINK-4385
URL: https://issues.apache.org/jira/browse/FLINK-4385
Project: Flink
Issue Type: Bug
Hey all!
I've created a short FLIP for rescalable non-partitioned state:
https://cwiki.apache.org/confluence/display/FLINK/FLIP-8%3A+Rescalable+Non-Partitioned+State
This is related to an effort led by Till, Aljoscha, Stephan, and
Stefan to allow rescaling of Flink jobs (see FLINK-3755, FLINK-43
Stephan Ewen created FLINK-4384:
---
Summary: Add a "scheduleRunAsync()" feature to the RpcEndpoint
Key: FLINK-4384
URL: https://issues.apache.org/jira/browse/FLINK-4384
Project: Flink
Issue Type:
Hi,
I think this is a very important change for the the future of the system
that provides a much cleaner internal representation of the states.
You are right that this can in theory break programs written in 1.1 when
upgraded to 1.2 but I wonder if this will be actually a practical problem
in th
Till Rohrmann created FLINK-4383:
Summary: Check parameters for serializability before sending a
remote RpcInvocation message
Key: FLINK-4383
URL: https://issues.apache.org/jira/browse/FLINK-4383
Proj
Till Rohrmann created FLINK-4382:
Summary: Buffer rpc calls until RpcEndpoint is properly started
Key: FLINK-4382
URL: https://issues.apache.org/jira/browse/FLINK-4382
Project: Flink
Issue Ty
Hi,
Stefan and I are currently working on preparing our state infrastructure
for the introduction of key-grouped state. This is the parent issue for
key-grouped state https://issues.apache.org/jira/browse/FLINK-3755 while
this is the specific issue that we are currently working on
https://issues.ap
Aljoscha Krettek created FLINK-4381:
---
Summary: Refactor State to Prepare For Key-Group State Backends
Key: FLINK-4381
URL: https://issues.apache.org/jira/browse/FLINK-4381
Project: Flink
Is
Aljoscha Krettek created FLINK-4380:
---
Summary: Introduce KeyGroupAssigner and Max-Parallelism Parameter
Key: FLINK-4380
URL: https://issues.apache.org/jira/browse/FLINK-4380
Project: Flink
Ufuk Celebi created FLINK-4379:
--
Summary: Add Rescalable Non-Partitioned State
Key: FLINK-4379
URL: https://issues.apache.org/jira/browse/FLINK-4379
Project: Flink
Issue Type: New Feature
Wenlong Lyu created FLINK-4378:
--
Summary: Enable RollingSink to custom HDFS client configuration
Key: FLINK-4378
URL: https://issues.apache.org/jira/browse/FLINK-4378
Project: Flink
Issue Type:
Sajeev Ramakrishnan created FLINK-4377:
--
Summary: akka.remote.OversizedPayloadException: Discarding
oversized payload
Key: FLINK-4377
URL: https://issues.apache.org/jira/browse/FLINK-4377
Project
Hi!
This is a very big change, both on the semantics, the runtime classes.
These changes are tricky to get in, and usually work best if you document
the changes and all implications well.
Something like a deep design doc, or a FLIP would be great for this.
https://cwiki.apache.org/confluence/disp
Wenlong Lyu created FLINK-4376:
--
Summary: implement job manager init procedure
Key: FLINK-4376
URL: https://issues.apache.org/jira/browse/FLINK-4376
Project: Flink
Issue Type: Sub-task
Wenlong Lyu created FLINK-4375:
--
Summary: defined rpc protocols provided by job manager
Key: FLINK-4375
URL: https://issues.apache.org/jira/browse/FLINK-4375
Project: Flink
Issue Type: Sub-task
Stefan Richter created FLINK-4374:
-
Summary: GroupReduce Broken for null Date
Key: FLINK-4374
URL: https://issues.apache.org/jira/browse/FLINK-4374
Project: Flink
Issue Type: Bug
Co
Hi Theo,
I think currently, there is nobody actively working on side inputs. Thus,
it might be possible that they don't make it in the 1.2 release.
Cheers,
Till
On Wed, Aug 10, 2016 at 10:41 PM, Theodore Vasiloudis <
theodoros.vasilou...@gmail.com> wrote:
> Hello Aljoscha,
>
> Do you think the
Thank you for your responses. I will get in touch with the Bahir community
to see what they are thinking about this.
Once we know a bit more about the details of such a collaboration, we can
make a final decision here.
On Tue, Aug 9, 2016 at 3:47 PM, Till Rohrmann wrote:
> I agree with Stephan t
The Flink PMC is pleased to announce the availability of Flink 1.1.1.
The Maven artifacts published on Maven central for the previous 1.1.0
version had a Hadoop dependency issue. No Hadoop 1 specific version
(with version 1.1.0-hadoop1) was deployed and the 1.1.0 artifacts have
a dependency on Had
Kurt Young created FLINK-4373:
-
Summary: Introduce SlotID & ResourceProfile
Key: FLINK-4373
URL: https://issues.apache.org/jira/browse/FLINK-4373
Project: Flink
Issue Type: Sub-task
Com
23 matches
Mail list logo
