Andra Lungu created FLINK-1677:
--
Summary: Properly Suppress Sysout Printing for the Degrees with
exception test suite
Key: FLINK-1677
URL: https://issues.apache.org/jira/browse/FLINK-1677
Project: Flink
And I'm +1 for removing the old API with the next release.
2015-03-10 17:38 GMT+01:00 Fabian Hueske :
> Yeah, I spotted a good amount of optimizer tests that depend on the Record
> API.
> I implemented the last optimizer tests with the new API and would
> volunteer to port the other optimizer tes
Márton Balassi created FLINK-1688:
-
Summary: Add socket sink
Key: FLINK-1688
URL: https://issues.apache.org/jira/browse/FLINK-1688
Project: Flink
Issue Type: Sub-task
Components: St
I will follow up again with Sally this week if there any special
messaging or communications needed to do for the Apache Con from our
side.
- Henry
On Tue, Mar 10, 2015 at 3:20 AM, Robert Metzger wrote:
> Hey,
>
> whats the status on this? There is one week left until we are going to fork
> off
+1 for the idea too. Should make it easier to trace/ debug.
- Henry
On Tue, Mar 10, 2015 at 5:45 AM, Stephan Ewen wrote:
> +1, let's change this lazily whenever we work on an action/message, we pull
> the handling out into a dedicated method.
>
> On Tue, Mar 10, 2015 at 11:49 AM, Ufuk Celebi w
Robert Metzger created FLINK-1679:
-
Summary: Document how "degree of parallelism" / "parallelism" /
"slots" are connected to each other
Key: FLINK-1679
URL: https://issues.apache.org/jira/browse/FLINK-1679
Hi all,
I would like your opinion on whether we should deprecate the Spargel API in
0.9.
Gelly doesn't depend on Spargel, it actually contains it -- we have copied
the relevant classes over. I think it would be a good idea to deprecate
Spargel in 0.9, so that we can inform existing Spargel users
+1 I think it's a good idea to remove it and finish the deprecation. ;)
Thanks for looking into it Fabian.
– Ufuk
On 10 Mar 2015, at 20:42, Henry Saputra wrote:
> Thanks guys,
>
> I have filed FLINK-1681 [1] to track this issue.
>
> Maybe Fabian would like to take stab at this?
>
> [1] http
Gábor Hermann created FLINK-1687:
Summary: Streaming file source API is not in sync with the batch
API
Key: FLINK-1687
URL: https://issues.apache.org/jira/browse/FLINK-1687
Project: Flink
Is
+1
2015-03-12 9:23 GMT+01:00 Ufuk Celebi :
> +1 I think it's a good idea to remove it and finish the deprecation. ;)
>
> Thanks for looking into it Fabian.
>
> – Ufuk
>
> On 10 Mar 2015, at 20:42, Henry Saputra wrote:
>
> > Thanks guys,
> >
> > I have filed FLINK-1681 [1] to track this issue.
>
+1 for deprecating
2015-03-11 14:11 GMT+01:00 Kostas Tzoumas :
> +1 for deprecating and pointing people to Gelly
>
> On Wed, Mar 11, 2015 at 10:30 AM, Ufuk Celebi wrote:
>
> >
> > On 10 Mar 2015, at 22:02, Vasiliki Kalavri
> > wrote:
> >
> > > Hi all,
> > >
> > > I would like your opinion on wh
Márton Balassi created FLINK-1689:
-
Summary: Add documentation on streaming file sinks interaction
with the batch outputformat
Key: FLINK-1689
URL: https://issues.apache.org/jira/browse/FLINK-1689
Pro
Till Rohrmann created FLINK-1690:
Summary:
ProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure spuriously
fails on Travis
Key: FLINK-1690
URL: https://issues.apache.org/jira/browse/FLINK-1690
Robert Metzger created FLINK-1692:
-
Summary: Add option to Flink YARN client to stop a detached YARN
session.
Key: FLINK-1692
URL: https://issues.apache.org/jira/browse/FLINK-1692
Project: Flink
On Tue, Mar 10, 2015 at 11:20 AM, Robert Metzger
wrote:
> I think
> it is time to evaluate whether we are confident that the master is stable.
>
In the course of finishing up #471 [1] I ran 20 Travis builds over night,
of which 7 failed.
The (unexpected) failing test cases:
- ExternalSortITCas
So you're saying regarding the release you don't feel very confident that
we manage to fork off release-0.9 next week?
The exceptions in the jobmanager-stderr from the YARN tests is the
following (from #347.5 and #344.5):
07:46:00,598 WARN org.apache.flink.yarn.YarnTestBase
- LINE: Mar 12,
+1 for going consistently with parallelism. However, these are API-breaking
changes and we need to mark them deprecated before throwing them out, IMO.
I am not comfortable with using AUTOMAX as a default. This is fine on
dedicated setups like YARN sessions, but will consume all available
resources
We can also make the change non-API breaking by adding an additional method
and deprecating the old one.
Why would the AUTOMAX parallelism eat up all cluster resources? It would
only allocate all slots WITHIN the Flink cluster.
Those users (=new users) who would benefit from the AUTOMAX paralleli
+1 for consistently calling it parallelism
-1 for AUTOMAX as the default
On Thu, Mar 12, 2015 at 10:31 AM, Robert Metzger
wrote:
> We can also make the change non-API breaking by adding an additional method
> and deprecating the old one.
>
>
> Why would the AUTOMAX parallelism eat up all cluste
+1 for unifying the way to set the parallelism and deprecating the old methods.
We had the AUTOMAX discussion before in the corresponding pull
request. It seems to be that there are two orthogonal views on how
resources should be allocated by default. I strongly agree with
Robert.
Users have excl
YARN does not have that problem anyways, because YARN sets the default
parallelism to all slots anyways
On Thu, Mar 12, 2015 at 11:19 AM, Maximilian Michels wrote:
> +1 for unifying the way to set the parallelism and deprecating the old
> methods.
>
> We had the AUTOMAX discussion before in the
On Thu, Mar 12, 2015 at 10:11 AM, Robert Metzger
wrote:
> So you're saying regarding the release you don't feel very confident that
> we manage to fork off release-0.9 next week?
>
Yes. At the moment I would be uncomfortable with forking off.
Regarding the failing tests: I thought that so
Vasia Kalavri created FLINK-1693:
Summary: Deprecate the Spargel API
Key: FLINK-1693
URL: https://issues.apache.org/jira/browse/FLINK-1693
Project: Flink
Issue Type: Task
Components
Vasia Kalavri created FLINK-1694:
Summary: Change the split between create/run of a vertex-centric
iteration
Key: FLINK-1694
URL: https://issues.apache.org/jira/browse/FLINK-1694
Project: Flink
I would like to get the Expression API for Java in there, as well.
On Thu, Mar 12, 2015 at 11:59 AM, Ufuk Celebi wrote:
> On Thu, Mar 12, 2015 at 10:11 AM, Robert Metzger
> wrote:
>
>> So you're saying regarding the release you don't feel very confident that
>> we manage to fork off release-0.9
Hi Folks,
as mentioned in the title, we need a good name for this. Right now the
API is called Expression API, the package is flink-expressions and the
thing on which you call operations (equivalent to DataSet or
DataStream) is called ExpressionOperation. Especially the last one is
extremely ugly.
I am also big time skeptical.
There are some remaining stability issues with 0.9
- Apparently a bug in the task canceling
- Blocking Data Exchange is premature at this point
- TaskManager startup is not robust
- TaskManager / JobManager registration is not robust
- Streaming fault tolera
Have you run the 20 builds with the new shading code? With new shading the
TaskManagerFailsITCase should no longer fail. If it still does, then we
have to look into it again.
On Thu, Mar 12, 2015 at 2:01 PM, Stephan Ewen wrote:
> I am also big time skeptical.
>
> There are some remaining stabili
On Thursday, March 12, 2015, Till Rohrmann wrote:
> Have you run the 20 builds with the new shading code? With new shading the
> TaskManagerFailsITCase should no longer fail. If it still does, then we
> have to look into it again.
No, rebased on Monday before shading. Let me rebase and rerun to
Seemed like after few commits between today and yesterday, building
Flink takes very long time.
I used to be able to run mvn clean install -DskipTests in about 17
mins but after pull this morning, it has been 25 mins and the build
has not complete yet.
I am using MacOSX with JDK7
- Henry
Till Rohrmann created FLINK-1695:
Summary: Create machine learning library
Key: FLINK-1695
URL: https://issues.apache.org/jira/browse/FLINK-1695
Project: Flink
Issue Type: Improvement
Till Rohrmann created FLINK-1697:
Summary: Add alternating least squares algorithm to ML library
Key: FLINK-1697
URL: https://issues.apache.org/jira/browse/FLINK-1697
Project: Flink
Issue Typ
Till Rohrmann created FLINK-1696:
Summary: Add multiple linear regression to ML library
Key: FLINK-1696
URL: https://issues.apache.org/jira/browse/FLINK-1696
Project: Flink
Issue Type: Improv
Till Rohrmann created FLINK-1698:
Summary: Add polynomial base feature mapper to ML library
Key: FLINK-1698
URL: https://issues.apache.org/jira/browse/FLINK-1698
Project: Flink
Issue Type: Im
Ah interesting, on my Linux box it only took about 8 mins.
Something wrong with my MBP env =(
- Henry
On Thu, Mar 12, 2015 at 11:37 AM, Henry Saputra wrote:
> Seemed like after few commits between today and yesterday, building
> Flink takes very long time.
>
> I used to be able to run mvn clean
35 matches
Mail list logo
