Hello Daniel,
there is neither Design Doc for the Python API nor for how it interacts
the the DataSet API.
If you have any questions feel free to contact me, I'll provide as much
information as i can.
Regards,
Chesnay
On 29.06.2016 22:53, Daniel Li wrote:
I am evaluating the feasibility o
Yes, I will take care of it as part other JIRA that I am working on.
RegardsVijay
On Wednesday, June 29, 2016 2:40 AM, Maximilian Michels
wrote:
Hi Vijay,
Glad we solved the problem.
Good catch with the FlinkYarnSessionCli. We should clean up the
properties file after running the Yarn
I am evaluating the feasibility of adding C# binding to Apache Flink. I
wonder if anyone of you can share a design doc for Apache Python binding
for Apache Flink?
thx
Daniel
Hi,
Yes , now I am getting clear with the concepts here.
One last thing I want to try before going for custom trigger, I want to try
Delta Trigger but I am not able to get the syntax right , this is how I am
trying it :
TypeInformation> typeInfo = TypeInformation.of(new
TypeHint>() {
});
// sourc
Hi Flink community,
while reviewing the LICENSE and NOTICE file of Apache Flink, I noticed that
according to the LICENSE file Flink contains many java script files.
However, tracking the corresponding files back was not so easy, because
they are actually all merged into
flink-runtime-web/web-dashb
Hi,
yes, you are definitely right that allowing to run multiple user code tasks
in the same TaskManager JVM is not good for stability. This mode is still
there from the very early days of Flink where Yarn was not yet available.
In a production environment I would now recommend to always run one
Fli
Hi,
you can use ingestion time if you don't care about the timestamps in your
events, yes. If elements from the two streams happen to arrive at such
times that they are not put into the same window then you won't get a
match, correct.
Regarding ingestion time and out-of-order events. I think this
Robert Metzger created FLINK-4133:
-
Summary: Reflect streaming file source changes in documentation
Key: FLINK-4133
URL: https://issues.apache.org/jira/browse/FLINK-4133
Project: Flink
Issue
Greg Hogan created FLINK-4132:
-
Summary: Fix boxed comparison in CommunityDetection algorithm
Key: FLINK-4132
URL: https://issues.apache.org/jira/browse/FLINK-4132
Project: Flink
Issue Type: Bug
Oh yes we've made a bit change on flink table API so that we can work on
data streams like data sets, thus code-generation is called.
On Wed, Jun 29, 2016 at 8:31 PM, Fabian Hueske wrote:
> Hi Cody,
>
>
>
> Aggregations are currently not performed by code-generated user functions.
> This would b
Hi Cody,
Aggregations are currently not performed by code-generated user functions. This
would be a good improvement though. Check the DataSetAggregate class to learn
how aggregations are translated into Flink Dataset programs.
Best, Fabian
Von: Cody Innowhere
Hi,
Ok.
Inside the checkAndGetNextWatermark(lastElement, extractedTimestamp) method
both these parameters are coming same (timestamp value) , I was expecting
last element timestamp value in the 1st param when I extract it.
Lets say I decide to use IngestionTime (since I am getting accurate result
Ufuk Celebi created FLINK-4131:
--
Summary: Confusing error for out dated RequestPartitionState
Key: FLINK-4131
URL: https://issues.apache.org/jira/browse/FLINK-4131
Project: Flink
Issue Type: Imp
Hi,
the element will be kept around indefinitely if no new watermark arrives.
I think the same problem will persist for AssignerWithPunctuatedWatermarks
since there you also might not get the required "last watermark" to trigger
processing of the last window.
Cheers,
Aljoscha
On Wed, 29 Jun 2016
Hi Aljoscha,
This clears a lot of doubts now.
So now lets say the stream paused for a while or it stops completely on
Friday , let us assume that the last message did not get processed and is
kept in the internal buffers.
So when the stream starts again on Monday , will it consider the last
eleme
Hi Vijay,
Glad we solved the problem.
Good catch with the FlinkYarnSessionCli. We should clean up the
properties file after running the Yarn tests. If you want to fix that,
you could open a pull request.
Cheers,
Max
On Wed, Jun 29, 2016 at 1:34 AM, Vijay Srinivasaraghavan
wrote:
> Hi Max,
> Yo
Hi,
the reason why the last element might never be emitted is the way the
ascending timestamp extractor works. I'll try and explain with an example.
Let's say we have a window size of 2 milliseconds, elements arrive starting
with timestamp 0, window begin timestamp is inclusive, end timestamp is
e
Cody created FLINK-4130:
---
Summary: CallGenerator could generate illegal code when taking no
operands
Key: FLINK-4130
URL: https://issues.apache.org/jira/browse/FLINK-4130
Project: Flink
Issue Type: Bu
@Fabian,
given the example that a user wants to sum a column whose value might be
null, with null check enabled. In this case, when the column value is null,
-1 is set instead? Am I understanding correctly?
On Wed, Jun 29, 2016 at 3:28 PM, Timo Walther wrote:
> Hi Cody,
>
> default values are n
Hi Cody,
default values are needed in cases where NULL values are not supported.
This happens if the null check is disabled in TableConfig for efficiency
reasons. Using 0 to DataType.MAX_VALUE for numeric types and -1 as a
NULL equivalent in special cases seems more reasonable to me.
Hope th
hi ,
Sorry for asking the quest here? Any answer will be apprecated.
Why different job's tasks can run in the single process. (There are some
different job's tasks in one TaskManager).It seems Flink-on-Yarn can let
different job run on different process. But for standalone mode, this problem
s
21 matches
Mail list logo
