[GitHub] flink pull request #3461: [FLINK-5954] Always assign names to the window in ...

2017-03-09 Thread haohui
Github user haohui closed the pull request at: https://github.com/apache/flink/pull/3461 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3461: [FLINK-5954] Always assign names to the window in the Str...

2017-03-09 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3461 Sorry for the late response. This is a prerequisite step for FLINK-6012 -- translating the group auxiliary functions (e.g., `TUMBLE_START`) to the corresponding Flink expressions (e.g., `WindowStart

[GitHub] flink pull request #3461: [FLINK-5954] Always assign names to the window in ...

2017-03-09 Thread haohui
GitHub user haohui reopened a pull request: https://github.com/apache/flink/pull/3461 [FLINK-5954] Always assign names to the window in the Stream SQL API. Please see jira for more details. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] flink pull request #3604: [FLINK-5998] Un-fat Hadoop from Flink fat jar

2017-03-23 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3604 [FLINK-5998] Un-fat Hadoop from Flink fat jar This PR implements FLINK-5998. It marks all Hadoop dependency in the dist jar as `provided` so that users can plug in the jars from their own

[GitHub] flink pull request #3613: [FLINK-5829] Bump Calcite version to 1.12 once ava...

2017-03-25 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3613 [FLINK-5829] Bump Calcite version to 1.12 once available. This PR bumps the Calcite version from 1.11 to 1.12. The main issue is that it conflicts with FLINK-4288, as the `tableMap` field

[GitHub] flink issue #3604: [FLINK-5998] Un-fat Hadoop from Flink fat jar

2017-03-27 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3604 @rmetzger -- thanks for the clarification. Do you think that it is sufficient to mark the dependency of `flink-shaded-hadoop2` as provided and produces a dedicated jar for it? --- If your project

[GitHub] flink pull request #3648: [FLINK-6217] ContaineredTaskManagerParameters sets...

2017-03-29 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3648 [FLINK-6217] ContaineredTaskManagerParameters sets off-heap memory size incorrectly You can merge this pull request into a Git repository by running: $ git pull https://github.com/haohui

[GitHub] flink issue #3648: [FLINK-6217] ContaineredTaskManagerParameters sets off-he...

2017-03-30 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3648 The failed tests are being addressed in FLINK-6175. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink issue #3655: [FLINK-6175] Harden HistoryServerTest#testFullArchiveLife...

2017-03-31 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3655 Looks good to me overall. Instead of changing in the normal code path, maybe it is a little bit less intrusive to use Mockito to change the field? For example: ``` JobArchiveFetcherTask

[GitHub] flink issue #3613: [FLINK-5829] Bump Calcite version to 1.12 once available.

2017-03-31 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3613 The failed test is unrelated to the changes. @twalthr @fhueske can you please take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] flink issue #3648: [FLINK-6217] ContaineredTaskManagerParameters sets off-he...

2017-04-03 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3648 The test failure seems unrelated. Cannot reproduce locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink pull request #3665: [FLINK-6011] Support TUMBLE, HOP, SESSION window i...

2017-04-03 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3665 [FLINK-6011] Support TUMBLE, HOP, SESSION window in streaming SQL. This PR adds supports for the `TUMBLE`, `HOP`, and `SESSION` windows in Flink. The work of supporting WindowStart and

[GitHub] flink pull request #3665: [FLINK-6011] Support TUMBLE, HOP, SESSION window i...

2017-04-04 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3665#discussion_r109810006 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/plan/rules/datastream/LogicalWindowAggregateRule.scala --- @@ -117,46 +119,86

[GitHub] flink pull request #3665: [FLINK-6011] Support TUMBLE, HOP, SESSION window i...

2017-04-05 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3665#discussion_r109857875 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/plan/rules/datastream/LogicalWindowAggregateRule.scala --- @@ -117,46 +119,86

[GitHub] flink issue #3675: [FLINK-6261] [table] Support TUMBLE, HOP, SESSION group w...

2017-04-05 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3675 Thanks for the PR! It looks good to me overall. One problem is that `dataSet.LogicalWindowAggregateRule` has duplicated quite a bit of code in the `dataStream.LogicalWindowAggregateRule

[GitHub] flink issue #3675: [FLINK-6261] [table] Support TUMBLE, HOP, SESSION group w...

2017-04-06 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3675 The PR looks pretty good. Thanks @fhueske for improving the documentation. +1 (non-binding) --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] flink issue #3675: [FLINK-6261] [table] Support TUMBLE, HOP, SESSION group w...

2017-04-06 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3675 Yes. I agree with you that `FLOOR` / `CEIL` are quite fragile and it is much clearer to use the `TUMBLING` / `HOP` / `SESSION` constructs. --- If your project is set up for it, you can reply to this

[GitHub] flink pull request #3693: [FLINK-6012] [table] Support WindowStart / WindowE...

2017-04-07 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3693 [FLINK-6012] [table] Support WindowStart / WindowEnd functions in streaming SQL You can merge this pull request into a Git repository by running: $ git pull https://github.com/haohui/flink

[GitHub] flink issue #3604: [FLINK-5998] Un-fat Hadoop from Flink fat jar

2017-04-11 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3604 @rmetzger ping...would you mind taking a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink pull request #3712: [FLINK-6281] Create TableSink for JDBC.

2017-04-11 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3712 [FLINK-6281] Create TableSink for JDBC. This PR implements the `StreamTableSink` interface for the JDBC connectors so that the streaming SQL APIs can directly interact with them. You can merge this

[GitHub] flink issue #3720: [FLINK-6302] Documentation build error on ruby 2.4

2017-04-21 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3720 I hit the same problem on my Mac. Let me try it out later today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink issue #3712: [FLINK-6281] Create TableSink for JDBC.

2017-04-21 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3712 Thanks for the review. I'm not aware of the fact that OutputFormats are not integrated with Flink's checkpointing mechanism. To address this problem, maybe we can do something simi

[GitHub] flink issue #3648: [FLINK-6217] ContaineredTaskManagerParameters sets off-he...

2017-04-21 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3648 Totally Agree :-) @StephanEwen please take another look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink pull request #3764: [FLINK-6335] Parse DISTINCT over grouped windows i...

2017-04-24 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3764 [FLINK-6335] Parse DISTINCT over grouped windows in stream SQL. This PR only supports parsing distinct aggregations over grouped windows. It essentially allows the `DataStreamAggregateRule` to

[GitHub] flink pull request #3765: [FLINK-6373] Add runtime support for distinct aggr...

2017-04-24 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3765 [FLINK-6373] Add runtime support for distinct aggregation over grouped windows You can merge this pull request into a Git repository by running: $ git pull https://github.com/haohui/flink

[GitHub] flink issue #3765: [FLINK-6373] Add runtime support for distinct aggregation...

2017-04-24 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3765 Note that this PR contains minimal amount of tests. Would love the feedbacks on what kinds of tests are required here. --- If your project is set up for it, you can reply to this email and have your

[GitHub] flink pull request #3767: [FLINK-6377] [table] Support map types in the Tabl...

2017-04-24 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3767 [FLINK-6377] [table] Support map types in the Table / SQL API This PR adds the supports of the map types in the Table / SQL API. It covers both the parsing and the runtime. One caveat is

[GitHub] flink issue #3720: [FLINK-6302] Documentation build error on ruby 2.4

2017-04-24 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3720 +1 (non-binding) Tested on OSX Sierra. The documentation builds successfully. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink issue #3712: [FLINK-6281] Create TableSink for JDBC.

2017-04-26 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3712 Thanks for your pointer of the prototype! > Do you intend to provide exactly-once guarantees for arbitrary updates? As I think about it a little bit more, I think it might make se

[GitHub] flink issue #3712: [FLINK-6281] Create TableSink for JDBC.

2017-04-27 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3712 Correct me if I'm wrong -- will something like the following work? ``` + @Override + public void snapshotState(FunctionSnapshotContext context) throws Exce

[GitHub] flink issue #3765: [FLINK-6373] Add runtime support for distinct aggregation...

2017-04-27 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3765 Updated the PR to codegen the parts used by distinct accumulator. Each column is calculated independently. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink issue #3746: [FLINK-4022] [kafka] Partition and topic discovery for Fl...

2017-05-09 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3746 Any updates on this? Would love to try this out :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink pull request #3748: [FLINK-6225] [Cassandra Connector] add CassandraTa...

2017-05-10 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3748#discussion_r115861002 --- Diff: flink-connectors/flink-connector-cassandra/pom.xml --- @@ -176,5 +176,23 @@ under the License

[GitHub] flink pull request #3748: [FLINK-6225] [Cassandra Connector] add CassandraTa...

2017-05-11 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3748#discussion_r115927398 --- Diff: flink-connectors/flink-connector-cassandra/pom.xml --- @@ -176,5 +176,23 @@ under the License

[GitHub] flink pull request #3748: [FLINK-6225] [Cassandra Connector] add CassandraTa...

2017-05-11 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3748#discussion_r115935549 --- Diff: flink-connectors/flink-connector-cassandra/src/test/java/org/apache/flink/streaming/connectors/cassandra/CassandraConnectorITCase.java

[GitHub] flink pull request #3748: [FLINK-6225] [Cassandra Connector] add CassandraTa...

2017-05-11 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3748#discussion_r116092436 --- Diff: flink-connectors/flink-connector-cassandra/src/test/java/org/apache/flink/streaming/connectors/cassandra/CassandraConnectorITCase.java

[GitHub] flink pull request #3879: [FLINK-6562] Support implicit table references for...

2017-05-11 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3879 [FLINK-6562] Support implicit table references for nested fields in SQL. You can merge this pull request into a Git repository by running: $ git pull https://github.com/haohui/flink FLINK-6562

[GitHub] flink pull request #3252: [FLINK-5624] Support tumbling window on streaming ...

2017-02-13 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3252#discussion_r100917108 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/codegen/calls/FunctionGenerator.scala --- @@ -290,6 +291,15 @@ object

[GitHub] flink issue #3252: [FLINK-5624] Support tumbling window on streaming tables ...

2017-02-13 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3252 The v3 PR gets the best from both of the worlds -- the code generator will throw exceptions if the queries actually execute the `rowtime()`. Essentially it rewrites the project and the

[GitHub] flink issue #3252: [FLINK-5624] Support tumbling window on streaming tables ...

2017-02-14 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3252 Discussed with @fhueske offline. Thanks a lot for the comments. The V4 PR implements the following: * Rebased on top of #3101 * `LogicalWindowAggregateRule` implements `RelOptRule

[GitHub] flink pull request #3314: [FLINK-3679] DeserializationSchema should handle z...

2017-02-14 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3314 [FLINK-3679] DeserializationSchema should handle zero or more outputs This PR adds a new interface, `RichKeyedDeserializationSchema`, to enable the deserializer to produce zero or more outputs. The

[GitHub] flink issue #3338: [FLINK-5414] [table] Bump up Calcite version to 1.11

2017-02-17 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3338 Looks good to me overall. One question -- I wonder, does it mean that all array types become nullable after this change? --- If your project is set up for it, you can reply to this email and have

[GitHub] flink pull request #3370: [FLINK-5710] Add ProcTime() function to indicate S...

2017-02-20 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3370 [FLINK-5710] Add ProcTime() function to indicate StreamSQL. This is the commit we used internally -- There is no unit tests associated with this PR. It simply serves as a reference point for #3302

[GitHub] flink issue #3302: [FLINK-5710] Add ProcTime() function to indicate StreamSQ...

2017-02-20 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3302 FYI: #3370 is the commit we use internally for this feature. Please feel free to take it if it helps implementing this PR. --- If your project is set up for it, you can reply to this email and have

[GitHub] flink pull request #3338: [FLINK-5414] [table] Bump up Calcite version to 1....

2017-02-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3338#discussion_r102117236 --- Diff: flink-libraries/flink-table/src/test/scala/org/apache/flink/table/ExpressionReductionTest.scala --- @@ -155,15 +155,15 @@ class

[GitHub] flink pull request #3338: [FLINK-5414] [table] Bump up Calcite version to 1....

2017-02-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3338#discussion_r102125031 --- Diff: flink-libraries/flink-table/src/test/scala/org/apache/flink/table/ExpressionReductionTest.scala --- @@ -155,15 +155,15 @@ class

[GitHub] flink pull request #3314: [FLINK-3679] DeserializationSchema should handle z...

2017-02-21 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3314#discussion_r102299038 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/SimpleConsumerThread.java

[GitHub] flink pull request #3370: [FLINK-5710] Add ProcTime() function to indicate S...

2017-02-23 Thread haohui
Github user haohui closed the pull request at: https://github.com/apache/flink/pull/3370 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #3314: [FLINK-3679] DeserializationSchema should handle z...

2017-02-23 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3314#discussion_r102830609 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/SimpleConsumerThread.java

[GitHub] flink pull request #3370: [FLINK-5710] Add ProcTime() function to indicate S...

2017-02-23 Thread haohui
GitHub user haohui reopened a pull request: https://github.com/apache/flink/pull/3370 [FLINK-5710] Add ProcTime() function to indicate StreamSQL. This is the commit we used internally -- There is no unit tests associated with this PR. It simply serves as a reference point for #3302

[GitHub] flink pull request #3314: [FLINK-3679] DeserializationSchema should handle z...

2017-02-23 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3314#discussion_r102881264 --- Diff: flink-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/SimpleConsumerThread.java

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2017-02-27 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3314 @rmetzger ping... just wondering what do you think about all the approaches we have discussed here? Your comments are appreciated. --- If your project is set up for it, you can reply to this

[GitHub] flink pull request #3426: [FLINK-5414] [table] Bump up Calcite version to 1....

2017-02-27 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3426 [FLINK-5414] [table] Bump up Calcite version to 1.11 This PR resembles #3338 except that it canonizes the nullable types. @wuchong can you please take a look? You can merge this pull

[GitHub] flink pull request #3314: [FLINK-3679] DeserializationSchema should handle z...

2017-02-27 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/3314#discussion_r103339489 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/util/serialization/RichKeyedDeserializationSchema.java

[GitHub] flink issue #3426: [FLINK-5414] [table] Bump up Calcite version to 1.11

2017-03-02 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3426 Sorry stuck with something. Will update the PR in a day or two. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2017-03-02 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3314 Thanks for the comments. Allowing `DeserializationSchema` to return `null` sounds good to me. I'll update the PR accordingly. --- If your project is set up for it, you can reply to this emai

[GitHub] flink issue #3426: [FLINK-5414] [table] Bump up Calcite version to 1.11

2017-03-02 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3426 Fix the unit tests. There are two additional changes: 1. There are precision differences when converting `double` to `BigDecimal`. Fix the unit tests. 2. When registering UDFs

[GitHub] flink pull request #3461: [FLINK-5954] Always assign names to the window in ...

2017-03-02 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3461 [FLINK-5954] Always assign names to the window in the Stream SQL API. Please see jira for more details. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2017-03-07 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3314 CI failed in one of the group as the group was timed out. The specific group was not timed out in the last run. @tzulitai can you please take another look? Thanks --- If your project is set

[GitHub] flink issue #3426: [FLINK-5414] [table] Bump up Calcite version to 1.11

2017-03-07 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3426 @twalthr can you please take another look? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink issue #3314: [FLINK-3679] DeserializationSchema should handle zero or ...

2017-03-08 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3314 Yes totally agree. Thanks very much for taking the time to review the PRs. Will do it next time. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] flink pull request #3123: [FLINK-5489] maven release:prepare fails due to in...

2017-01-13 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3123 [FLINK-5489] maven release:prepare fails due to invalid JDOM comments… When I was trying to publish Flink to our internal artifactory, I found out that maven release:prepare has failed because the

[GitHub] flink pull request #3202: [FLINK-5631] [yarn] Support downloading additional...

2017-01-24 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3202 [FLINK-5631] [yarn] Support downloading additional jars from non-HDFS… This PR enables Flink to support downloading additional jars from non-HDFS paths (e.g., S3, viewfs). More details are

[GitHub] flink issue #3202: [FLINK-5631] [yarn] Support downloading additional jars f...

2017-01-31 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3202 Thanks for the reviews. It's more about readability of the code itself instead of testing and visibility. The two functions are fairly long and basically identical. Therefore I refacto

[GitHub] flink pull request #3252: [FLINK-5624] Support tumbling window on streaming ...

2017-02-01 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/flink/pull/3252 [FLINK-5624] Support tumbling window on streaming tables in the SQL API. This is a POC to add tumbling window support for streaming tables in SQL. Essentially it recognizes the

[GitHub] flink issue #3252: [FLINK-5624] Support tumbling window on streaming tables ...

2017-02-06 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3252 Updated the PR to recognize the `GROUP BY` clause instead of the `OVER` clause. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink issue #3252: [FLINK-5624] Support tumbling window on streaming tables ...

2017-02-07 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/3252 Adding `ROWTIME()` as an expression to enable users to specify event time windows. After trying multiple approaches at the end I settled down with translating `LogicalAggregate` directly to

[GitHub] flink pull request #4638: [FLINK-6563] [table] Add time indicator support to...

2017-09-18 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4638#discussion_r139532226 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/KafkaTableSource.java --- @@ -106,8 +240,191

[GitHub] flink pull request #4638: [FLINK-6563] [table] Add time indicator support to...

2017-09-18 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4638#discussion_r139553991 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/KafkaTableSource.java --- @@ -106,8 +240,191

[GitHub] flink pull request #4638: [FLINK-6563] [table] Add time indicator support to...

2017-09-19 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4638#discussion_r139625581 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/KafkaTableSource.java --- @@ -106,8 +240,191

[GitHub] flink pull request #4638: [FLINK-6563] [table] Add time indicator support to...

2017-09-19 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4638#discussion_r139629938 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/KafkaTableSource.java --- @@ -106,8 +240,191

[GitHub] flink issue #4710: [FLINK-7446] [table] Change DefinedRowtimeAttribute to wo...

2017-09-24 Thread haohui
Github user haohui commented on the issue: https://github.com/apache/flink/pull/4710 LGTM overall +1. One question: since we now cast `ROWTIME` / `PROCTIME` directly to `LONG`, I wonder, do we want to revisit the decision that creates dedicated types for `ROWTIME

[GitHub] flink pull request #4683: [FLINK-5944] Support reading of Snappy files

2017-09-24 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4683#discussion_r140649772 --- Diff: flink-core/pom.xml --- @@ -52,6 +52,12 @@ under the License. flink-shaded-asm

[GitHub] flink pull request #4683: [FLINK-5944] Support reading of Snappy files

2017-09-24 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4683#discussion_r140696992 --- Diff: flink-core/pom.xml --- @@ -52,6 +52,12 @@ under the License. flink-shaded-asm

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697367 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699558 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699619 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140698379 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699738 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699577 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697889 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140698040 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699511 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697494 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697648 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140698914 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcUtils.java --- @@ -0,0 +1,2229 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140700434 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcUtils.java --- @@ -0,0 +1,2229 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699131 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcUtils.java --- @@ -0,0 +1,2229 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699592 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140700317 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcUtils.java --- @@ -0,0 +1,2229 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140700095 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699826 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697199 --- Diff: flink-connectors/flink-orc/pom.xml --- @@ -0,0 +1,152 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699375 --- Diff: flink-connectors/flink-orc/pom.xml --- @@ -0,0 +1,152 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140698526 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697150 --- Diff: flink-connectors/flink-orc/pom.xml --- @@ -0,0 +1,152 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699402 --- Diff: flink-connectors/flink-orc/pom.xml --- @@ -0,0 +1,152 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140699453 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140698436 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/RowOrcInputFormat.java --- @@ -0,0 +1,241 @@ +/* + * Licensed to the Apache

[GitHub] flink pull request #4670: [FLINK-2170] [connectors] Add ORC connector for Ta...

2017-09-25 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/flink/pull/4670#discussion_r140697285 --- Diff: flink-connectors/flink-orc/src/main/java/org/apache/flink/orc/OrcTableSource.java --- @@ -0,0 +1,128 @@ +/* + * Licensed to the Apache

  1   2   3   >