[jira] [Created] (FLINK-24485) COUNT(DISTINCT) should support binary field

2021-10-08 Thread Haohui Mai (Jira)
Haohui Mai created FLINK-24485: -- Summary: COUNT(DISTINCT) should support binary field Key: FLINK-24485 URL: https://issues.apache.org/jira/browse/FLINK-24485 Project: Flink Issue Type

[jira] [Created] (FLINK-24456) Support bounded offset in the Kafka table connector

2021-10-05 Thread Haohui Mai (Jira)
Haohui Mai created FLINK-24456: -- Summary: Support bounded offset in the Kafka table connector Key: FLINK-24456 URL: https://issues.apache.org/jira/browse/FLINK-24456 Project: Flink Issue Type

Re: [ANNOUNCE] New committer: Haohui Mai

2017-11-02 Thread Haohui Mai
gt; On behalf of the PMC I am delighted to announce Haohui Mai as a new Flink > > committer! > > > > Haohui has been an active member of our community for several months. > > Among other things, he made major contributions in ideas and code to the > > SQL and Table

[jira] [Created] (FLINK-7787) Remove guava dependency in the cassandra connector

2017-10-09 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7787: - Summary: Remove guava dependency in the cassandra connector Key: FLINK-7787 URL: https://issues.apache.org/jira/browse/FLINK-7787 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7743) Remove the restriction of minimum memory of JM

2017-09-30 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7743: - Summary: Remove the restriction of minimum memory of JM Key: FLINK-7743 URL: https://issues.apache.org/jira/browse/FLINK-7743 Project: Flink Issue Type: Bug

Re: Support for multiple HDFS

2017-09-24 Thread Haohui Mai
You can definitely use absolute URIs to access two clusters. The configuration just has to be the union of multiple HDFS clusters (e.g., the NameNode lists) Accessing both secure and non-secure clusters are fairly tricky but it can be done. AFAIK Isolating the Hadoop configuration will require a

[jira] [Created] (FLINK-7392) Enable more predicate push-down in joins

2017-08-08 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7392: - Summary: Enable more predicate push-down in joins Key: FLINK-7392 URL: https://issues.apache.org/jira/browse/FLINK-7392 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7344) Migrate usage of joda-time to the Java 8 DateTime API

2017-08-02 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7344: - Summary: Migrate usage of joda-time to the Java 8 DateTime API Key: FLINK-7344 URL: https://issues.apache.org/jira/browse/FLINK-7344 Project: Flink Issue Type

[jira] [Created] (FLINK-7237) Remove DateTimeUtils from Flink once Calcite is upgraded to 1.14

2017-07-19 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7237: - Summary: Remove DateTimeUtils from Flink once Calcite is upgraded to 1.14 Key: FLINK-7237 URL: https://issues.apache.org/jira/browse/FLINK-7237 Project: Flink

[jira] [Created] (FLINK-7236) Bump up the Calcite version to 1.14

2017-07-19 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7236: - Summary: Bump up the Calcite version to 1.14 Key: FLINK-7236 URL: https://issues.apache.org/jira/browse/FLINK-7236 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7235) Backport CALCITE-1884 to the Flink repository before Calcite 1.14

2017-07-19 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7235: - Summary: Backport CALCITE-1884 to the Flink repository before Calcite 1.14 Key: FLINK-7235 URL: https://issues.apache.org/jira/browse/FLINK-7235 Project: Flink

[jira] [Created] (FLINK-7159) Semantics of OVERLAPS in Table API diverge from the SQL standard

2017-07-11 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7159: - Summary: Semantics of OVERLAPS in Table API diverge from the SQL standard Key: FLINK-7159 URL: https://issues.apache.org/jira/browse/FLINK-7159 Project: Flink

Re: [ANNOUNCE] New Flink PMC member: Tzu-Li (Gordon) Tai

2017-07-10 Thread Haohui Mai
Congrats! On Mon, Jul 10, 2017 at 11:17 PM Dawid Wysakowicz < wysakowicz.da...@gmail.com> wrote: > Congrats, Gordon! >

Re: [ANNOUNCE] New Flink committer Jincheng Sun

2017-07-10 Thread Haohui Mai
Congrats! On Mon, Jul 10, 2017 at 11:33 PM Shaoxuan Wang wrote: > Congratulations, Jincheng! > > > On Tue, Jul 11, 2017 at 2:01 PM, Zhuoluo Yang > > wrote: > > > Congrats, Jincheng! > > > > Thanks, > > > > Zhuoluo 😀 > > > > > > > > > > > > 在 2017年7月11日,上午9:51,Jark 写道: > > > > Welcome on board

Re: [DISCUSS] Release 1.3.2 planning

2017-07-07 Thread Haohui Mai
PR which should be included in the next bug fix release > for the Table API: > >> https://issues.apache.org/jira/browse/FLINK-7005 > >> > >> Timo > >> > >> Am 23.06.17 um 14:09 schrieb Robert Metzger: > >>> Thanks Haohui. > >>> >

Re: [DISCUSS] Release 1.3.2 planning

2017-06-22 Thread Haohui Mai
Hi, Release management is though, I'm happy to help. Are there any timelines you have in mind? Haohui On Fri, Jun 23, 2017 at 12:01 AM Robert Metzger wrote: > Hi all, > > with the 1.3.1 release on the way, we can start thinking about the 1.3.2 > release. > > We have already one issue that shoul

Re: [ANNOUNCE] New Flink committer Shaoxuan Wang

2017-06-21 Thread Haohui Mai
Congrats! On Thu, Jun 22, 2017 at 9:58 AM SHI Xiaogang wrote: > Congrats, Shaoxuan > > Regards, > Xiaogang > > 2017-06-22 9:08 GMT+08:00 jincheng sun : > > > Congratulations Shaoxuan. > > > > > > 2017-06-22 8:56 GMT+08:00 Zhangrucong : > > > > > Congrats Shaoxuan! > > > > > > -邮件原件- > > >

Re: [ANNOUNCE] New committer: Dawid Wysakowicz

2017-06-21 Thread Haohui Mai
Congrats! On Thu, Jun 22, 2017 at 5:51 AM Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > Congratulations Dawid! > > On Tue, Jun 20, 2017 at 12:06 PM, Vasudevan, Ramkrishna S < > ramkrishna.s.vasude...@intel.com> wrote: > > > Congratulations !! > > > > -Original Message- > > From:

Re: [DISCUSS] Table API / SQL features for Flink 1.4.0

2017-06-21 Thread Haohui Mai
Hi, We are interested in building the simplest case of stream-table joins -- essentially calling stream.map(x => (x, table.get(x)). It solves the use cases of augmenting the streams with the information of the database. The operation itself can be batched for better performance. We are happy to c

Re: [POLL] Who still uses Java 7 with Flink ?

2017-06-08 Thread Haohui Mai
+1 There are several high impacts security vulnerabilities in JDK 7 and will not be addressed. As a result we completely moved away from JDK 7. +1 on separating the tasks of supporting Scala 2.12 and JDK 8 in two steps. On Thu, Jun 8, 2017 at 9:53 AM Greg Hogan wrote: > Is this not two diffe

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Haohui Mai
Hi, We have discovered https://issues.apache.org/jira/browse/FLINK-6780 which effectively makes external catalogs in the table API very difficult to use. It may not be a show stopper but in my opinion it is worth a fix before the release. Regards, Haohui On Tue, May 30, 2017 at 11:22 AM Till Ro

[jira] [Created] (FLINK-6780) ExternalTableSource fails to add the processing time and the event time attribute in the row type

2017-05-30 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6780: - Summary: ExternalTableSource fails to add the processing time and the event time attribute in the row type Key: FLINK-6780 URL: https://issues.apache.org/jira/browse/FLINK-6780

[jira] [Created] (FLINK-6693) Support DATE_FORMAT function in the SQL API

2017-05-23 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6693: - Summary: Support DATE_FORMAT function in the SQL API Key: FLINK-6693 URL: https://issues.apache.org/jira/browse/FLINK-6693 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-6692) The flink-dist jar contains unshaded nettyjar

2017-05-23 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6692: - Summary: The flink-dist jar contains unshaded nettyjar Key: FLINK-6692 URL: https://issues.apache.org/jira/browse/FLINK-6692 Project: Flink Issue Type: Bug

Re: [DISCUSS] Reorganize Table API / SQL documentation

2017-05-18 Thread Haohui Mai
+1 The Table / SQL component has made significant progress in the last few months (kudos to all contributors). It is a good time to have a documentation to reflect all the changes in the Table / SQL side. On Thu, May 18, 2017 at 8:12 AM Robert Metzger wrote: > Thank you Fabian for working on

[jira] [Created] (FLINK-6605) Allow users to specify a default name for processing time

2017-05-16 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6605: - Summary: Allow users to specify a default name for processing time Key: FLINK-6605 URL: https://issues.apache.org/jira/browse/FLINK-6605 Project: Flink Issue Type

[jira] [Created] (FLINK-6595) Nested SQL queries do not expose proctime / rowtime attributes

2017-05-15 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6595: - Summary: Nested SQL queries do not expose proctime / rowtime attributes Key: FLINK-6595 URL: https://issues.apache.org/jira/browse/FLINK-6595 Project: Flink

[jira] [Created] (FLINK-6574) External catalog should support a single level catalog

2017-05-12 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6574: - Summary: External catalog should support a single level catalog Key: FLINK-6574 URL: https://issues.apache.org/jira/browse/FLINK-6574 Project: Flink Issue Type

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-11 Thread Haohui Mai
Hi, Just curious -- do we have anything to track the blockers on the table / SQL side? For example, it seems to me that FLINK-6563 is a blocker because all group windows in SQL will not work without it. I think that Fabian / Timo might want to get several jiras into 1.3. Regards, Haohui On Thu,

[jira] [Created] (FLINK-6563) Expose time indicator attributes in the KafkaTableSource

2017-05-11 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6563: - Summary: Expose time indicator attributes in the KafkaTableSource Key: FLINK-6563 URL: https://issues.apache.org/jira/browse/FLINK-6563 Project: Flink Issue Type

[jira] [Created] (FLINK-6562) Support implicit table references for nested fields in SQL

2017-05-11 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6562: - Summary: Support implicit table references for nested fields in SQL Key: FLINK-6562 URL: https://issues.apache.org/jira/browse/FLINK-6562 Project: Flink Issue

Re: [DISCUSS] Feature Freeze

2017-04-27 Thread Haohui Mai
Hello, Thanks for starting this thread. It would be great to see the following features available in Flink 1.3: * Support for complex schema: FLINK-6033, FLINK-6377 * Various improvements on SQL over group windows: FLINK-6335, FLINK-6373 * StreamTableSink for JDBC and Cassandra: FLINK-6281, FLINK

[jira] [Created] (FLINK-6377) Support map types in the Table / SQL API

2017-04-24 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6377: - Summary: Support map types in the Table / SQL API Key: FLINK-6377 URL: https://issues.apache.org/jira/browse/FLINK-6377 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-6373) Add runtime support for distinct aggregation over grouped windows

2017-04-24 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6373: - Summary: Add runtime support for distinct aggregation over grouped windows Key: FLINK-6373 URL: https://issues.apache.org/jira/browse/FLINK-6373 Project: Flink

[jira] [Created] (FLINK-6335) Support DISTINCT over grouped window in stream SQL

2017-04-20 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6335: - Summary: Support DISTINCT over grouped window in stream SQL Key: FLINK-6335 URL: https://issues.apache.org/jira/browse/FLINK-6335 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6281) Create TableSink for JDBC

2017-04-07 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6281: - Summary: Create TableSink for JDBC Key: FLINK-6281 URL: https://issues.apache.org/jira/browse/FLINK-6281 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6217) ContaineredTaskManagerParameters sets off heap memory size incorrectly

2017-03-29 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6217: - Summary: ContaineredTaskManagerParameters sets off heap memory size incorrectly Key: FLINK-6217 URL: https://issues.apache.org/jira/browse/FLINK-6217 Project: Flink

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-28 Thread Haohui Mai
-1 (non-binding) We recently found out that all jobs submitted via UI will have a parallelism of 1, potentially due to FLINK-5808. Filed FLINK-6209 to track it. ~Haohui On Mon, Mar 27, 2017 at 2:59 AM Chesnay Schepler wrote: > If possible I would like to include FLINK-6183 & FLINK-6184 as wel

[jira] [Created] (FLINK-6209) StreamPlanEnvironment always has a parallelism of 1

2017-03-28 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6209: - Summary: StreamPlanEnvironment always has a parallelism of 1 Key: FLINK-6209 URL: https://issues.apache.org/jira/browse/FLINK-6209 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New committer: Theodore Vasiloudis

2017-03-21 Thread Haohui Mai
Congrats! On Tue, Mar 21, 2017 at 11:01 AM Matthias J. Sax wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > Congrats! > > On 3/21/17 8:59 AM, Greg Hogan wrote: > > Welcome, Theo, and great to have you onboard with Flink and ML! > > > > > >> On Mar 21, 2017, at 4:35 AM, Robert Metzg

[jira] [Created] (FLINK-6033) Support UNNEST query in the stream SQL api

2017-03-13 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6033: - Summary: Support UNNEST query in the stream SQL api Key: FLINK-6033 URL: https://issues.apache.org/jira/browse/FLINK-6033 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6012) Support WindowStart / WindowEnd functions in stream SQL

2017-03-09 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6012: - Summary: Support WindowStart / WindowEnd functions in stream SQL Key: FLINK-6012 URL: https://issues.apache.org/jira/browse/FLINK-6012 Project: Flink Issue Type

[jira] [Created] (FLINK-6011) Support TUMBLE, HOP, SESSION window in streaming SQL

2017-03-09 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-6011: - Summary: Support TUMBLE, HOP, SESSION window in streaming SQL Key: FLINK-6011 URL: https://issues.apache.org/jira/browse/FLINK-6011 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-5954) Always assign names to the window in the Stream SQL APi

2017-03-02 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5954: - Summary: Always assign names to the window in the Stream SQL APi Key: FLINK-5954 URL: https://issues.apache.org/jira/browse/FLINK-5954 Project: Flink Issue Type

[jira] [Created] (FLINK-5931) Make Flink highly available even if defaultFS is unavailable

2017-02-27 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5931: - Summary: Make Flink highly available even if defaultFS is unavailable Key: FLINK-5931 URL: https://issues.apache.org/jira/browse/FLINK-5931 Project: Flink Issue

Re: [DISCUSS] Table API / SQL indicators for event and processing time

2017-02-14 Thread Haohui Mai
Hi, Thanks for starting the discussion. I can see there are multiple trade-offs in these two approaches. One question I have is that to which extent Flink wants to open its APIs to allow users to access both processing and event time. Before we talk about joins, my understanding for the two appro

Re: [ANNOUNCE] Welcome Stefan Richter as a new committer

2017-02-10 Thread Haohui Mai
Congrats! On Fri, Feb 10, 2017 at 8:08 AM Henry Saputra wrote: > Congrats and welcome! > > On Fri, Feb 10, 2017 at 7:45 AM, Tzu-Li (Gordon) Tai > wrote: > > > Great news! Welcome Stefan :-D > > > > > > On February 10, 2017 at 11:36:14 PM, Aljoscha Krettek ( > aljos...@apache.org) > > wrote: > >

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Haohui Mai
Congratulations! On Tue, Feb 7, 2017 at 12:17 PM Fabian Hueske wrote: > Hi everybody, > > I'm very happy to announce that Jark Wu and Kostas Kloudas accepted the > invitation of the Flink PMC to become committers of the Apache Flink > project. > > Jark and Kostas are longtime members of the Flin

[jira] [Created] (FLINK-5725) Support JOIN between two streams in the SQL API

2017-02-06 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5725: - Summary: Support JOIN between two streams in the SQL API Key: FLINK-5725 URL: https://issues.apache.org/jira/browse/FLINK-5725 Project: Flink Issue Type: New

Re: [DISCUSS] (Not) tagging reviewers

2017-01-25 Thread Haohui Mai
+1. Nice to be pinged if required, but relying on specific people to review simply does not scale. Popping up one level, occasionally the fact that people tag other people is because the PRs are left unreviewed for a while (or they believe the PRs will not be reviewed unless they explicitly ping o

[jira] [Created] (FLINK-5631) [yarn] Support downloading additional jars from non-HDFS paths

2017-01-24 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5631: - Summary: [yarn] Support downloading additional jars from non-HDFS paths Key: FLINK-5631 URL: https://issues.apache.org/jira/browse/FLINK-5631 Project: Flink

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

2017-01-23 Thread Haohui Mai
that the Calcite / Azure Stream Analytics have introduced a new construct (TUMBLE / TUMBLINGWINDOW) to address this issue. Do you think it is a good idea to follow the same conventions? Your ideas are appreciated. Regards, Haohui On Mon, Jan 23, 2017 at 1:02 PM Haohui Mai wrote: > +1 &g

Re: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

2017-01-23 Thread Haohui Mai
+1 We are also quite interested in these features and would love to participate and contribute. ~Haohui On Mon, Jan 23, 2017 at 7:31 AM Fabian Hueske wrote: > Hi everybody, > > it seems that currently several contributors are working on new features > for the streaming Table API / SQL around r

Re: [DISCUSS] (Not) tagging reviewers

2017-01-20 Thread Haohui Mai
Hi, Usually this problem can be well addressed by growing the community. We Just wondering whether there is a wiki to describe how non-committers can help on reviewing the patches? I'm glad to help out on reviewing patches. Regards, Haohui On Fri, Jan 20, 2017 at 7:42 AM Stephan Ewen wrote: >

[jira] [Created] (FLINK-5583) Support flexible error handling in the Kafka consumer

2017-01-19 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5583: - Summary: Support flexible error handling in the Kafka consumer Key: FLINK-5583 URL: https://issues.apache.org/jira/browse/FLINK-5583 Project: Flink Issue Type

Becoming a contributor JIRA

2017-01-13 Thread Haohui Mai
Hi, I'm interested in contributing to Flink. I wonder, is it possible that someone can add me as a contributor in the Flink project so that I can assign jiras to myself? Your help is highly appreciated. Regards, Haohui

[jira] [Created] (FLINK-5489) maven release:prepare fails due to invalid JDOM comments in pom.xml

2017-01-13 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-5489: - Summary: maven release:prepare fails due to invalid JDOM comments in pom.xml Key: FLINK-5489 URL: https://issues.apache.org/jira/browse/FLINK-5489 Project: Flink

Re: Status of Flink-Calcite integration

2016-12-20 Thread Haohui Mai
me know if you have any questions. > > Cheers, Fabian > > [1] http://flink.apache.org/news/2016/05/24/stream-sql.html > [2] > > http://www.slideshare.net/FlinkForward/fabian-hueske-taking-a-look-under-the-hood-of-apache-flinks-relational-apis > [3] > > https://docs.googl

Status of Flink-Calcite integration

2016-12-19 Thread Haohui Mai
Hi, We are currently exploring on building a streaming SQL solution on top of Flink. We think that Flink is a good fit for the problem. I'm curious about what is the status on the Flink-Calcite integration right now? Is it being actively developed and on the road map? We are also very open to co