Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-27 Thread Wei Zhong
Congratulations Dian! > 在 2020年8月28日,14:29,Jingsong Li 写道: > > Congratulations , Dian! > > Best, Jingsong > > On Fri, Aug 28, 2020 at 11:06 AM Walter Peng > wrote: > congrats! > > Yun Tang wrote: > > Congratulations , Dian! > > > -- > Best, Jingsong Lee

Re: PyFlink - Scala UDF - How to convert Scala Map in Table API?

2020-11-17 Thread Wei Zhong
Hi Pierre, You can try to replace the '@DataTypeHint("ROW")' with '@FunctionHint(output = new DataTypeHint("ROW”))' Best, Wei > 在 2020年11月17日,15:45,Pierre Oberholzer 写道: > > Hi Dian, Community, > > (bringing the thread back to wider audience) > > As you suggested, I've tried to use DataType

Re: PyFlink - Scala UDF - How to convert Scala Map in Table API?

2020-11-17 Thread Wei Zhong
mmyMap() extends ScalarFunction { > def eval(): Row = { > Row.of(java.lang.String.valueOf("foo"), java.lang.String.valueOf("bar")) > } > } > > Best regards, > > Le mar. 17 nov. 2020 à 10:04, Wei Zhong <mailto:weizhong0...@gmail.com>> a écrit

Re: PyFlink - Scala UDF - How to convert Scala Map in Table API?

2020-11-17 Thread Wei Zhong
Types.AbstractField*)org.apache.flink.table.types.UnresolvedDataType > > [error] ()org.apache.flink.table.types.DataType > [error] (x$1: > org.apache.flink.table.api.DataTypes.Field*)org.apache.flink.table.types.DataType > [error] cannot be applied to (org.apache.flink.table.types.DataType, > org.apache.fli

Re: PyFlink - Scala UDF - How to convert Scala Map in Table API?

2020-11-18 Thread Wei Zhong
> Type conversions working: > - scala.collection.immutable.Map[String,String] => org.apache.flink.types.Row > => ROW > - scala.collection.immutable.Map[String,String] => > java.util.Map[String,String] => MAP > > Any hint for Map[String,Any] ? > > Best r

Re: Urgent help on S3 CSV file reader DataStream Job

2020-12-07 Thread Wei Zhong
Hi Deep, (redirecting this to user mailing list as this is not a dev question) You can try to set the line delimiter and field delimiter of the RowCsvInputFormat to a non-printing character (assume there is no non-printing characters in the csv files). It will read all the content of a csv file

Re: Urgent help on S3 CSV file reader DataStream Job

2020-12-07 Thread Wei Zhong
& Regards, > -Deep > > > On Mon, Dec 7, 2020 at 6:38 PM Till Rohrmann wrote: > Hi Deep, > > Could you use the TextInputFormat which reads a file line by line? That way > you can do the JSON parsing as part of a mapper which consumes the file > lines. > > Cheers,

Re: Urgent help on S3 CSV file reader DataStream Job

2020-12-08 Thread Wei Zhong
t()) { > return true; >} else { > throw new ParseException("Row too short: " + new String(bytes, offset, > numBytes, getCharset())); >} > } > Let me know if you need any details. > Thanks, > -Deep > > > > > > On Tue,

Re: [ANNOUNCE] Apache Flink 1.12.0 released

2020-12-10 Thread Wei Zhong
Congratulations! Thanks Dian and Robert for the great work! Best, Wei > 在 2020年12月10日,20:26,Leonard Xu 写道: > > > Thanks Dian and Robert for the great work as release manager ! > And thanks everyone who makes the release possible ! > > > Best, > Leonard > >> 在 2020年12月10日,20:17,Robert Metz

Re: Urgent help on S3 CSV file reader DataStream Job

2020-12-16 Thread Wei Zhong
Deep > > On Mon, 14 Dec, 2020, 10:28 AM DEEP NARAYAN Singh, <mailto:about.d...@gmail.com>> wrote: > Hi Wei, > No problem at all.Thanks for your response. > Yes ,it is just starting from the beginning like no check pointing finished. > > Thanks, > -Deep >

Re: [ANNOUNCE] Apache Flink 1.12.1 released

2021-01-19 Thread Wei Zhong
Thanks Xintong for the great work! Best, Wei > 在 2021年1月19日,18:00,Guowei Ma 写道: > > Thanks Xintong's effort! > Best, > Guowei > > > On Tue, Jan 19, 2021 at 5:37 PM Yangze Guo > wrote: > Thanks Xintong for the great work! > > Best, > Yangze Guo > > On Tue, Jan 19,

Re: [ANNOUNCE] Apache Flink 1.11.1 released

2020-07-22 Thread Wei Zhong
Congratulations! Thanks Dian for the great work! Best, Wei > 在 2020年7月22日,15:09,Leonard Xu 写道: > > Congratulations! > > Thanks Dian Fu for the great work as release manager, and thanks everyone > involved! > > Best > Leonard Xu > >> 在 2020年7月22日,14:52,Dian Fu 写道: >> >> The Apache Flink co

Re: PyFlink DDL UDTF join error

2020-07-28 Thread Wei Zhong
Hi Manas, It seems like a bug. You can try to replace the udtf sql call with such code as a workaround currently: t_env.register_table("tmp_view", t_env.from_path(f"{INPUT_TABLE}").join_lateral("split(data) as (featureName, featureValue)")) This works for me. I’ll try to find out what caused

Re: PyFlink DDL UDTF join error

2020-07-29 Thread Wei Zhong
28日,21:19,Wei Zhong 写道: > > Hi Manas, > > It seems like a bug. You can try to replace the udtf sql call with such code > as a workaround currently: > > t_env.register_table("tmp_view", > t_env.from_path(f"{INPUT_TABLE}").join_lateral("split(data

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

2020-08-05 Thread Wei Zhong
; >> Thanks a lot for bringing up this discussion and the proposal. +1 to > >>> >> improve the Python API doc. > >>> >> > >>> >> I have received many feedbacks from PyFlink beginners about > >>> >> the PyFlink doc, e.g. the mate

Re: Install/Run Streaming Anomaly Detection R package in Flink

2021-02-23 Thread Wei Zhong
chatryan 写道: > > Hi, > > I'm pulling in Wei Zhong and Xingbo Huang who know PyFlink better. > > Regards, > Roman > > > On Mon, Feb 22, 2021 at 3:01 PM Robert Cullen <mailto:cinquate...@gmail.com>> wrote: > My customer wants us to instal

Re: [ANNOUNCE] Apache Flink 1.8.3 released

2019-12-11 Thread Wei Zhong
Thanks Hequn for being the release manager. Great work! Best, Wei > 在 2019年12月12日,15:27,Jingsong Li 写道: > > Thanks Hequn for your driving, 1.8.3 fixed a lot of issues and it is very > useful to users. > Great work! > > Best, > Jingsong Lee > > On Thu, Dec 12, 2019 at 3:25 PM jincheng sun

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

2020-01-16 Thread Wei Zhong
Congrats Dian Fu! Well deserved! Best, Wei > 在 2020年1月16日,18:10,Hequn Cheng 写道: > > Congratulations, Dian. > Well deserved! > > Best, Hequn > > On Thu, Jan 16, 2020 at 6:08 PM Leonard Xu > wrote: > Congratulations! Dian Fu > > Best, > Leonard > >> 在 2020年1月16日,1

Re: [DISCUSS] Upload the Flink Python API 1.9.x to PyPI for user convenience.

2020-02-03 Thread Wei Zhong
Hi Jincheng, Thanks for bring up this discussion! +1 for this proposal. Building from source takes long time and requires a good network environment. Some users may not have such an environment. Uploading to PyPI will greatly improve the user experience. Best, Wei jincheng sun 于2020年2月4日周二 上午1

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

2020-02-10 Thread Wei Zhong
Hi, Thanks for driving this, Jincheng. +1 (non-binding) - Verified signatures and checksums. - Verified README.md and setup.py. - Run `pip install apache-flink-1.9.2.tar.gz` in Python 2.7.15 and Python 3.7.5 successfully. - Start local pyflink shell in Python 2.7.15 and Python 3.7.5 via `pyfl