Re: [DISCUSS] Best practice to run flink on kubernetes

2019-09-29 Thread 星沉
Yang Wang wrote: Through mixed-run with online services, they could get better resource utilization and reduce the cost. Flink, as an important case, the dynamical resource allocation is the basic requirement. That's why we want to move the progress more faster. vote +1. If flink migrati

Re: [DISCUSS] Best practice to run flink on kubernetes

2019-09-29 Thread Yang Wang
Hi dev and users, I just want to revive this discussion because we have some meaningful progress about kubernetes native integration. I have made a draft implementation to complete the poc. Cli and submission are both working as expected. The design doc[1] has been updated, including the detailed

[ANNOUNCE] Weekly Community Update 2019/39

2019-09-29 Thread Konstantin Knauf
Dear community, happy to share this week's community update with news about Flink 1.10 & 1.9.1, two FLIPs for better programmatic job and cluster control, improvements to the web user interface and a bit more. Flink Development == * [releases] Jark has started a discussion on releasi

Re:Re: map can't return null

2019-09-29 Thread a****
hi, ok,thanks.I'll read it. Then I have another problem, which was that I had caught the exception ,but it still came out. At 2019-09-29 17:05:20, "Biao Liu" wrote: Hi allan, It's not a bug. Flink does not support null value, see discussion [1]. In you example, you have to return s

Re: map can't return null

2019-09-29 Thread Biao Liu
Hi allan, It's not a bug. Flink does not support null value, see discussion [1]. In you example, you have to return something with MapFunction even there is nothing to return. Maybe you could use flatmap instead of map to handle this null value scenario. It's allowed to collect nothing (skip coll

Re: map can't return null

2019-09-29 Thread Abhishek Jain
Hi Allan, Map does support null but tuple serializer does not. You might want to use pojo or row types if you need to deal with null values. Read more here . - Abhishek On Sun, 29 Se

map can't return null

2019-09-29 Thread allan
Hi guys, When I use like the code, .map(new MapFunction>() { @Override public Tuple2 map(String value) throws Exception { if (properties != null) { return new Tuple2<>(cv_no, json.toJSONString()); } return null;