Hi Richard,

in general it is difficult to sort a DataStream that is potentially neverending. However, if you use Flink's event-time semantics with watermarks that indicate that you stream is complete until a certain point you can sort it. The Table API will offer a a sort option in 1.4 (https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/table/sql.html#orderby--limit) based on that. The easiest way to implement a sort is to buffer the records in state and sort them when you think it is reasonable to sort them, you can use a ProcessFunction for that.

I hope that helps.

Regards,
Timo


Am 11/16/17 um 2:37 PM schrieb Stefan Richter:
Hi,

does this answer your question: https://flink.apache.org/news/2017/03/29/table-sql-api-update.html ?

Best,
Stefan

Am 15.11.2017 um 20:33 schrieb Richard Xin <richardxin...@yahoo.com <mailto:richardxin...@yahoo.com>>:

I have DataStream<Row>, is there a way to convert it DataSet or table so that I could sort it and persist it a file?

Thanks a lot!


Reply via email to