[jira] [Created] (FLINK-9115) Support addition of part suffix in BucketingSink

2018-03-29 Thread Lakshmi Rao (JIRA)
Lakshmi Rao created FLINK-9115: -- Summary: Support addition of part suffix in BucketingSink Key: FLINK-9115 URL: https://issues.apache.org/jira/browse/FLINK-9115 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-9114) Enable user-provided, custom CheckpointRecoveryFactory for non-HA deployments

2018-03-29 Thread Jacob Park (JIRA)
Jacob Park created FLINK-9114: - Summary: Enable user-provided, custom CheckpointRecoveryFactory for non-HA deployments Key: FLINK-9114 URL: https://issues.apache.org/jira/browse/FLINK-9114 Project: Flink

Using Slack for online discussions

2018-03-29 Thread Thomas Weise
How does the community think about using ASF Slack for online discussions? The Beam project started to use it recently and it seems to work quite well [1] [2]. [1] https://lists.apache.org/thread.html/1bee60193823a8411dcfad7a6de695ac1d779ae5d14f7b954ffa5961@%3Cdev.beam.apache.org%3E [2] https://l

[jira] [Created] (FLINK-9113) Data loss in BucketingSink when writing to local filesystem

2018-03-29 Thread Timo Walther (JIRA)
Timo Walther created FLINK-9113: --- Summary: Data loss in BucketingSink when writing to local filesystem Key: FLINK-9113 URL: https://issues.apache.org/jira/browse/FLINK-9113 Project: Flink Issu

[jira] [Created] (FLINK-9112) Let end-to-end tests upload the components logs in case of a failure

2018-03-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9112: Summary: Let end-to-end tests upload the components logs in case of a failure Key: FLINK-9112 URL: https://issues.apache.org/jira/browse/FLINK-9112 Project: Flink

Re: Adding a part suffix setter to the BucketingSink

2018-03-29 Thread lrao
Sorry, I meant "I don't see a way of doing this apart from setting a part file *suffix* with the required file extension. " On 2018/03/29 14:55:43, l...@lyft.com wrote: > Currently the BucketingSink allows addition of part prefix, pending > prefix/suffix and in-progress prefix/suffix via sett

Adding a part suffix setter to the BucketingSink

2018-03-29 Thread lrao
Currently the BucketingSink allows addition of part prefix, pending prefix/suffix and in-progress prefix/suffix via setter methods. Can we also support setting part suffixes? An instance where this maybe useful: I am currently writing GZIP compressed output to S3 using the BucketingSink and I wo

Re: Compressing files with the Bucketing Sink

2018-03-29 Thread lrao
Thanks a lot for the suggestion Till! I ended up using your suggestion of extending StreamWriterBase and wrapping the FSDataOutputStream with GZIPOutputStream. On 2018/03/28 09:44:26, Till Rohrmann wrote: > Hi, > > the SequenceFileWriter and the AvroKeyValueSinkWriter both support > co

[jira] [Created] (FLINK-9111) SSL Passwords written to log file in plain text

2018-03-29 Thread Vinay (JIRA)
Vinay created FLINK-9111: Summary: SSL Passwords written to log file in plain text Key: FLINK-9111 URL: https://issues.apache.org/jira/browse/FLINK-9111 Project: Flink Issue Type: Bug Compo

[jira] [Created] (FLINK-9110) Building docs with Ruby 2.5 fails if bunder is not globally installed

2018-03-29 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9110: -- Summary: Building docs with Ruby 2.5 fails if bunder is not globally installed Key: FLINK-9110 URL: https://issues.apache.org/jira/browse/FLINK-9110 Project: Flink

[jira] [Created] (FLINK-9109) Add flink modify command to documentation

2018-03-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9109: Summary: Add flink modify command to documentation Key: FLINK-9109 URL: https://issues.apache.org/jira/browse/FLINK-9109 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9108) invalid ProcessWindowFunction link in Document

2018-03-29 Thread Matrix42 (JIRA)
Matrix42 created FLINK-9108: --- Summary: invalid ProcessWindowFunction link in Document Key: FLINK-9108 URL: https://issues.apache.org/jira/browse/FLINK-9108 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9107) Document timer coalescing for ProcessFunctions

2018-03-29 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9107: -- Summary: Document timer coalescing for ProcessFunctions Key: FLINK-9107 URL: https://issues.apache.org/jira/browse/FLINK-9107 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-9106) Add UnfencedMainThreadExecutor to FencedRpcEndpoint

2018-03-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9106: Summary: Add UnfencedMainThreadExecutor to FencedRpcEndpoint Key: FLINK-9106 URL: https://issues.apache.org/jira/browse/FLINK-9106 Project: Flink Issue Type:

[jira] [Created] (FLINK-9105) Table program compiles failed

2018-03-29 Thread Bob Lau (JIRA)
Bob Lau created FLINK-9105: -- Summary: Table program compiles failed Key: FLINK-9105 URL: https://issues.apache.org/jira/browse/FLINK-9105 Project: Flink Issue Type: Bug Components: DataStr

Subject: Last chance to register for Flink Forward SF (April 10). Get 25% discount

2018-03-29 Thread Stephan Ewen
Hi all! There are still some spots left to attend Flink Forward San Francisco, so sign up soon before registration closes. Use this promo code to get 25% off: MailingListFFSF The 1-day conference takes place on Tuesday, April 10 in downtown SF. We have a great lineup of speakers from companies w

[jira] [Created] (FLINK-9104) Re-generate REST API documentation for FLIP-6

2018-03-29 Thread Gary Yao (JIRA)
Gary Yao created FLINK-9104: --- Summary: Re-generate REST API documentation for FLIP-6 Key: FLINK-9104 URL: https://issues.apache.org/jira/browse/FLINK-9104 Project: Flink Issue Type: Bug