[ 
https://issues.apache.org/jira/browse/FLINK-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916474#comment-16916474
 ] 

Joao Boto commented on FLINK-13850:
-----------------------------------

this make sense to me, maybe FileConfig make more sense as it only have 
configuration for the file, if we see the bucket as part of output to.

but to use this config as [~kkl0u]  says, we will have to pass this to 
BulkWriter.Factory, and for that I don't no if it make more sense delegate de 
name creation to the writer directly

 

> Refactor part file configuration into a single method
> -----------------------------------------------------
>
>                 Key: FLINK-13850
>                 URL: https://issues.apache.org/jira/browse/FLINK-13850
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Connectors / FileSystem
>            Reporter: Gyula Fora
>            Assignee: Joao Boto
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.10.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently there is only two methods on both format builders
> withPartFilePrefix and withPartFileSuffix for configuring the part files but 
> in the future it is likely to grow.
>  * More settings, different directories for pending / inprogress files etc
> I suggest we remove these two methods and replace them with a single : 
> withPartFileConfig(..) where we use an extensible config class.
> This should be fixed before 1.10 in order to not release the other methods.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to