[ https://issues.apache.org/jira/browse/FLINK-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16100855#comment-16100855 ]
Ken Geis commented on FLINK-7221: --------------------------------- Unfortunately, my employer (UC Berkeley) is reluctant to allow staff to sign ICLAs. Although this would be a simple patch, I don't think I'll have resources to prepare it outside of work. > JDBCOutputFormat swallows errors on last batch > ---------------------------------------------- > > Key: FLINK-7221 > URL: https://issues.apache.org/jira/browse/FLINK-7221 > Project: Flink > Issue Type: Bug > Components: Batch Connectors and Input/Output Formats > Affects Versions: 1.3.1 > Environment: Java 1.8.0_131, PostgreSQL driver 42.1.3 > Reporter: Ken Geis > > I have a data set with ~17000 rows that I was trying to write to a PostgreSQL > table that I did not (yet) have permission on. No data was loaded, and Flink > did not report any problem outputting the data set. The only indication I > found of my problem was in the PostgreSQL log. > With the default parallelism (8) and the default batch interval (5000), my > batches were ~2000 rows each, so they were never executed in > {{JDBCOutputFormat.writeRecord(..)}}. {{JDBCOutputFormat.close()}} does a > final call on {{upload.executeBatch()}}, but if there is a problem, it is > logged at INFO level and not rethrown. > If I decrease the batch interval to 100 or 1000, then an error is properly > reported. -- This message was sent by Atlassian JIRA (v6.4.14#64029)