Fabian Hueske created FLINK-8854: ------------------------------------ Summary: Mapping of SchemaValidator.deriveFieldMapping() is incorrect. Key: FLINK-8854 URL: https://issues.apache.org/jira/browse/FLINK-8854 Project: Flink Issue Type: Bug Components: Table API & SQL Affects Versions: 1.5.0 Reporter: Fabian Hueske Fix For: 1.5.0
The field mapping returned by {{SchemaValidator.deriveFieldMapping()}} is not correct. It should not only include all fields of the table schema, but also all fields of the format schema (mapped to themselves). Otherwise, it is not possible to use a timestamp extractor on a field that is not in table schema. For example this configuration would fail: {code} sources: - name: TaxiRides schema: - name: rideId type: LONG - name: rowTime type: TIMESTAMP rowtime: timestamps: type: "from-field" from: "rideTime" watermarks: type: "periodic-bounded" delay: "60000" connector: .... format: property-version: 1 type: json schema: "ROW(rideId LONG, rideTime TIMESTAMP)" {code} because {{rideTime}} is not in the table schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)