[ 
https://issues.apache.org/jira/browse/KAFKA-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

rameshkrishnan muthusamy resolved KAFKA-9326.
---------------------------------------------
    Resolution: Invalid

> Kafka Connect JSON Converter results in data loss when additional fields 
> apart from provided JSON schema is present in the payload
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-9326
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9326
>             Project: Kafka
>          Issue Type: Bug
>          Components: KafkaConnect
>    Affects Versions: 3.0.0, 2.3.0, 2.2.1, 2.3.1
>            Reporter: rameshkrishnan muthusamy
>            Priority: Major
>              Labels: kafka-connect
>
> JSON Convertor in Kafka Connect validates the payload against the schema 
> provided by the user. In case there is an additional field in the payload 
> which is not mentioned in the schema the JSON convertor does not fail and 
> returns the value without the additional column. 
> e.g) message has additional column "new_col"
> {
>  "schema": {
>  "type": "struct",
>  "fields": [
>  {
>  "type": "string",
>  "optional": true,
>  "field": "type"
>  },
>  {
>  "type": "string",
>  "optional": false,
>  "field": "data"
>  }
>  ],
>  "optional": false,
>  "name": "test"
>  },
>  "payload": {
>  "type": "testpayload",
>  "data": "test_data",
>  "new_col": 1
>  }
> }
> The output of JSON convertor "Struct\{type=testpayload,data=test_data}" 
> should ideally fail assuming fail fast rather than skipping the field in the 
> output payload. 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to