anishshri-db commented on code in PR #50177: URL: https://github.com/apache/spark/pull/50177#discussion_r2029508149
########## docs/streaming/structured-streaming-state-data-source.md: ########## @@ -174,6 +174,24 @@ The following configurations are optional: <td>latest commited batchId</td> <td>Represents the last batch to read in the read change feed mode. This option requires 'readChangeFeed' to be set to true.</td> </tr> +<tr> + <td>stateVarName</td> + <td>string</td> + <td></td> + <td>The state variable name to read as part of this batch query. This is a required option if the transformWithState operator is used.</td> +</tr> +<tr> + <td>readRegisteredTimers</td> + <td>boolean</td> + <td>false</td> + <td>If true, the user can read registered timers used within the transformWithState operator.</td> +</tr> +<tr> + <td>flattenCollectionTypes</td> + <td>boolean</td> + <td>true</td> + <td>If true, the collection types for state variables such as list state, map state etc are flattened out. If false, the values are provided as Array or Map type in Spark SQL.</td> Review Comment: No - I mean in the schema for the state reader dataframe, they will appear as `Array`, `Map` type right - thats what I meant -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
