davidradl commented on code in PR #28:
URL:
https://github.com/apache/flink-connector-http/pull/28#discussion_r2905587207
##########
docs/content.zh/docs/connectors/datastream/http.md:
##########
@@ -72,15 +70,23 @@ These options are specified on the builder using the
setProperty method.
| flink.connector.http.security.cert.server.allowSelfSigned | optional |
Accept untrusted certificates for TLS communication.
|
| flink.connector.http.sink.request.timeout | optional | Sets
HTTP request timeout in seconds. If not specified, the default value of 30
seconds will be used.
|
| flink.connector.http.sink.writer.thread-pool.size | optional | Sets
the size of pool thread for HTTP Sink request processing. Increasing this value
would mean that more concurrent requests can be processed in the same time. If
not specified, the default value of 1 thread will be used. |
-| flink.connector.http.sink.writer.request.mode | optional | Sets
Http Sink request submission mode. Two modes are available to select, `single`
and `batch` which is the default mode if option is not specified.
|
+| flink.connector.http.sink.writer.request.mode | optional | Sets
the Http Sink request submission mode. Two modes are available: `single` and
`batch`. Defaults to `batch` if not specified. |
| flink.connector.http.sink.request.batch.size | optional |
Applicable only for `flink.connector.http.sink.writer.request.mode = batch`.
Sets number of individual events/requests that will be submitted as one HTTP
request by HTTP sink. The default value is 500 which is same as HTTP Sink
`maxBatchSize` |
-### Batch submission mode
+### Request submission
+HTTP Sink by default submits events in batch. The submission mode can be
changed using `flink.connector.http.sink.writer.request.mode` property using
`single` or `batch` as property value.
+
+#### Batch submission mode
+
+The HTTP Sink uses a two-stage batching mechanism that decouples the rate and
size of incoming records from how they are sent as HTTP requests.
-By default, batch size is set to 500 which is the same as Http Sink's
`maxBatchSize` property and has value of 500.
-The `maxBatchSize` property sets maximal number of events that will be
buffered by Flink runtime before passing it to Http Sink for processing.
+**Stage 1 - Flink Runtime Buffering**: Controlled by `sink.batch.max-size`
property (default: 500). Flink buffers records internally until reaching
`sink.batch.max-size` records, `sink.flush-buffer.size`, or timeout
`sink.flush-buffer.timeout`. When triggered, Flink flushes the buffered records
to the HTTP Sink.
Review Comment:
nit : to the HTTP Sink. - > to the network.
##########
docs/content.zh/docs/connectors/datastream/http.md:
##########
@@ -72,15 +70,23 @@ These options are specified on the builder using the
setProperty method.
| flink.connector.http.security.cert.server.allowSelfSigned | optional |
Accept untrusted certificates for TLS communication.
|
| flink.connector.http.sink.request.timeout | optional | Sets
HTTP request timeout in seconds. If not specified, the default value of 30
seconds will be used.
|
| flink.connector.http.sink.writer.thread-pool.size | optional | Sets
the size of pool thread for HTTP Sink request processing. Increasing this value
would mean that more concurrent requests can be processed in the same time. If
not specified, the default value of 1 thread will be used. |
-| flink.connector.http.sink.writer.request.mode | optional | Sets
Http Sink request submission mode. Two modes are available to select, `single`
and `batch` which is the default mode if option is not specified.
|
+| flink.connector.http.sink.writer.request.mode | optional | Sets
the Http Sink request submission mode. Two modes are available: `single` and
`batch`. Defaults to `batch` if not specified. |
| flink.connector.http.sink.request.batch.size | optional |
Applicable only for `flink.connector.http.sink.writer.request.mode = batch`.
Sets number of individual events/requests that will be submitted as one HTTP
request by HTTP sink. The default value is 500 which is same as HTTP Sink
`maxBatchSize` |
-### Batch submission mode
+### Request submission
+HTTP Sink by default submits events in batch. The submission mode can be
changed using `flink.connector.http.sink.writer.request.mode` property using
`single` or `batch` as property value.
+
+#### Batch submission mode
+
+The HTTP Sink uses a two-stage batching mechanism that decouples the rate and
size of incoming records from how they are sent as HTTP requests.
-By default, batch size is set to 500 which is the same as Http Sink's
`maxBatchSize` property and has value of 500.
-The `maxBatchSize` property sets maximal number of events that will be
buffered by Flink runtime before passing it to Http Sink for processing.
+**Stage 1 - Flink Runtime Buffering**: Controlled by `sink.batch.max-size`
property (default: 500). Flink buffers records internally until reaching
`sink.batch.max-size` records, `sink.flush-buffer.size`, or timeout
`sink.flush-buffer.timeout`. When triggered, Flink flushes the buffered records
to the HTTP Sink.
Review Comment:
nit : to the HTTP Sink. - > to the network.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
