Liu Liu created FLINK-40437:
-------------------------------
Summary: Add iteration and bounded retrieval to DataFrame API
Key: FLINK-40437
URL: https://issues.apache.org/jira/browse/FLINK-40437
Project: Flink
Issue Type: Sub-task
Components: API / Python
Reporter: Liu Liu
Add incremental row and batch result APIs:
{code:java}
def iter_rows(
self,
*,
include_row_kind=False,
row_kind_field="__row_kind__",
) -> CloseableIterator[Dict[str, Any]]
def iter_batches(
self,
*,
batch_size=1000,
batch_format="pandas",
include_row_kind=False,
row_kind_field="__row_kind__",
) -> CloseableIterator {code}
Also add bounded retrieval helpers:
{code:java}
def take(self, n, *, timeout=None, include_row_kind=False, ...) -> List[Dict]
def take_batch(self, n, *, timeout=None, batch_format="pandas", ...) -> Batch
{code}
{{}}
{{}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
