tadeja opened a new issue, #51220:
URL: https://github.com/apache/arrow/issues/51220
### Describe the enhancement requested
Some ParquetWriter options accepted by `pq.write_table` are not registered
in `ParquetFileWriteOptions`, so `pq.write_to_dataset` and `ds.write_dataset`
reject them:
- `write_time_adjusted_to_utc` #47745
- `bloom_filter_options` #49377 (also missing in `ParquetWriter.__init__`)
```python
pq.write_to_dataset(table, path, bloom_filter_options={'a': True})
```
Output
```console
File "_/python/pyarrow/parquet/core.py", line 2279, in write_to_dataset
write_options = parquet_format.make_write_options(**kwargs)
pyarrow._dataset_parquet.ParquetFileFormat.make_write_options
(<ParquetFileWriteOptions> opts).update(**kwargs)
File "pyarrow/_dataset_parquet.pyx", line 628, in
pyarrow._dataset_parquet.ParquetFileWriteOptions.update
raise TypeError("unexpected parquet write option: " + name)
TypeError: unexpected parquet write option: bloom_filter_options
```
- (? `store_schema` commit 56b90a44d0 )
Similar to `use_content_defined_chunking` getting added in #47499 / #47498
[implementor's
note](https://github.com/apache/arrow/blame/51bfc67ef646b5616003c9630e615618fbe48481/python/pyarrow/parquet/core.py#L2022)
A test that every option in `inspect.signature(pq.write_table).parameters`
is accepted by `ParquetFileFormat.make_write_options` may be considered to
prevent this in the future.
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
