This is an automated email from the ASF dual-hosted git repository.
nevime pushed a change to branch rust-parquet-arrow-writer
in repository https://gitbox.apache.org/repos/asf/arrow.git.
discard 710cf41 ARROW-8423: [Rust] [Parquet] Serialize Arrow schema metadata
discard 00b2b3b ARROW-8289: [Rust] Parquet Arrow writer with nested support
add 0cced8f ARROW-9793: [Rust] [DataFusion] Fixed unit tests
add 41fa221 ARROW-9792: [Rust] [DataFusion] Aggregate expression
functions should not return result
add 5abe72f ARROW-9788: [Rust] [DataFusion] Rename SelectionExec to
FilterExec
add 2ebde1c ARROW-9800: [Rust][Parquet] Remove println! when writing
column statistics
add 01f06cf ARROW-9778: [Rust] [DataFusion] Implement Expr.nullable() and
make consistent between logical and physical plans
add 3cb0bd8 ARROW-9760: [Rust] [DataFusion] Added DataFrame::explain
add f0f02c6 ARROW-9784: [Rust][DataFusion] Make running TPCH benchmark
repeatable
add 9e73081 ARROW-9733: [Rust] [DataFusion] Added support for
COUNT/MIN/MAX on string columns
add 25b0b1b ARROW-9790: [Rust][Parquet] Fix PrimitiveArrayReader boundary
conditions
add c90ad63 ARROW-9532: [Python][Doc] Use Python3_EXECUTABLE instead of
PYTHON_EXECUTABLE for finding Python executable
add de8bfdd ARROW-9808: [Python] Update read_table doc string
add 60987f5 ARROW-8773: [Python] Preserve nullability of fields in
schema.empty_table()
add cb7d1c1 ARROW-9388: [C++] Division kernels
add 0576da6 ARROW-9768: [Python] Check overflow in conversion of datetime
objects to nanosecond timestamps
add 5d9ccb7 ARROW-6437: [R] Add AWS SDK to system dependencies for macOS
and Windows
add 36d267b [MINOR] Fix typo and use more concise word in README.md
add 597a26e ARROW-9807: [R] News update/version bump post-1.0.1
add 5e7be07 ARROW-9678: [Rust] [DataFusion] Improve projection push down
to remove unused columns
add f98de24 ARROW-9815 [Rust] [DataFusion] Fixed deadlock caused by
accessing the scalar functions' registry.
add 085b44d ARROW-9490: [Python][C++] Bug in pa.array when input mixes
int8 with float
add 0a698c0 ARROW-9831: [Rust][DataFusion] Fixed compilation error
add 2e8fcd4 ARROW-9762: [Rust] [DataFusion] ExecutionContext::sql now
returns DataFrame
add 85f4324 ARROW-9819: [C++] Bump mimalloc to 1.6.4
add 735c870 ARROW-9809: [Rust][DataFusion] Fixed type coercion,
supertypes and type checking.
add 657b3d3 ARROW-9833: [Rust] [DataFusion] TableProvider.scan now
returns ExecutionPlan
add d1d85db ARROW-9464: [Rust] [DataFusion] Remove Partition trait
add 3fb1356 ARROW-9554: [Java] FixedWidthInPlaceVectorSorter sometimes
produces wrong result
add 5e19200 ARROW-9840: [Python] fs documentation out of date with code
(FileStats -> FileInfo)
add 55defbf ARROW-9405: [R] Switch to cpp11
add 0943924 ARROW-9835: [Rust][DataFusion] Removed FunctionMeta and
FunctionType
add f0bda5f ARROW-9815: [Rust][DataFusion] Add a trait for looking up
scalar functions by name
add 7b2307f ARROW-9841: [Rust] Update checked-in fbs files
new c424f5c ARROW-8289: [Rust] Parquet Arrow writer with nested support
new 8f83f22 ARROW-8423: [Rust] [Parquet] Serialize Arrow schema metadata
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (710cf41)
\
N -- N -- N refs/heads/rust-parquet-arrow-writer (8f83f22)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 4 +-
ci/scripts/PKGBUILD | 9 +-
ci/scripts/r_windows_build.sh | 10 +-
cpp/src/arrow/compute/api_scalar.cc | 1 +
cpp/src/arrow/compute/api_scalar.h | 14 +
cpp/src/arrow/compute/kernels/codegen_internal.h | 3 +-
cpp/src/arrow/compute/kernels/scalar_arithmetic.cc | 59 +
.../compute/kernels/scalar_arithmetic_benchmark.cc | 2 +
.../compute/kernels/scalar_arithmetic_test.cc | 82 +
cpp/src/arrow/python/helpers.cc | 2 +
cpp/src/arrow/python/python_to_arrow.cc | 17 +-
cpp/src/arrow/util/int_util_internal.h | 1 +
cpp/thirdparty/versions.txt | 2 +-
dev/release/rat_exclude_files.txt | 2 +
.../homebrew-formulae/autobrew/apache-arrow.rb | 7 +-
dev/tasks/homebrew-formulae/travis.osx.r.yml | 5 +-
docs/source/cpp/compute.rst | 4 +
docs/source/developers/python.rst | 10 +-
docs/source/python/filesystems.rst | 22 +-
.../sort/FixedWidthInPlaceVectorSorter.java | 2 +
.../sort/FixedWidthOutOfPlaceVectorSorter.java | 12 +
.../sort/VariableWidthOutOfPlaceVectorSorter.java | 17 +
.../sort/TestFixedWidthInPlaceVectorSorter.java | 28 +
.../sort/TestFixedWidthOutOfPlaceVectorSorter.java | 36 +
.../algorithm/sort/TestFixedWidthSorting.java | 172 +
.../arrow/algorithm/sort/TestSortingUtil.java | 166 +
.../algorithm/sort/TestVariableWidthSorting.java | 165 +
.../arrow/vector/testing/RandomDataGenerator.java} | 34 +-
python/pyarrow/parquet.py | 2 +-
python/pyarrow/tests/test_convert_builtin.py | 30 +-
python/pyarrow/tests/test_schema.py | 17 +-
python/pyarrow/types.pxi | 12 +-
python/setup.py | 1 +
r/DESCRIPTION | 5 +-
r/NAMESPACE | 1 -
r/NEWS.md | 24 +-
r/R/arrow-package.R | 1 -
r/R/arrowExports.R | 36 +-
r/R/json.R | 13 +-
r/R/parquet.R | 3 +-
r/R/schema.R | 5 +-
r/R/struct.R | 2 +-
r/R/table.R | 6 +-
r/README.md | 8 +-
r/configure | 5 +-
r/configure.win | 13 +-
r/data-raw/codegen.R | 27 +-
r/inst/include/cpp11.hpp | 25 +
r/inst/include/cpp11/R.hpp | 49 +
r/inst/include/cpp11/altrep.hpp | 44 +
r/inst/include/cpp11/as.hpp | 339 ++
r/inst/include/cpp11/attribute_proxy.hpp | 50 +
r/inst/include/cpp11/data_frame.hpp | 102 +
r/inst/include/cpp11/declarations.hpp | 53 +
r/inst/include/cpp11/doubles.hpp | 136 +
r/inst/include/cpp11/environment.hpp | 75 +
r/inst/include/cpp11/external_pointer.hpp | 165 +
r/inst/include/cpp11/function.hpp | 78 +
r/inst/include/cpp11/integers.hpp | 142 +
r/inst/include/cpp11/list.hpp | 138 +
r/inst/include/cpp11/list_of.hpp | 53 +
r/inst/include/cpp11/logicals.hpp | 140 +
r/inst/include/cpp11/matrix.hpp | 111 +
r/inst/include/cpp11/named_arg.hpp | 51 +
r/inst/include/cpp11/protect.hpp | 286 ++
r/inst/include/cpp11/r_string.hpp | 92 +
r/inst/include/cpp11/r_vector.hpp | 986 ++++
r/inst/include/cpp11/raws.hpp | 148 +
r/inst/include/cpp11/sexp.hpp | 79 +
r/inst/include/cpp11/strings.hpp | 187 +
r/src/Makevars.in | 2 +-
r/src/array.cpp | 49 +-
r/src/array_from_vector.cpp | 171 +-
r/src/array_to_vector.cpp | 487 +-
r/src/arraydata.cpp | 7 +-
r/src/arrowExports.cpp | 5008 ++++++++++----------
r/src/arrow_cpp11.h | 312 ++
r/src/arrow_exports.h | 13 +-
r/src/arrow_rcpp.h | 186 -
r/src/arrow_types.h | 77 +-
r/src/buffer.cpp | 18 +-
r/src/chunkedarray.cpp | 13 +-
r/src/compression.cpp | 4 +-
r/src/compute.cpp | 42 +-
r/src/csv.cpp | 44 +-
r/src/dataset.cpp | 7 +-
r/src/datatype.cpp | 55 +-
r/src/feather.cpp | 14 +-
r/src/filesystem.cpp | 10 +-
r/src/io.cpp | 8 +-
r/src/json.cpp | 14 +-
r/src/memorypool.cpp | 2 +-
r/src/message.cpp | 2 -
r/src/parquet.cpp | 18 +-
r/src/py-to-r.cpp | 54 +-
r/src/recordbatch.cpp | 80 +-
r/src/recordbatchreader.cpp | 2 +-
r/src/recordbatchwriter.cpp | 2 -
r/src/schema.cpp | 39 +-
r/src/symbols.cpp | 54 +-
r/src/table.cpp | 107 +-
r/tests/testthat/helper-roundtrip.R | 43 +
r/tests/testthat/test-Array-errors.txt | 25 -
r/tests/testthat/test-Array.R | 74 +-
r/tests/testthat/test-RecordBatch.R | 22 +-
r/tests/testthat/test-Table.R | 18 +-
r/tests/testthat/test-chunked-array.R | 10 +-
r/tests/testthat/test-data-type.R | 4 +-
r/tests/testthat/test-python.R | 2 +
r/tools/autobrew | 7 +-
r/vignettes/install.Rmd | 4 +-
rust/arrow/src/ipc/gen/File.rs | 2 +-
rust/arrow/src/ipc/gen/Message.rs | 255 +
rust/arrow/src/ipc/gen/Schema.rs | 156 +-
rust/arrow/src/ipc/gen/SparseTensor.rs | 442 +-
rust/arrow/src/ipc/gen/Tensor.rs | 70 +-
rust/benchmarks/README.md | 26 +-
rust/benchmarks/src/bin/nyctaxi.rs | 2 +-
rust/benchmarks/src/bin/tpch.rs | 12 +-
rust/datafusion/README.md | 2 +-
rust/datafusion/benches/aggregate_query_sql.rs | 3 +-
rust/datafusion/examples/csv_sql.rs | 3 +-
rust/datafusion/examples/flight_server.rs | 2 +-
rust/datafusion/examples/parquet_sql.rs | 3 +-
rust/datafusion/src/bin/repl.rs | 3 +-
rust/datafusion/src/dataframe.rs | 20 +-
rust/datafusion/src/datasource/csv.rs | 29 +-
rust/datafusion/src/datasource/datasource.rs | 7 +-
rust/datafusion/src/datasource/memory.rs | 64 +-
rust/datafusion/src/datasource/parquet.rs | 129 +-
rust/datafusion/src/execution/context.rs | 212 +-
rust/datafusion/src/execution/dataframe_impl.rs | 61 +-
.../src/execution/physical_plan/common.rs | 11 +
rust/datafusion/src/execution/physical_plan/csv.rs | 115 +-
.../src/execution/physical_plan/datasource.rs | 59 -
.../src/execution/physical_plan/explain.rs | 26 +-
.../src/execution/physical_plan/expressions.rs | 573 ++-
.../physical_plan/{selection.rs => filter.rs} | 139 +-
.../src/execution/physical_plan/hash_aggregate.rs | 84 +-
.../src/execution/physical_plan/limit.rs | 89 +-
.../src/execution/physical_plan/memory.rs | 67 +-
.../src/execution/physical_plan/merge.rs | 95 +-
rust/datafusion/src/execution/physical_plan/mod.rs | 39 +-
.../src/execution/physical_plan/parquet.rs | 110 +-
.../src/execution/physical_plan/planner.rs | 256 +-
.../src/execution/physical_plan/projection.rs | 45 +-
.../datafusion/src/execution/physical_plan/sort.rs | 54 +-
rust/datafusion/src/execution/physical_plan/udf.rs | 14 +-
rust/datafusion/src/lib.rs | 4 +-
rust/datafusion/src/logicalplan.rs | 204 +-
rust/datafusion/src/optimizer/filter_push_down.rs | 140 +-
.../src/optimizer/projection_push_down.rs | 447 +-
rust/datafusion/src/optimizer/type_coercion.rs | 203 +-
rust/datafusion/src/optimizer/utils.rs | 125 +-
rust/datafusion/src/sql/planner.rs | 62 +-
rust/datafusion/src/test/mod.rs | 9 +-
rust/datafusion/tests/sql.rs | 64 +-
rust/parquet/src/arrow/array_reader.rs | 62 +-
rust/parquet/src/arrow/arrow_reader.rs | 39 +
159 files changed, 10909 insertions(+), 5467 deletions(-)
create mode 100644
java/algorithm/src/test/java/org/apache/arrow/algorithm/sort/TestFixedWidthSorting.java
create mode 100644
java/algorithm/src/test/java/org/apache/arrow/algorithm/sort/TestSortingUtil.java
create mode 100644
java/algorithm/src/test/java/org/apache/arrow/algorithm/sort/TestVariableWidthSorting.java
copy
java/vector/src/{main/java/org/apache/arrow/vector/types/pojo/ExtensionTypeRegistry.java
=> test/java/org/apache/arrow/vector/testing/RandomDataGenerator.java} (54%)
create mode 100644 r/inst/include/cpp11.hpp
create mode 100644 r/inst/include/cpp11/R.hpp
create mode 100644 r/inst/include/cpp11/altrep.hpp
create mode 100644 r/inst/include/cpp11/as.hpp
create mode 100644 r/inst/include/cpp11/attribute_proxy.hpp
create mode 100644 r/inst/include/cpp11/data_frame.hpp
create mode 100644 r/inst/include/cpp11/declarations.hpp
create mode 100644 r/inst/include/cpp11/doubles.hpp
create mode 100644 r/inst/include/cpp11/environment.hpp
create mode 100644 r/inst/include/cpp11/external_pointer.hpp
create mode 100644 r/inst/include/cpp11/function.hpp
create mode 100644 r/inst/include/cpp11/integers.hpp
create mode 100644 r/inst/include/cpp11/list.hpp
create mode 100644 r/inst/include/cpp11/list_of.hpp
create mode 100644 r/inst/include/cpp11/logicals.hpp
create mode 100644 r/inst/include/cpp11/matrix.hpp
create mode 100644 r/inst/include/cpp11/named_arg.hpp
create mode 100644 r/inst/include/cpp11/protect.hpp
create mode 100644 r/inst/include/cpp11/r_string.hpp
create mode 100644 r/inst/include/cpp11/r_vector.hpp
create mode 100644 r/inst/include/cpp11/raws.hpp
create mode 100644 r/inst/include/cpp11/sexp.hpp
create mode 100644 r/inst/include/cpp11/strings.hpp
create mode 100644 r/src/arrow_cpp11.h
delete mode 100644 r/src/arrow_rcpp.h
create mode 100644 r/tests/testthat/helper-roundtrip.R
delete mode 100644 r/tests/testthat/test-Array-errors.txt
delete mode 100644 rust/datafusion/src/execution/physical_plan/datasource.rs
rename rust/datafusion/src/execution/physical_plan/{selection.rs => filter.rs}
(53%)
