This is an automated email from the ASF dual-hosted git repository.
jmalkin pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datasketches-spark.git
from 255b048 Merge pull request #18 from apache/rename_packages
add a1dd278 WIP: Initial files for pyspark testing. Not fully working but
checkpointing here
add b6940ee fix misplaced paren in _array_as_java_column
add a432672 Clean up codegen by setting ev.isNull properly
add 4e8d151 WIP: modified build.sbt to copy ds-java jars, added setup.py
to include in sdist/wheels.
add d63c5aa cleaner build.sbt that better interacts with setting up
python. many changes to make python build work for wheel or sdist
add 0858aa7 minor cleanup, add TODO for tox
add a9144fe finish setting up config to support pyspark package,
inclduing methods to simplify use
add 71bc84e final(?) changes for baseline kll in pyspark, including
useful tests
add 8945522 Ensure python deps path exists before copying into it
add 70742f2 Remove deprecation warning for reading package resource files
add b1ebc1f Tidy up kll python tests a bit
add 50794a0 improve kll merge test
add 6357cdd Update readmes with build instructions
add 55fc7d5 Switch from isBlank() to isEmpty() so java8 works
add 00ad689 Try to fix main ci workflow warnings, add python ci workflow
add dbe59e1 Rename Python CI job to disambiguation, put edits in correct
file
add 02ed084 Finished moving edits -- sbt test in scala, sbt package in
python
add 6e347e7 Minor fix: better naming
add 0fd0d61 Minor fix: use | for multi-line commands
new a4387a3 Merge pull request #19 from apache/python
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/ci.yaml | 10 +-
.github/workflows/{ci.yaml => python_ci.yaml} | 47 ++++---
.gitignore | 24 +---
README.md | 29 +++-
build.sbt | 149 +++++++++++----------
project/BuildUtils.scala | 94 +++++++++++++
python/MANIFEST.in | 21 +++
python/README.md | 55 ++++++++
python/pyproject.toml | 48 +++++++
python/setup.py | 79 +++++++++++
python/src/datasketches_spark/__init__.py | 29 ++++
python/src/datasketches_spark/_version.py | 27 ++++
python/src/datasketches_spark/common.py | 120 +++++++++++++++++
python/src/datasketches_spark/kll.py | 104 ++++++++++++++
python/tests/__init__.py | 16 +++
python/tests/conftest.py | 35 +++++
python/tests/kll_test.py | 73 ++++++++++
python/tox.ini | 25 ++++
.../expressions/KllDoublesSketchExpressions.scala | 23 ++--
.../kll/types/KllDoublesSketchType.scala | 4 +
version.cfg | 21 +++
21 files changed, 903 insertions(+), 130 deletions(-)
copy .github/workflows/{ci.yaml => python_ci.yaml} (59%)
create mode 100644 project/BuildUtils.scala
create mode 100644 python/MANIFEST.in
create mode 100644 python/README.md
create mode 100644 python/pyproject.toml
create mode 100644 python/setup.py
create mode 100644 python/src/datasketches_spark/__init__.py
create mode 100644 python/src/datasketches_spark/_version.py
create mode 100644 python/src/datasketches_spark/common.py
create mode 100644 python/src/datasketches_spark/kll.py
create mode 100644 python/tests/__init__.py
create mode 100644 python/tests/conftest.py
create mode 100644 python/tests/kll_test.py
create mode 100644 python/tox.ini
create mode 100644 version.cfg
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]