wangzhigang1999 commented on PR #7704:
URL: https://github.com/apache/kyuubi/pull/7704#issuecomment-5524485126
I tested this PR at `a0c81c9c49677ce005993847554529cb9395af15` on ACK using
Spark 4.3.0 RC1 and Scala 2.13. I focused on Kyuubi's Spark 4.3 compatibility
paths; CI covers the unit tests.
| Area | Coverage | Result |
|---|---|---|
| Build and packaging | Spark 4.3 distribution and Kyuubi image | Passed |
| Spark SQL Engine | JDBC sessions and Kubernetes Driver/Executor | Passed |
| Spark 4.3 extension | Module loading, parser, dynamic shuffle, Watchdog,
and Z-order smoke tests | Passed |
| Arrow compatibility | Spark 4.3 `toArrowSchema` signature, `none`/`zstd`,
and nested types | Passed |
| Spark 4.3 SQL compatibility | ASOF JOIN, map DISTINCT, zero-length
Parquet, column comment removal, and new `unix_*` inputs | Passed |
| Nanosecond timestamps | NTZ/LTZ precisions 7, 8, and 9 through JDBC and
Arrow | **Failed** |
With `spark.sql.timestampNanosTypes.enabled=true`, all six nanosecond
timestamp variants fail during Kyuubi result metadata conversion:
```text
Unrecognized type name: timestamp_{ntz|ltz}(7|8|9)
```
This was the only Kyuubi compatibility issue found in this ACK validation.
Since nanosecond timestamps are disabled by default, this could either be fixed
in this PR or documented as a known Spark 4.3 limitation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
