commits  

Messages by Thread

• (paimon) branch master updated: [parquet] Minor refactor schemaCache in ParquetReaderFactory lzljs3620320
• (paimon) branch master updated: [parquet]: Cache requestedSchema and fields in ParquetReaderFactory to avoid redundant computation (#7476) lzljs3620320
• (paimon-website) branch asf-site updated (907ca9015 -> f39a9c6c9) github-bot
• (paimon-rust) branch main updated: feat: add REST API client with list_databases support (#144) lzljs3620320
• (paimon) branch master updated: [core] Introduce 'pk-clustering-override' to clustering by non-primary key fields (#7426) lzljs3620320
• (paimon) branch master updated: [mirror] Use HeapBytesVector instead of WritableBytesVector to call putByteArray (#7455) lzljs3620320
• (paimon) branch master updated: [parquet] Fix INT96 TimestampUpdater.skipValues incorrectly skipping bytes (#7454) lzljs3620320
• (paimon) branch master updated: [core] Add VARCHAR check for FieldListaggAgg (#7485) lzljs3620320
• (paimon) branch master updated: [spark] Support by-name resolution for nested struct fields during schema merge (#7487) lzljs3620320
• (paimon) branch master updated: [spark] Fix NPE in SparkHilbertUDF and SparkZOrderUDF for null values (#7451) lzljs3620320
• (paimon) branch master updated: [build] Add fast-build profile and update AGENTS.md (#7488) lzljs3620320
• (paimon) branch master updated: [docs][flink] Add guide for self-merge use case and minor fix. (#7481) lzljs3620320
• (paimon) branch master updated: [python] Fix null partition value causing TypeError in manifest stats calculation (#7480) lzljs3620320
• (paimon) branch master updated: [core][python] Add a version number in BtreeFileFooter (#7461) junhao
• (paimon) branch master updated: [spark] Fix V1 DELETE statement incorrectly removing rows with NULL values (#7482) zouxxyy
• (paimon) branch master updated: [core] Validate retained global index row ranges (#7479) junhao
• (paimon) branch master updated: [core] refactor flink create global index (#7445) junhao
• (paimon) branch master updated: [core] Unify inclusive predicate project to PredicateProjectionConverter (#7473) lzljs3620320
• (paimon-website) branch asf-site updated (335ad2578 -> 907ca9015) github-bot
• (paimon) branch master updated: [python] Support partition.default-name to fix read null/empty partition values error (#7472) lzljs3620320
• (paimon) branch master updated: [format] Simplify ParquetDecimalVector to a read-only adapter (#7468) lzljs3620320
• (paimon) branch master updated: [flink] Split btree index build and execute (#7471) lzljs3620320
• (paimon) branch master updated: [core] Do not clean base and delta manifests in ChangelogDeletion (#7429) lzljs3620320
• (paimon) branch master updated: [python] Fix blob descriptor conversion missing in to_arrow_batch_reader (#7460) lzljs3620320
• (paimon) branch master updated: [python] Support SchemaManager with branch in pypaimon (#7465) lzljs3620320
• (paimon) branch master updated: [core] Introduce new aggregate function: merge_map_with_keytime (#7446) yuzelin
• (paimon) branch master updated: [python] Introduce TableUpsertByKey for data-evolution table (#7462) lzljs3620320
• (paimon) branch master updated: [core] fix AppendOnlyWriterTest after the update that vector always stored separately if vector.file.format is configured (#7463) jerryjing
• (paimon-rust) branch main updated: feat(spec): implement partition path generation (#139) lzljs3620320
• (paimon-rust) branch main updated: feat: support read deletion vector to arrow (#141) lzljs3620320
• (paimon) branch master updated: [python] Use streaming yield when reading ray data for better performance (#7453) lzljs3620320
• (paimon-website) branch asf-site updated (0d4b0b618 -> 335ad2578) github-bot
• (paimon) branch master updated: [avro] add avro support for vector type (#7449) lzljs3620320
• (paimon) branch master updated: [core] Refactor vector store related codes (#7447) lzljs3620320
• (paimon) branch master updated: [python] Add json format for CLI table read and list-partitions (#7452) lzljs3620320
• (paimon) branch master updated: [core] Refine btree index entry scanning API (#7450) lzljs3620320
• (paimon) branch master updated: [python] Introduce branch_manager API for pypaimon (#7448) lzljs3620320
• (paimon) branch master updated: [core] Do not delete manifest files on false commit result (#7441) lzljs3620320
• (paimon) branch master updated: [Flink] Fix SystemTableSource unordered flag for bucket-unaware system talbes (#7434) lzljs3620320
• (paimon) branch master updated: [python] Add list partitions support for Python CLI (#7442) lzljs3620320
• (paimon) branch master updated: [core] Add partition format check if partition expire time is set (#7428) lzljs3620320
• (paimon) branch master updated: [core] flink support vector index create (#7437) lzljs3620320
• (paimon) branch master updated: [python] Add acceptance test to lint-python (#7439) lzljs3620320
• (paimon-trino) branch main updated: Bump Trino to 476 and Paimon to 1.3.1 (#122) junhao
• (paimon) branch master updated: [spark] Fix concurrent V2 MERGE INTO data inconsistency (#7432) zouxxyy
• (paimon) branch master updated: [python] Add IncrementalDiff acceptance tests and streaming API docs (#7436) lzljs3620320
• (paimon-website) branch asf-site updated (d612f4af5 -> 0d4b0b618) github-bot
• (paimon) branch master updated: [python] Add consumer ID support for streaming read progress persistence (#7435) lzljs3620320
• (paimon-rust) branch main updated: ci: add release pipeline for go binding (#138) lzljs3620320
• (paimon) branch master updated: [python] Fix wrong file extension parsing for compressed json/csv files (#7433) lzljs3620320
• (paimon) branch dependabot/maven/paimon-e2e-tests/org.apache.flink-flink-connector-mysql-cdc-3.5.0 deleted (was 37829e63a1) github-bot
• (paimon) branch master updated: Bump org.apache.flink:flink-connector-mysql-cdc from 3.1.1 to 3.5.0 in /paimon-e2e-tests (#7430) lzljs3620320
• (paimon) branch dependabot/maven/paimon-e2e-tests/org.apache.flink-flink-connector-mysql-cdc-3.5.0 created (now 37829e63a1) github-bot
• (paimon-rust) branch main updated: feat: implement BinaryRow deserialization for partition bytes (#133) lzljs3620320
• (paimon-rust) branch main updated: feat: introduce go binding (#132) lzljs3620320
• (paimon-rust) branch main updated: feat: add OSS storage support. (#134) lzljs3620320
• (paimon-rust) branch main updated (4db64be -> 1bb21c5) lzljs3620320
• (paimon) branch master updated: [core] Add table properties sync to JDBC catalog (#7423) lzljs3620320
• (paimon) branch master updated: [python] Fix _apply_push_down_limit not considering non-raw-convertible splits issue (#7427) lzljs3620320
• (paimon-website) branch asf-site updated (14cdb7f6d -> d612f4af5) github-bot
• (paimon) branch master updated: [rest] Add IO cache configuration option to token (#7425) lzljs3620320
• (paimon-website) branch asf-site updated (e8ffbf7ae -> 14cdb7f6d) github-bot
• (paimon) branch master updated (28544bbfda -> e63d9abb8d) lzljs3620320
• (paimon-rust) branch dependabot/cargo/opendal-0.50 deleted (was cfc8e6f) github-bot
• (paimon-rust) branch main updated: feat: introduce c binding to expose ffi for go binding (#123) lzljs3620320
• (paimon-website) branch asf-site updated (23bdf8ccd -> e8ffbf7ae) github-bot
• (paimon-rust) branch main updated: feat: plan support to plan deletion vector (#118) lzljs3620320
• (paimon) branch master updated: [test] Add className to unstable MergeInto tests lzljs3620320
• (paimon) branch master updated: [test] Fix unstable test in BitSliceIndexRoaringBitmapTest lzljs3620320
• (paimon) branch master updated: [python] Add SnapshotManager batch lookahead with get_snapshots_batch and find_next_scannable (#7418) lzljs3620320
• (paimon) branch master updated: [core] Enable incrementalScan for BTreeGlobalIndexBuilder (#7416) lzljs3620320
• (paimon) branch master updated: [python] Add ChangelogProducer enum and changelog-producer config option (#7417) lzljs3620320
• (paimon) branch master updated: [python] Improve the consumer_manager API and support in file_store_table (#7415) lzljs3620320
• (paimon) branch master updated: [flink] supports dynamic options for system table (#7414) lzljs3620320
• (paimon) branch master updated: [core] Add Compaction Sort Buffer metrics (#7411) lzljs3620320
• (paimon) branch master updated: [flink] fix blob type conversion (#7405) lzljs3620320
• (paimon) branch master updated: [python] Support getting snapshot by RESTCatalog (#7412) lzljs3620320
• (paimon) branch master updated: [core] Supoort Option of adding columns before partition (#7374) lzljs3620320
• (paimon) branch master updated: [test] Add random name to MergeIntoTableTestBase lzljs3620320
• (paimon) branch master updated: [flink] Enable BTreeIndexTopoBuilder to build multiple columns index in one job (#7413) junhao
• (paimon) branch master updated: [core] Introduce SimpleLsmKvDb to put and get based on Paimon SST (#7407) lzljs3620320
• (paimon) branch master updated: [core] Abstract KvCompactionManagerFactory in KeyValueFileStoreWrite (#7403) yuzelin
• (paimon) branch master updated: [python] Add consumer management for streaming progress (#7349) lzljs3620320
• (paimon-website) branch asf-site updated (bda218b2a -> 23bdf8ccd) github-bot
• (paimon) branch master updated: [python] Add row kind support for TableRead (#7394) lzljs3620320
• (paimon) branch master updated: [python] Make sure primary key not null in schema (#7406) lzljs3620320
• (paimon) branch master updated: [flink] StoreMultiCommitter support dynamic options per table (#7404) lzljs3620320
• (paimon) branch master updated: [core] Use snapshots in ExpireSnapshotsImpl (#7401) yuzelin
• (paimon) branch master updated: [python] file_scanner should use with_shard instead of new interfaces lzljs3620320
• (paimon) branch master updated: [python] Add FollowUpScanner, IncrementalDiffScanner, sharding (#7348) lzljs3620320
• (paimon) branch master updated: [python] Implement Python ObjectTable with read support (#7400) lzljs3620320
• (paimon-rust) branch main updated: feat: support read to arrow (#116) lzljs3620320
• (paimon) branch master updated: [core] Optimize snapshots collect in ExpireSnapshots (#7397) lzljs3620320
• (paimon) branch master updated: [core] Introduce hive bucket function to align with spark hive bucket (#7393) lzljs3620320
• (paimon) branch master updated: [flink] Implement FLIP-314 LineageVertexProvider for source and sink connectors (#7311) yunfengzhou
• (paimon-website) branch asf-site updated (16af87eb4 -> bda218b2a) github-bot
• (paimon) branch master updated: [flink] Migrate paimon-flink-cdc from KafkaDeserializationSchema to KafkaRecordDeserializationSchema (#7396) lzljs3620320
• (paimon) branch master updated: [flink] [spark] Fix btree procedure GlobalIndexMeta row range not accurate (#7354) lzljs3620320
• (paimon) branch master updated: [python] Fix wrong result when using where and limit in CLI table read (#7391) junhao
• (paimon-website) branch asf-site updated (37c3a747c -> 16af87eb4) github-bot
• (paimon) branch master updated: [doc] Fix ref error in data-types lzljs3620320
• (paimon) branch master updated: [python] Introduce where for Python CLI table read (#7389) lzljs3620320
• (paimon) branch master updated: [python] Fix blob table read failure when filtering by _ROW_ID (#7390) lzljs3620320
• (paimon) branch master updated: [test] fix unstable test for weighted external-path (#7387) lzljs3620320
• (paimon-rust) branch main updated: feat: introduce read builder (#114) lzljs3620320
• (paimon) branch master updated: [core] Support options in ObjectTable (#7378) lzljs3620320
• (paimon) branch master updated: [core] Fix chain table partition listing under data filters. (#7268) aitozi
• (paimon) branch master updated: [python] Backtick quoting for identifiers, exists_batch optimization (#7347) lzljs3620320
• (paimon) branch master updated: [core] upgrade lz4-java to 1.10.4 due to CVE (#7384) lzljs3620320
• (paimon) branch master updated: [core] upgrade snappy-java to 1.1.10.8 due to CVE (#7383) lzljs3620320
• (paimon) branch master updated: [core] Support partition range predicate pushdown for FilesTable (#7376) lzljs3620320
• (paimon) branch master updated: [spark] Optimize drop multi partitions in batch (#7380) lzljs3620320
• (paimon) branch master updated: [core] Validate the deletion vector is disabled for chain table (#7382) lzljs3620320
• (paimon) branch master updated: [core] upgrade aircompresssor to 2.0.3 due to CVE (#7375) lzljs3620320
• (paimon) branch master updated: [spark] Fix table name conflict in concurrent MergeInto tests (#7381) lzljs3620320
• (paimon) branch master updated: [python] Introduce select for CLI table read (#7377) lzljs3620320
• (paimon) branch master updated: [python] Correct pyroaring version in requirements lzljs3620320
• (paimon) branch master updated: [test] Enrich table name in MergeIntoTableTestBase lzljs3620320
• (paimon) branch master updated: [test] Fix unstable test: FileStoreLookupFunctionTest.testLookupScanLeak lzljs3620320
• (paimon) branch master updated: [python] Introduce Python CLI table snapshot (#7373) lzljs3620320
• (paimon) branch master updated: [python] Remove useless parameters in blob_writer.py lzljs3620320
• (paimon) branch master updated: [rest] Introduce reset consumer api in rest (#7372) lzljs3620320
• (paimon) branch master updated: [python] Fix time mapping by always using time32 (#7371) lzljs3620320
• (paimon-rust) branch main updated: feat: introduce basic deletion vector support (#110) lzljs3620320
• (paimon-rust) branch main updated: ci: introduce deny to check apache compatible licenses (#112) lzljs3620320
• (paimon-rust) branch main updated: ci: introduce spark paimon integration for integration test (#107) lzljs3620320
• (paimon-rust) branch main updated: feat: introduce table scan to plan splits (#96) lzljs3620320
• (paimon) branch master updated: [python] Introduce catalog list-dbs in Python CLI (#7366) lzljs3620320
• (paimon) branch master updated: [hotfix][docs] replace the documentation URL for data-types blob (#7370) lzljs3620320
• (paimon) branch master updated: [python] Add i short name to ignore-if-not-exists for database lzljs3620320
• (paimon) branch master updated: [python] Support dynamic bucket write (#7363) lzljs3620320
• (paimon) branch master updated: [python] Introduce database related commands to Python CLI (#7362) lzljs3620320
• (paimon) branch master updated: [python] Introduce table import, drop and alter to Python CLI (#7360) lzljs3620320
• (paimon) branch master updated: [python] Fix py version required in README (#7361) lzljs3620320
• (paimon) branch master updated: [python] support predicate NotBetween, Like function (#7352) lzljs3620320
• (paimon) branch master updated: [test] Add missing LeafFunction coverage in PredicateJsonSerdeTest (#7359) lzljs3620320
• (paimon) branch master updated: [python] Introduce Paimon CLI in PyPaimon (#7358) lzljs3620320
• (paimon-website) branch asf-site updated (5b6a57278 -> ba01b1d37) github-bot
• (paimon) branch master updated: [doc] Document ignoreIfExists for create_branch lzljs3620320
• (paimon) branch master updated: [core] Add IF NOT EXISTS support for create_branch operation (#7353) lzljs3620320
• (paimon) branch master updated: [python] Remove oss and pylance from requirements deps lzljs3620320
• (paimon) branch master updated: [hive] Lazily initialize HMS client pool in HiveCatalog (#7346) lzljs3620320
• (paimon) branch master updated: [core] introduce weighted strategy for external-path (#7356) lzljs3620320
• (paimon) branch master updated: [common] Fix possible deadlock in ParallelExecution (#7355) lzljs3620320
• (paimon-website) branch asf-site updated (19d78a771 -> 5b6a57278) github-bot
• (paimon-website) branch asf-site updated (a14aa009c -> 19d78a771) github-bot
• (paimon) branch master updated: [doc] Add rename_tag for python doc (#7345) lzljs3620320
• (paimon) branch master updated: [cdc] Add metadata column support for Kafka CDC connector (#7315) lzljs3620320
• (paimon) branch master updated: [rest] Introduce consumers api definition in rest (#7339) lzljs3620320
• (paimon) branch master updated: [doc] Fix typos in docs and code comments (#7341) lzljs3620320
• (paimon-website) branch asf-site updated (f74543a2b -> a14aa009c) github-bot
• (paimon) branch master updated: [core] Introduce Catalog.listPartitionsByNames (#7340) lzljs3620320
• (paimon) branch master updated: [filesystem] support report access extended information to DLF OSS (#7337) lzljs3620320
• (paimon-website) branch asf-site updated (85fe27b96 -> f74543a2b) github-bot
• (paimon) branch master updated: [flink] optimize flink Data-Evolution-Merge-Into (#7324) lzljs3620320
• (paimon-rust) branch main updated: fix(io): return correct list_status paths and reuse storage operators (#101) lzljs3620320
• (paimon-rust) branch main updated: feat: introduce snapshot manager (#103) lzljs3620320
• (paimon) branch master updated: [python] Support conflict detection when updating existing data concurrently. (#7323) lzljs3620320
• (paimon) branch master updated: [core] Refactor BlobFileContext for blob writing lzljs3620320
• (paimon) branch master updated: [core] Support external-storage BLOB columns and MERGE INTO updates for descriptor-based BLOB columns (#7328) lzljs3620320
• (paimon) branch master updated: [spark] Fix the case that exists filter expression in merge-into on clause (#7334) lzljs3620320
• (paimon) branch master updated: [core] Enable clustering before write phase for incremental clustering table (#7331) lzljs3620320
• (paimon-website) branch asf-site updated (955adf079 -> 85fe27b96) github-bot
• (paimon) branch master updated: [hotfix] Ignore unstable test: AliyunJson lzljs3620320
• (paimon-rust) branch main updated: feat: Introduce split & plan (#95) lzljs3620320
• (paimon) branch master updated: [python] Support rollback API for RESTCatalog and FileStoreTable (#7325) lzljs3620320
• (paimon) branch master updated: [core] Support consumer_id predicate pushdown for ConsumersTable (#7329) lzljs3620320
• (paimon) branch master updated: [hotfix] Remove useless codes for faiss and lucene lzljs3620320
• (paimon-rust) branch main updated: feat: introduce manifest (#94) lzljs3620320
• (paimon-rust) branch main updated: feat: introduce filesystem catalog (#93) lzljs3620320
• (paimon) branch master updated: [iceberg] Avoid partition evolution when partition fieldId is not 0 (#7186) lzljs3620320
• (paimon-website) branch asf-site updated (8738c01db -> 955adf079) github-bot
• (paimon) branch master updated: [python] Fix read after data evolution updating by shard (#7157) lzljs3620320
• (paimon-website) branch asf-site updated (3c41fac07 -> 8738c01db) github-bot
• (paimon) branch master updated: [python] Support rename tag API for pypaimon (#7322) lzljs3620320
• (paimon) branch master updated: [core] Fix testEmptyPartitionDirectories failure by making empty dir older (#7320) lzljs3620320
• (paimon) branch master updated: [core] Support ignore corrupt or lost files during read (#6821) aitozi
• (paimon) branch master updated: [test] Use new version of kafka docker image lzljs3620320
• (paimon) branch master updated: [doc] Fix Flink Call Statements documentation link (#7321) lzljs3620320
• (paimon) branch dependabot/maven/paimon-faiss/paimon-faiss-e2e-test/com.fasterxml.jackson.core-jackson-core-2.18.6 deleted (was d134bdc38f) github-bot
• (paimon) branch master updated: [core] Introduce BTreeIndexReader.createIterator to iterator all records in BTree (#7318) lzljs3620320
• (paimon) branch dependabot/maven/paimon-faiss/paimon-faiss-e2e-test/com.fasterxml.jackson.core-jackson-core-2.18.6 created (now d134bdc38f) github-bot
• (paimon) branch master updated: [doc] Fix paimon-website-javadoc profile to use its own maven-javadoc-plugin (#7317) lzljs3620320
• (paimon) branch master updated: [docs] Fixing the discrepancies inside the docs with respect to procedure parallelism (#7198) lzljs3620320
• (paimon) branch master updated: [core] Update lastFullCompaction in EarlyFullCompaction when triggering full compaction via size thresholds (#7314) lzljs3620320
• (paimon-website) branch asf-site updated (c4c6d5b39 -> 3c41fac07) github-bot
• (paimon-rust) branch main updated: feat: introduce catalog api (#92) lzljs3620320
• (paimon) branch master updated: [core] Update comments of BlobDescriptor lzljs3620320
• (paimon) branch master updated: [python] Add multi-threaded prefetch for pytorch streaming read (#7143) lzljs3620320
• (paimon) branch master updated: [core] Support schema_id predicate pushdown for ManifestsTable (#7310) lzljs3620320
• (paimon) branch master updated: [python] Support update partial file by row id (#7307) lzljs3620320
• (paimon-website) branch asf-site updated (b8550e12 -> c4c6d5b3) github-bot
• (paimon) branch master updated: [python] Rename Blob Stored to Blob Descriptor Field lzljs3620320
• (paimon) branch master updated: [core] Optimize data-evolution scan with index (#7305) lzljs3620320
• (paimon) branch master updated: [core]: Supporting repair procedure for Jdbc catalogs (#7289) lzljs3620320
• (paimon) branch master updated: [test] Fix flaky testDlfStSTokenPathAuth (#7309) lzljs3620320
• (paimon) branch master updated: [core] Support empty dirs cleaning without bucket sub dir in orphan files cleanup (#7295) lzljs3620320
• (paimon) branch master updated: [core] Refactor AppendOnlyFileStoreScan to do limit in readManifestEntries early lzljs3620320
• (paimon) branch master updated: [core] Data evolution table limit push down (#7298) lzljs3620320
• (paimon) branch master updated: [core] Introduce NullTransform for AlwaysTrue and AlwaysFalse lzljs3620320

• Earlier messages
• Later messages