Re: [I] [Bug] [hive to clickhouse 2.3.8] Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [s

2024-11-15 Thread via GitHub
littlecool857 commented on issue #7962: URL: https://github.com/apache/seatunnel/issues/7962#issuecomment-2478192647 > > > > 我有同样的问题,我将 exec.jar metastore.jar common.jar 更改为 2.x 版本,然后它就可以工作了 > > > > > > > > > ![图像](https://private-user-images.githubusercontent.com/141210485/386491

Re: [PR] [Improve][POM] Bump the version of maven-shade-plugin to 3.4.1 [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN merged PR #8067: URL: https://github.com/apache/seatunnel/pull/8067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

[PR] [Feature][robot]Add auto-translation robot [seatunnel]

2024-11-15 Thread via GitHub
davidzollo opened a new pull request, #8069: URL: https://github.com/apache/seatunnel/pull/8069 There're many non-English issues in the issue list, this robot will auto translate the issue to English. -- This is an automated message from the Apache Git Service. To respond to the message,

(seatunnel) branch dev updated: [Improve][POM] Bump the version of maven-shade-plugin to 3.4.1 (#8067)

2024-11-15 Thread zhouyao2023
This is an automated email from the ASF dual-hosted git repository. zhouyao2023 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 102d9f9b25 [Improve][POM] Bump the version of

Re: [PR] [Feature][RestAPI] Support submit job with seatunnel style hocon format config [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X commented on code in PR #8000: URL: https://github.com/apache/seatunnel/pull/8000#discussion_r1843116907 ## docs/en/seatunnel-engine/rest-api-v2.md: ## @@ -384,11 +384,12 @@ When we can't get the job info, the response will be: Parameters -> | name

Re: [I] [Bug] [hive to clickhouse 2.3.8] Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [s

2024-11-15 Thread via GitHub
littlecool857 commented on issue #7962: URL: https://github.com/apache/seatunnel/issues/7962#issuecomment-2478195372 > > > > 我有同样的问题,我将 exec.jar metastore.jar common.jar 更改为 2.x 版本,然后它就可以工作了 > > > > > > > > > ![图像](https://private-user-images.githubusercontent.com/141210485/386491

Re: [I] [Bug] [hive to clickhouse 2.3.8] Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [s

2024-11-15 Thread via GitHub
littlecool857 commented on issue #7962: URL: https://github.com/apache/seatunnel/issues/7962#issuecomment-2478202990 > 24/11/01 18:00:50 INFO HiveMetaStoreProxy: hive client conf:Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site

Re: [I] [Bug] [hive to clickhouse 2.3.8] Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [s

2024-11-15 Thread via GitHub
laixueyong commented on issue #7962: URL: https://github.com/apache/seatunnel/issues/7962#issuecomment-2478178270 > > > 我有同样的问题,我将 exec.jar metastore.jar common.jar 更改为 2.x 版本,然后它就可以工作了 > > > > > > ![图像](https://private-user-images.githubusercontent.com/141210485/386491002-df3e7b8

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843551886 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/CatalogTableUtil.java: ## @@ -111,6 +111,16 @@ public static List getCatalogTables(

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843554773 ## seatunnel-examples/seatunnel-engine-examples/src/main/java/org/apache/seatunnel/example/engine/SeaTunnelEngineLocalExample.java: ## @@ -36,7 +36,7 @@ public c

Re: [PR] [Feature][robot]Add auto-translation robot [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X commented on PR #8069: URL: https://github.com/apache/seatunnel/pull/8069#issuecomment-2478575299 I'm not sure if we need this, it will make users more likely to submit issues in Chinese. This is what we don't want to see. cc @hailin0 -- This is an automated message from the Apa

Re: [PR] [Improve][Zeta] Remove default jvm memory option [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X commented on code in PR #8068: URL: https://github.com/apache/seatunnel/pull/8068#discussion_r1843593226 ## seatunnel-e2e/seatunnel-e2e-common/src/test/java/org/apache/seatunnel/e2e/common/util/ContainerUtil.java: ## @@ -317,7 +320,9 @@ public static List discoverTestCo

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
liunaijie commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1843685439 ## docs/en/connector-v2/source/kafka.md: ## @@ -59,6 +59,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ### Simple > Thi

[PR] [Improve][Transform] Optimize transform structure [seatunnel]

2024-11-15 Thread via GitHub
corgy-w opened a new pull request, #8071: URL: https://github.com/apache/seatunnel/pull/8071 ### Purpose of this pull request Optimize transform structure ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Original test case

Re: [I] [Bug] [Module Name] SeaTunnel job executed failed JDBC Notfound [seatunnel]

2024-11-15 Thread via GitHub
github-actions[bot] commented on issue #7856: URL: https://github.com/apache/seatunnel/issues/7856#issuecomment-2480215312 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][E2E][Flink] Add e2e test case about flink on yarn sumbit [seatunnel]

2024-11-15 Thread via GitHub
github-actions[bot] commented on issue #7853: URL: https://github.com/apache/seatunnel/issues/7853#issuecomment-2480215363 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] seatunnel-web也应该来个docker的 [seatunnel]

2024-11-15 Thread via GitHub
github-actions[bot] commented on issue #7850: URL: https://github.com/apache/seatunnel/issues/7850#issuecomment-2480215416 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

(seatunnel) branch dev updated: [Fix][Kafka] Fix in kafka streaming mode can not read incremental data (#7871)

2024-11-15 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new a0eeeb9b62 [Fix][Kafka] Fix in kafka streaming mode

Re: [PR] [Fix][Kafka] Fix in kafka streaming mode can not read incremental data [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X merged PR #7871: URL: https://github.com/apache/seatunnel/pull/7871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

(seatunnel) branch dev updated: [Hotfix][Transforms-v2] DynamicCompile Plugin compatibility fix (#8057)

2024-11-15 Thread dailai
This is an automated email from the ASF dual-hosted git repository. dailai pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 41b5a88d61 [Hotfix][Transforms-v2] DynamicCompile P

Re: [PR] [Feature][Clickhouse] Support multi-table source read [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X commented on code in PR #7529: URL: https://github.com/apache/seatunnel/pull/7529#discussion_r1843628766 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -62,65

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
liunaijie commented on PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#issuecomment-2478745040 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [PR] [Improve][Connector-V2] Change read excel util from POI to EasyExcel [seatunnel]

2024-11-15 Thread via GitHub
dwave commented on code in PR #8064: URL: https://github.com/apache/seatunnel/pull/8064#discussion_r1843657279 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/test/java/org/apache/seatunnel/connectors/seatunnel/file/Reader/ExcelReadStrategyTest.java: ## @@ -54,

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843546690 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions.java: ## @@ -55,6 +55,12 @@ public static class TableIdentifierOp

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843546690 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions.java: ## @@ -55,6 +55,12 @@ public static class TableIdentifierOp

Re: [PR] [Feature][robot]Add auto-translation robot [seatunnel]

2024-11-15 Thread via GitHub
hailin0 commented on PR #8069: URL: https://github.com/apache/seatunnel/pull/8069#issuecomment-2478612233 > I would rather have a script that can directly close Chinese issues +1 This may prompt users to submit questions in English -- This is an automated message from the Apache

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1843694251 ## docs/en/connector-v2/source/kafka.md: ## @@ -59,6 +59,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ### Simple >

(seatunnel) branch dev updated: [Hotfix][Docs]Correct errors in the FAQ doc (#8048)

2024-11-15 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 8d893f9ba5 [Hotfix][Docs]Correct errors in the

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1843694251 ## docs/en/connector-v2/source/kafka.md: ## @@ -59,6 +59,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ### Simple >

Re: [PR] [Hotfix][Docs]Correct errors in the FAQ doc [seatunnel]

2024-11-15 Thread via GitHub
hailin0 merged PR #8048: URL: https://github.com/apache/seatunnel/pull/8048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1843694251 ## docs/en/connector-v2/source/kafka.md: ## @@ -59,6 +59,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ### Simple >

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1843699821 ## docs/en/connector-v2/source/kafka.md: ## @@ -59,6 +59,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ### Simple >

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1843707024 ## docs/en/connector-v2/source/kafka.md: ## @@ -59,6 +59,7 @@ They can be downloaded via install-plugin.sh or from the Maven central repositor ### Simple >

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
hawk9821 commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843707886 ## seatunnel-examples/seatunnel-engine-examples/pom.xml: ## @@ -67,5 +67,11 @@ ${project.version} + +org.apache.seatunne

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
hawk9821 commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843766820 ## seatunnel-examples/seatunnel-engine-examples/src/main/java/org/apache/seatunnel/example/engine/SeaTunnelEngineLocalExample.java: ## @@ -36,7 +36,7 @@ public class

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
hawk9821 commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843765911 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/CatalogTableUtil.java: ## @@ -111,6 +111,16 @@ public static List getCatalogTables(

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
hawk9821 commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843770491 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions.java: ## @@ -55,6 +55,12 @@ public static class TableIdentifierOption

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
hawk9821 commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843770491 ## seatunnel-api/src/main/java/org/apache/seatunnel/api/table/catalog/schema/TableSchemaOptions.java: ## @@ -55,6 +55,12 @@ public static class TableIdentifierOption

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843544282 ## seatunnel-examples/seatunnel-engine-examples/pom.xml: ## @@ -67,5 +67,11 @@ ${project.version} + +org.apache.seat

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-15 Thread via GitHub
Carl-Zhou-CN commented on code in PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#discussion_r1843544882 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-mongodb-e2e/src/test/java/mongodb/MongodbCDCIT.java: ## @@ -295,12 +312,35 @@ private List> querySql()

Re: [PR] [Feature][robot]Add auto-translation robot [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X commented on PR #8069: URL: https://github.com/apache/seatunnel/pull/8069#issuecomment-2478577117 I would rather have a script that can directly close Chinese issues -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[I] [Bug] [Connector][Paimon] setLoadTable too late when restoreJob [seatunnel]

2024-11-15 Thread via GitHub
yoogoc opened a new issue, #8070: URL: https://github.com/apache/seatunnel/issues/8070 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Improve][Connector-V2] Change read excel util from POI to EasyExcel [seatunnel]

2024-11-15 Thread via GitHub
Hisoka-X commented on code in PR #8064: URL: https://github.com/apache/seatunnel/pull/8064#discussion_r1843609823 ## seatunnel-connectors-v2/connector-file/connector-file-base/src/test/java/org/apache/seatunnel/connectors/seatunnel/file/Reader/ExcelReadStrategyTest.java: ## @@ -

Re: [PR] [Refactor][Config] Rename `result_table_name`/`source_table_name` [seatunnel]

2024-11-15 Thread via GitHub
hailin0 closed pull request #8072: [Refactor][Config] Rename `result_table_name`/`source_table_name` URL: https://github.com/apache/seatunnel/pull/8072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[PR] [Refactor][Config] Rename `result_table_name`/`source_table_name` [seatunnel]

2024-11-15 Thread via GitHub
hailin0 opened a new pull request, #8072: URL: https://github.com/apache/seatunnel/pull/8072 ### Purpose of this pull request close #8062 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check l