[PR] [Hotfix][Connector-V2] ExcelReader read more than 65000 rows XSSFWorkbook will cause oom . so change POI to EasyExcel #8040 [seatunnel]

2024-11-14 Thread via GitHub
dwave opened a new pull request, #8064: URL: https://github.com/apache/seatunnel/pull/8064 #8040 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ###

[PR] [Improve][POM] Bump the version of maven-shade-plugin to 3.4.1 [seatunnel]

2024-11-14 Thread via GitHub
dailai opened a new pull request, #8067: URL: https://github.com/apache/seatunnel/pull/8067 ### Purpose of this pull request I defined a SPI services in paimon connetor. ![1](https://github.com/user-attachments/assets/d4858e0e-ce9e-4d36-9fcd-39de89543272) The SPI se

Re: [PR] [Feature][Connector-V2]Jdbc chunk split add snapshotSplitColumn config #7794 [seatunnel]

2024-11-14 Thread via GitHub
XenosK commented on code in PR #7840: URL: https://github.com/apache/seatunnel/pull/7840#discussion_r1843262081 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/enumerator/splitter/AbstractJdbcSourceChunkSplitter.j

[I] [Bug] [mysqlCDC-to-kafka] Unable to create a source for identifier 'MySQL-CDC' [seatunnel]

2024-11-14 Thread via GitHub
aiyi926 opened a new issue, #8063: URL: https://github.com/apache/seatunnel/issues/8063 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] psgsql表的id是uuid,执行任务报错 [seatunnel]

2024-11-14 Thread via GitHub
scyCoder opened a new issue, #8066: URL: https://github.com/apache/seatunnel/issues/8066 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [IMP] [ci] Add JAVA_TOOL_OPTIONS for CodeQL [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1276: [IMP] [ci] Add JAVA_TOOL_OPTIONS for CodeQL URL: https://github.com/apache/seatunnel/issues/1276 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [Hotfix][Docs]Correct errors in the FAQ doc [seatunnel]

2024-11-14 Thread via GitHub
davidzollo commented on PR #8048: URL: https://github.com/apache/seatunnel/pull/8048#issuecomment-2477801056 @Hisoka-X Thanks for your suggestions, I have updated the en and ch docs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] Failed to read kafka data and write hive data [seatunnel]

2024-11-14 Thread via GitHub
flymianmian commented on issue #8056: URL: https://github.com/apache/seatunnel/issues/8056#issuecomment-2477744567 2.3.6 修了几个hive 的bug,你可以升级下版本试试。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [Feature][Connector-V2]Jdbc chunk split add snapshotSplitColumn config #7794 [seatunnel]

2024-11-14 Thread via GitHub
hailin0 commented on code in PR #7840: URL: https://github.com/apache/seatunnel/pull/7840#discussion_r1843097328 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/enumerator/splitter/AbstractJdbcSourceChunkSplitter.

Re: [PR] [Feature][Clickhouse] Support multi-table source read [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X commented on code in PR #7529: URL: https://github.com/apache/seatunnel/pull/7529#discussion_r1843098510 ## docs/en/connector-v2/source/Clickhouse.md: ## @@ -1,3 +1,4 @@ + Review Comment: ```suggestion ``` ## docs/en/connector-v2/source/Clickhouse.md:

Re: [I] [Feature][Plugin] Add spark ignite connector [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1127: [Feature][Plugin] Add spark ignite connector URL: https://github.com/apache/seatunnel/issues/1127 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Bug] [Core] VerifyError: Bad type on operand stack [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1147: [Bug] [Core] VerifyError: Bad type on operand stack URL: https://github.com/apache/seatunnel/issues/1147 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] [Feature] Introduce seatunnel-backend module [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1573: [Feature] Introduce seatunnel-backend module URL: https://github.com/apache/seatunnel/issues/1573 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Feature][Mysql-CDC] Support 8.4 and 9 [seatunnel]

2024-11-14 Thread via GitHub
dailai commented on PR #7952: URL: https://github.com/apache/seatunnel/pull/7952#issuecomment-241548 It's not all right. Currently, seatunnel's cdc depends on debezium 1.9.8.Final which is the highest version currently supported by java8. I think debezium should also be adapted to suppo

Re: [I] [Feature][Clickhouse] Support sink savemode [seatunnel]

2024-11-14 Thread via GitHub
zhangshenghang commented on issue #8060: URL: https://github.com/apache/seatunnel/issues/8060#issuecomment-2477790831 Please assign it to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] [Bug] [common] remove Common.setDeployMode [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1346: [Bug] [common] remove Common.setDeployMode URL: https://github.com/apache/seatunnel/issues/1346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [Feature][docs] Add announcement page in our website to new release and new committer/PMC [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1619: [Feature][docs] Add announcement page in our website to new release and new committer/PMC URL: https://github.com/apache/seatunnel/issues/1619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] [Feature][connector-spark] add a jdbc connector base DataSource V2 API [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1347: [Feature][connector-spark] add a jdbc connector base DataSource V2 API URL: https://github.com/apache/seatunnel/issues/1347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Feature][doc] Add search component for our document [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1470: [Feature][doc] Add search component for our document URL: https://github.com/apache/seatunnel/issues/1470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] [Bug] [JCommander] Error when starting start-seatunnel-flink.sh [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1356: [Bug] [JCommander] Error when starting start-seatunnel-flink.sh URL: https://github.com/apache/seatunnel/issues/1356 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [Feature][Clickhouse] Support multi-table source read [seatunnel]

2024-11-14 Thread via GitHub
zhilinli123 commented on code in PR #7529: URL: https://github.com/apache/seatunnel/pull/7529#discussion_r1843134041 ## seatunnel-connectors-v2/connector-clickhouse/src/main/java/org/apache/seatunnel/connectors/seatunnel/clickhouse/source/ClickhouseSourceFactory.java: ## @@ -62,

Re: [I] Read kafka data in real time failed to be written to hive [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #8058: Read kafka data in real time failed to be written to hive URL: https://github.com/apache/seatunnel/issues/8058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] [Feature][Plugin] Add Plugin Flink Source Postgre CDC [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1070: [Feature][Plugin] Add Plugin Flink Source Postgre CDC URL: https://github.com/apache/seatunnel/issues/1070 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [Feature][Plugin] Add Plugin Flink Sink Elasticsearch [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1065: [Feature][Plugin] Add Plugin Flink Sink Elasticsearch URL: https://github.com/apache/seatunnel/issues/1065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [Feature][Maven] Add Dependabot to create PR to upgrade dependency automatically [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1049: [Feature][Maven] Add Dependabot to create PR to upgrade dependency automatically URL: https://github.com/apache/seatunnel/issues/1049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [I] [Feature][Plugin] Add Plugin Flink Source TiDB [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1067: [Feature][Plugin] Add Plugin Flink Source TiDB URL: https://github.com/apache/seatunnel/issues/1067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Feature][Plugin] Add Plugin Flink Source Mongodb CDC [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1066: [Feature][Plugin] Add Plugin Flink Source Mongodb CDC URL: https://github.com/apache/seatunnel/issues/1066 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [Feature][Plugin] Support spark batch sink to Datalake Delta [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1032: [Feature][Plugin] Support spark batch sink to Datalake Delta URL: https://github.com/apache/seatunnel/issues/1032 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] [Feature][Plugin] Add Plugin Flink Source Clickhouse [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1062: [Feature][Plugin] Add Plugin Flink Source Clickhouse URL: https://github.com/apache/seatunnel/issues/1062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] [Feature][Plugin] Add Plugin Flink Source Elasticsearch [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1064: [Feature][Plugin] Add Plugin Flink Source Elasticsearch URL: https://github.com/apache/seatunnel/issues/1064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [DISCUSS]Unified DSL Design(alternatives HOCON, SQL, JSON, YAML ... [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #964: [DISCUSS]Unified DSL Design(alternatives HOCON, SQL, JSON, YAML ... URL: https://github.com/apache/seatunnel/issues/964 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] [Discuss][plugin] unify the format of parameters in plugins [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #932: [Discuss][plugin] unify the format of parameters in plugins URL: https://github.com/apache/seatunnel/issues/932 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] [DISCUSS] Support Datalake import adaptation [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #734: [DISCUSS] Support Datalake import adaptation URL: https://github.com/apache/seatunnel/issues/734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [Feature][transform] spark.read.json(RDD) deprecated [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #893: [Feature][transform] spark.read.json(RDD) deprecated URL: https://github.com/apache/seatunnel/issues/893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] [Improvement][README] seatunnel-workflow picture in README the display effect is not good [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #908: [Improvement][README] seatunnel-workflow picture in README the display effect is not good URL: https://github.com/apache/seatunnel/issues/908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [I] [Feature][plugin-spark-sink-clickhouse] Add The function of execute initializing ClickHouse SQL before synchronizing data [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #768: [Feature][plugin-spark-sink-clickhouse] Add The function of execute initializing ClickHouse SQL before synchronizing data URL: https://github.com/apache/seatunnel/issues/768 -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] ERROR Seatunnel: Reason:SQL validation failed. From line 1, column 28 to line 1, column 40: Object 'user_20211216' not found [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1096: ERROR Seatunnel: Reason:SQL validation failed. From line 1, column 28 to line 1, column 40: Object 'user_20211216' not found URL: https://github.com/apache/seatunnel/issues/1096 -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [I] ERROR Seatunnel: Reason:SQL validation failed. From line 1, column 28 to line 1, column 40: Object 'user_20211216' not found [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on issue #1096: URL: https://github.com/apache/seatunnel/issues/1096#issuecomment-2477761201 close it as not active -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [Feature]Support rate limit [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1082: [Feature]Support rate limit URL: https://github.com/apache/seatunnel/issues/1082 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [I] IDE run project no working [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1311: IDE run project no working URL: https://github.com/apache/seatunnel/issues/1311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] [Feature][Spark] Add breakpoint resume [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1325: [Feature][Spark] Add breakpoint resume URL: https://github.com/apache/seatunnel/issues/1325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class[Bug] [Module Name] Bug title [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1306: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class[Bug] [Module Name] Bug title URL: https://github.com/apache/seatunnel/issues/1306 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] [Feature][Udf] Whether to add UDF/UDAF/UDTF Module [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1295: [Feature][Udf] Whether to add UDF/UDAF/UDTF Module URL: https://github.com/apache/seatunnel/issues/1295 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] [Feature][Spark] Add MaxCompute to source and sink [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1323: [Feature][Spark] Add MaxCompute to source and sink URL: https://github.com/apache/seatunnel/issues/1323 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] Whether to support restful api (http) as input source? [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1270: Whether to support restful api (http) as input source? URL: https://github.com/apache/seatunnel/issues/1270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [Bug] [ci] seatunnel-dist: Failed to create assembly [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1290: [Bug] [ci] seatunnel-dist: Failed to create assembly URL: https://github.com/apache/seatunnel/issues/1290 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] [Feature][Connectors] Add IoTDB Flink Source [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1288: [Feature][Connectors] Add IoTDB Flink Source URL: https://github.com/apache/seatunnel/issues/1288 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Feature][connectors] some questions about configuration files management [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1138: [Feature][connectors] some questions about configuration files management URL: https://github.com/apache/seatunnel/issues/1138 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] [Bug] [seatunnel-core-spark] ClassNotFoundException throw while run with spark3.0.3 [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1284: [Bug] [seatunnel-core-spark] ClassNotFoundException throw while run with spark3.0.3 URL: https://github.com/apache/seatunnel/issues/1284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [Bug] [seatunnel-connector-spark-hudi] spark connector writes data to hudi error [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1164: [Bug] [seatunnel-connector-spark-hudi] spark connector writes data to hudi error URL: https://github.com/apache/seatunnel/issues/1164 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [I] [Feature][Spark] Add remote debug for spark job [seatunnel]

2024-11-14 Thread via GitHub
liunaijie closed issue #1161: [Feature][Spark] Add remote debug for spark job URL: https://github.com/apache/seatunnel/issues/1161 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[I] [Bug] [streaming] 流式任务状态显示失败但是任务仍在运行,也无法手工停止 [seatunnel]

2024-11-14 Thread via GitHub
exitNA opened a new issue, #8065: URL: https://github.com/apache/seatunnel/issues/8065 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Feature][Mongodb-CDC] Support multi-table read [seatunnel]

2024-11-14 Thread via GitHub
hawk9821 commented on PR #8029: URL: https://github.com/apache/seatunnel/pull/8029#issuecomment-2478124544 ![image](https://github.com/user-attachments/assets/92aaf3a2-42a6-48e7-a370-d1264f0ce610) -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] [Bug] [hive to clickhouse 2.3.8] Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [s

2024-11-14 Thread via GitHub
laixueyong commented on issue #7962: URL: https://github.com/apache/seatunnel/issues/7962#issuecomment-2478098293 > 我有同样的问题,我将 exec.jar metastore.jar common.jar 更改为 2.x 版本,然后它就可以工作了 ![image](https://github.com/user-attachments/assets/df3e7b81-01ce-4f36-ac2e-da324eab8df8) 还是报这个问题 缺

[PR] [Improve][Zeta] Remove default jvm memory option [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X opened a new pull request, #8068: URL: https://github.com/apache/seatunnel/pull/8068 ### Purpose of this pull request Remove default jvm memory option, let jvm set default xms/xmx by itself. ### Does this PR introduce _any_ user-facing change? no

Re: [I] [Bug] [hive to clickhouse 2.3.8] Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(Lorg/apache/hadoop/hive/conf/HiveConf;)V [s

2024-11-14 Thread via GitHub
littlecool857 commented on issue #7962: URL: https://github.com/apache/seatunnel/issues/7962#issuecomment-2478110705 > > 我有同样的问题,我将 exec.jar metastore.jar common.jar 更改为 2.x 版本,然后它就可以工作了 > > ![image](https://private-user-images.githubusercontent.com/141210485/386491002-df3e7b81-01ce-4

Re: [PR] [Hotfix][Transforms-v2] DynamicCompile Plugin compatibility fix [seatunnel]

2024-11-14 Thread via GitHub
dailai merged PR #8057: URL: https://github.com/apache/seatunnel/pull/8057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel

Re: [I] psgsql表的id是uuid,执行任务报错 [seatunnel]

2024-11-14 Thread via GitHub
CosmosNi commented on issue #8066: URL: https://github.com/apache/seatunnel/issues/8066#issuecomment-2478144420 id = "string" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [Bug] [connector-kafka] kafka source commit offset fail and can not consume data [seatunnel]

2024-11-14 Thread via GitHub
github-actions[bot] commented on issue #7839: URL: https://github.com/apache/seatunnel/issues/7839#issuecomment-2477697628 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [MYSQL-CDC] 并行读取MySQL表数据同步到doris时, 表有主键和唯一索引,但是数据不使用主键(id)进行分割,而是使用唯一键进行分割。 [seatunnel]

2024-11-14 Thread via GitHub
github-actions[bot] commented on issue #7794: URL: https://github.com/apache/seatunnel/issues/7794#issuecomment-2477697829 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][connector-hive] hive sink connector support overwrite mode [seatunnel]

2024-11-14 Thread via GitHub
github-actions[bot] commented on issue #7843: URL: https://github.com/apache/seatunnel/issues/7843#issuecomment-2477697568 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] seatunnel 2.3.5 cant start [seatunnel]

2024-11-14 Thread via GitHub
github-actions[bot] commented on issue #7846: URL: https://github.com/apache/seatunnel/issues/7846#issuecomment-2477697478 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Config] Rename config key [seatunnel]

2024-11-14 Thread via GitHub
hailin0 commented on issue #8062: URL: https://github.com/apache/seatunnel/issues/8062#issuecomment-2477856305 `source_table_name` -> `plugin_input_identifier` `result_table_name` -> `plugin_output_identifier` -- This is an automated message from the Apache Git Service. To respond to th

[I] [Feature][Config] Rename config key [seatunnel]

2024-11-14 Thread via GitHub
hailin0 opened a new issue, #8062: URL: https://github.com/apache/seatunnel/issues/8062 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [PR] [Bug] [Seatunnel-web] fix build prod [seatunnel-web]

2024-11-14 Thread via GitHub
susanbushisan commented on PR #241: URL: https://github.com/apache/seatunnel-web/pull/241#issuecomment-2475912906 > @susanbushisan, For me the build is success without your change also. Seems the build failed for you because of local environment issue. ![image](https://github.com/use

Re: [I] Read kafka data in real time failed to be written to hive [seatunnel]

2024-11-14 Thread via GitHub
gaotong521 commented on issue #8058: URL: https://github.com/apache/seatunnel/issues/8058#issuecomment-2476090032 ![image](https://github.com/user-attachments/assets/1a2cee89-daab-4b92-a222-65a149b4f1e0) -- This is an automated message from the Apache Git Service. To respond to the me

Re: [I] mysql to doris, report this error, Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:8040 [/127.0.0.1] failed: Connection refused (Connection refused) [seatunnel]

2024-11-14 Thread via GitHub
hawk9821 commented on issue #7999: URL: https://github.com/apache/seatunnel/issues/7999#issuecomment-2476098951 @FN20200222 please refer to the DorisE2E initializeBE method . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [Feature][Connector-V2]Jdbc chunk split add snapshotSplitColumn config #7794 [seatunnel]

2024-11-14 Thread via GitHub
hailin0 commented on code in PR #7840: URL: https://github.com/apache/seatunnel/pull/7840#discussion_r1842162259 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/enumerator/splitter/AbstractJdbcSourceChunkSplitter.

Re: [PR] [Improve][Connector][StarRocks] Add StarRocks TypeConverter. [seatunnel]

2024-11-14 Thread via GitHub
jw-itq commented on PR #7776: URL: https://github.com/apache/seatunnel/pull/7776#issuecomment-2476536987 > > Hi @FlechazoW , please fix test case. Thanks > > Ok, I will complete this task later. hi @FlechazoW ,can this pr be completed soon? we would like to use TypeConverter, T

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#issuecomment-2475968853 > ![image](https://private-user-images.githubusercontent.com/36789477/381793391-477a380b-b0a7-4ce7-8a16-7832bca89610.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY2

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1841991174 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceSplitEnumerator.java: ## @@ -344,6 +351,1

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1841853562 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceSplitEnumerator.java: ## @@ -344,6 +351,1

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1841856934 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceSplitEnumerator.java: ## @@ -344,6 +35

Re: [I] Failed to read kafka data and write hive data [seatunnel]

2024-11-14 Thread via GitHub
gaotong521 commented on issue #8056: URL: https://github.com/apache/seatunnel/issues/8056#issuecomment-2475877634 > > No error is reported, kerberos login is normal, but only a dozen data can be written, and then it is always running, but the data is not written > > You can update to

Re: [I] Failed to read kafka data and write hive data [seatunnel]

2024-11-14 Thread via GitHub
gaotong521 commented on issue #8056: URL: https://github.com/apache/seatunnel/issues/8056#issuecomment-2475760601 No error is reported, kerberos login is normal, but only a dozen data can be written, and then it is always running, but the data is not written -- This is an automated messag

Re: [I] Failed to read kafka data and write hive data [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on issue #8056: URL: https://github.com/apache/seatunnel/issues/8056#issuecomment-2475784146 > No error is reported, kerberos login is normal, but only a dozen data can be written, and then it is always running, but the data is not written You can update to Console

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1841812692 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceSplitEnumerator.java: ## @@ -344,6 +351,1

Re: [I] Failed to read kafka data and write hive data [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on issue #8056: URL: https://github.com/apache/seatunnel/issues/8056#issuecomment-2475789566 And for your config, you use `FieldMapper ` and `Sql`, you can merge them into `Sql` transform. the sql query is like: ``` select col_a as new_col_a, b, col_c as new_

[I] Failed to read kafka data and write hive data [seatunnel]

2024-11-14 Thread via GitHub
gaotong521 opened a new issue, #8056: URL: https://github.com/apache/seatunnel/issues/8056 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1841828066 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceSplitEnumerator.java: ## @@ -344,6 +35

Re: [I] [Bug] [Connectors-v2] "NullPointerException Due to Incomplete Metadata Extraction in SeaTunnel Kafka [seatunnel]

2024-11-14 Thread via GitHub
liunaijie commented on issue #8053: URL: https://github.com/apache/seatunnel/issues/8053#issuecomment-2475815543 I got similar issue today. My version is 2.3.5 My error stack is ``` java.util.concurrent.CompletionException: java.lang.RuntimeException: java.util.concurrent.Execu

[I] [Feature][Clickhouse] Support sink ddl [seatunnel]

2024-11-14 Thread via GitHub
hailin0 opened a new issue, #8061: URL: https://github.com/apache/seatunnel/issues/8061 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [PR] [Hotfix][Docs]Correct errors in the FAQ doc [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X commented on code in PR #8048: URL: https://github.com/apache/seatunnel/pull/8048#discussion_r1842007810 ## README.md: ## @@ -144,6 +144,7 @@ Yes, SeaTunnel is available under the Apache 2.0 License, allowing commercial us Our [Official Documentation](https://seatun

Re: [PR] [Bug][connectors-v2] fix mongodb bson convert exception [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X commented on PR #8044: URL: https://github.com/apache/seatunnel/pull/8044#issuecomment-2476043018 cc @loustler as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
Carl-Zhou-CN commented on code in PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#discussion_r1842081399 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceSplitEnumerator.java: ## @@ -344,6 +35

Re: [PR] [Feature][Connector-V2] Jdbc support trino dialect [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X commented on code in PR #8026: URL: https://github.com/apache/seatunnel/pull/8026#discussion_r1842049672 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-2/src/test/resources/jdbc_trino_source_and_console .conf: ## @@ -0,0 +1,48 @@

[I] Read kafka data in real time failed to be written to hive [seatunnel]

2024-11-14 Thread via GitHub
gaotong521 opened a new issue, #8058: URL: https://github.com/apache/seatunnel/issues/8058 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

Re: [PR] [Bugfix][Kafka] In kafka flow mode, stop offse should be Long.MAX_VALUE [seatunnel]

2024-11-14 Thread via GitHub
Carl-Zhou-CN commented on PR #7871: URL: https://github.com/apache/seatunnel/pull/7871#issuecomment-2476140580 > > ![image](https://private-user-images.githubusercontent.com/36789477/381793391-477a380b-b0a7-4ce7-8a16-7832bca89610.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRod

Re: [PR] [Feature][Connector-V2]Jdbc chunk split add snapshotSplitColumn config #7794 [seatunnel]

2024-11-14 Thread via GitHub
hailin0 commented on code in PR #7840: URL: https://github.com/apache/seatunnel/pull/7840#discussion_r1842162259 ## seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/enumerator/splitter/AbstractJdbcSourceChunkSplitter.

Re: [PR] [Feature][Connector-v2] Support S3 filesystem of paimon connector [seatunnel]

2024-11-14 Thread via GitHub
hailin0 merged PR #8036: URL: https://github.com/apache/seatunnel/pull/8036 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Feature][Connector-v2] Support S3 filesystem of paimon connector (#8036)

2024-11-14 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new e2a4772933 [Feature][Connector-v2] Support S3 f

(seatunnel) branch dev updated: [Bug][connectors-v2] fix mongodb bson convert exception (#8044)

2024-11-14 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b222c13f2f [Bug][connectors-v2] fix mongodb bso

Re: [PR] [Bug][connectors-v2] fix mongodb bson convert exception [seatunnel]

2024-11-14 Thread via GitHub
hailin0 merged PR #8044: URL: https://github.com/apache/seatunnel/pull/8044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][CI] time-consuming module optimization [seatunnel]

2024-11-14 Thread via GitHub
hailin0 merged PR #8052: URL: https://github.com/apache/seatunnel/pull/8052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Fix][CI] time-consuming module optimization (#8052)

2024-11-14 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 1cee43708c [Fix][CI] time-consuming module opti

Re: [PR] [Fix][Zeta] Remove duplicate `LIFECYCLE_WRITER_CLOSE` events [seatunnel]

2024-11-14 Thread via GitHub
hailin0 commented on PR #7984: URL: https://github.com/apache/seatunnel/pull/7984#issuecomment-2476237821 LGTM waiting for ci passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[PR] [Hotfix][Transforms-v2] DynamicCompile Plugin compatibility fix [seatunnel]

2024-11-14 Thread via GitHub
hawk9821 opened a new pull request, #8057: URL: https://github.com/apache/seatunnel/pull/8057 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Feature][Connector-V2] Jdbc support trino dialect [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X commented on PR #8026: URL: https://github.com/apache/seatunnel/pull/8026#issuecomment-2476067519 > > Thanks @sanjaychitransh ! Please fix ci. > > Hi @Hisoka-X, thanks ! for the review, I fixed CI issues, but seems one build is failing (engine-V2-it),but not due to code issue

Re: [PR] [Feature][Transform-V2] Support transform with multi-table [seatunnel]

2024-11-14 Thread via GitHub
Hisoka-X commented on PR #7628: URL: https://github.com/apache/seatunnel/pull/7628#issuecomment-2476151948 cc @hailin0 and @liunaijie -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [Bug] [E2E] MysqlCDCIT running errors [seatunnel]

2024-11-14 Thread via GitHub
hailin0 closed issue #8030: [Bug] [E2E] MysqlCDCIT running errors URL: https://github.com/apache/seatunnel/issues/8030 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

  1   2   >