Re: [PR] [Improve][Zeta] Split classloader in job master [seatunnel]

2025-02-08 Thread via GitHub


Hisoka-X commented on code in PR #8622:
URL: https://github.com/apache/seatunnel/pull/8622#discussion_r1947551166


##
seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java:
##
@@ -235,19 +235,27 @@ public synchronized void init(long 
initializationTimestamp, boolean restart) thr
 jobImmutableInformation.getJobId(),
 jobImmutableInformation.getPluginJarsUrls()));
 ClassLoader appClassLoader = 
Thread.currentThread().getContextClassLoader();
-ClassLoader classLoader =
-seaTunnelServer
-.getClassLoaderService()
-.getClassLoader(
-jobImmutableInformation.getJobId(),
-jobImmutableInformation.getPluginJarsUrls());
+
+List> logicalVertexJarsList = 
jobImmutableInformation.getLogicalVertexJarsList();
+List classLoaders = new ArrayList<>();

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] [Fix][transform-v2]SQL transform support max/min function [seatunnel]

2025-02-08 Thread via GitHub


hailin0 commented on code in PR #8625:
URL: https://github.com/apache/seatunnel/pull/8625#discussion_r1947540154


##
docs/en/transform-v2/sql-functions.md:
##
@@ -385,6 +385,26 @@ Example:
 
 ACOS(D)
 
+### MAX
+
+```MAX(ARRAY)```

Review Comment:
   rename to ARRAY_MAX ?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] [Improve][Zeta] Split classloader in job master [seatunnel]

2025-02-08 Thread via GitHub


hailin0 commented on code in PR #8622:
URL: https://github.com/apache/seatunnel/pull/8622#discussion_r1947543615


##
seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java:
##
@@ -235,19 +235,27 @@ public synchronized void init(long 
initializationTimestamp, boolean restart) thr
 jobImmutableInformation.getJobId(),
 jobImmutableInformation.getPluginJarsUrls()));
 ClassLoader appClassLoader = 
Thread.currentThread().getContextClassLoader();
-ClassLoader classLoader =
-seaTunnelServer
-.getClassLoaderService()
-.getClassLoader(
-jobImmutableInformation.getJobId(),
-jobImmutableInformation.getPluginJarsUrls());
+
+List> logicalVertexJarsList = 
jobImmutableInformation.getLogicalVertexJarsList();
+List classLoaders = new ArrayList<>();

Review Comment:
   ```suggestion
   List logicalVertexClassLoaders = new ArrayList<>();
   ```



##
seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java:
##
@@ -256,8 +264,15 @@ public synchronized void init(long 
initializationTimestamp, boolean restart) thr
 logicalDag.getLogicalVertexMap().values().stream()
 .map(LogicalVertex::getAction)
 .filter(action -> action instanceof SinkAction)
-.map(sink -> ((SinkAction) sink).getSink())
-.forEach(JobMaster::handleSaveMode);
+.forEach(
+sink -> {
+Thread.currentThread()
+.setContextClassLoader(
+
classLoaderMap.get(sink.getId()));
+JobMaster.handleSaveMode(
+((SinkAction) 
sink).getSink());
+});
+Thread.currentThread().setContextClassLoader(appClassLoader);

Review Comment:
   Use `try-finally`?



##
seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/master/JobMaster.java:
##
@@ -235,19 +235,27 @@ public synchronized void init(long 
initializationTimestamp, boolean restart) thr
 jobImmutableInformation.getJobId(),
 jobImmutableInformation.getPluginJarsUrls()));
 ClassLoader appClassLoader = 
Thread.currentThread().getContextClassLoader();
-ClassLoader classLoader =
-seaTunnelServer
-.getClassLoaderService()
-.getClassLoader(
-jobImmutableInformation.getJobId(),
-jobImmutableInformation.getPluginJarsUrls());
+
+List> logicalVertexJarsList = 
jobImmutableInformation.getLogicalVertexJarsList();
+List classLoaders = new ArrayList<>();
+for (Set urls : logicalVertexJarsList) {
+classLoaders.add(
+seaTunnelServer
+.getClassLoaderService()
+
.getClassLoader(jobImmutableInformation.getJobId(), urls));
+}
 logicalDag =
-CustomClassLoadedObject.deserializeWithCustomClassLoader(
+DAGUtils.restoreLogicalDag(
+jobImmutableInformation,
 nodeEngine.getSerializationService(),
-classLoader,
-jobImmutableInformation.getLogicalDag());
+classLoaders);
+
+Map classLoaderMap = new HashMap<>();

Review Comment:
   ```suggestion
   Map logicalVertexIdClassLoaderMap = new 
HashMap<>();
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] [Fix][transform-v2]SQL transform support max/min function [seatunnel]

2025-02-08 Thread via GitHub


CosmosNi commented on code in PR #8625:
URL: https://github.com/apache/seatunnel/pull/8625#discussion_r1947545294


##
docs/en/transform-v2/sql-functions.md:
##
@@ -385,6 +385,26 @@ Example:
 
 ACOS(D)
 
+### MAX
+
+```MAX(ARRAY)```

Review Comment:
   get



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] Bump vite from 5.4.9 to 5.4.14 in /seatunnel-engine/seatunnel-engine-ui [seatunnel]

2025-02-08 Thread via GitHub


dependabot[bot] commented on PR #8570:
URL: https://github.com/apache/seatunnel/pull/8570#issuecomment-2646081049

   OK, I won't notify you again about this release, but will get in touch when 
a new version is available. If you'd rather skip all updates until the next 
major or minor version, let me know by commenting `@dependabot ignore this 
major version` or `@dependabot ignore this minor version`.
   
   If you change your mind, just re-open this PR and I'll resolve any conflicts 
on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] Bump net.snowflake:snowflake-jdbc from 3.13.29 to 3.22.0 in /seatunnel-connectors-v2/connector-jdbc [seatunnel]

2025-02-08 Thread via GitHub


davidzollo closed pull request #8605: Bump net.snowflake:snowflake-jdbc from 
3.13.29 to 3.22.0 in /seatunnel-connectors-v2/connector-jdbc
URL: https://github.com/apache/seatunnel/pull/8605


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] Bump org.apache.hive:hive-exec from 2.3.9 to 4.0.1 in /seatunnel-connectors-v2/connector-iceberg [seatunnel]

2025-02-08 Thread via GitHub


davidzollo closed pull request #8597: Bump org.apache.hive:hive-exec from 2.3.9 
to 4.0.1 in /seatunnel-connectors-v2/connector-iceberg
URL: https://github.com/apache/seatunnel/pull/8597


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



(seatunnel) branch dependabot/npm_and_yarn/seatunnel-engine/seatunnel-engine-ui/vitest-1.6.1 deleted (was 524271c9aa)

2025-02-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/npm_and_yarn/seatunnel-engine/seatunnel-engine-ui/vitest-1.6.1
in repository https://gitbox.apache.org/repos/asf/seatunnel.git


 was 524271c9aa Bump vitest from 1.6.0 to 1.6.1 in 
/seatunnel-engine/seatunnel-engine-ui

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



Re: [PR] Bump vite from 5.4.9 to 5.4.14 in /seatunnel-engine/seatunnel-engine-ui [seatunnel]

2025-02-08 Thread via GitHub


davidzollo closed pull request #8570: Bump vite from 5.4.9 to 5.4.14 in 
/seatunnel-engine/seatunnel-engine-ui
URL: https://github.com/apache/seatunnel/pull/8570


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



(seatunnel) branch dependabot/npm_and_yarn/seatunnel-engine/seatunnel-engine-ui/vite-5.4.14 deleted (was cfd42956d6)

2025-02-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/npm_and_yarn/seatunnel-engine/seatunnel-engine-ui/vite-5.4.14
in repository https://gitbox.apache.org/repos/asf/seatunnel.git


 was cfd42956d6 Bump vite from 5.4.9 to 5.4.14 in 
/seatunnel-engine/seatunnel-engine-ui

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



Re: [PR] Bump vitest from 1.6.0 to 1.6.1 in /seatunnel-engine/seatunnel-engine-ui [seatunnel]

2025-02-08 Thread via GitHub


davidzollo closed pull request #8606: Bump vitest from 1.6.0 to 1.6.1 in 
/seatunnel-engine/seatunnel-engine-ui
URL: https://github.com/apache/seatunnel/pull/8606


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] [Improve][e2e] Remove duplicate dependencies [seatunnel]

2025-02-08 Thread via GitHub


davidzollo merged PR #8628:
URL: https://github.com/apache/seatunnel/pull/8628


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] Bump org.apache.hive:hive-exec from 2.3.9 to 4.0.1 in /seatunnel-connectors-v2/connector-iceberg [seatunnel]

2025-02-08 Thread via GitHub


dependabot[bot] commented on PR #8597:
URL: https://github.com/apache/seatunnel/pull/8597#issuecomment-2646081054

   OK, I won't notify you again about this release, but will get in touch when 
a new version is available. If you'd rather skip all updates until the next 
major or minor version, let me know by commenting `@dependabot ignore this 
major version` or `@dependabot ignore this minor version`.
   
   If you change your mind, just re-open this PR and I'll resolve any conflicts 
on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



(seatunnel) branch dependabot/maven/seatunnel-connectors-v2/connector-iceberg/org.apache.hive-hive-exec-4.0.1 deleted (was e2c5b5d62f)

2025-02-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/maven/seatunnel-connectors-v2/connector-iceberg/org.apache.hive-hive-exec-4.0.1
in repository https://gitbox.apache.org/repos/asf/seatunnel.git


 was e2c5b5d62f Bump org.apache.hive:hive-exec

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



Re: [PR] Bump vitest from 1.6.0 to 1.6.1 in /seatunnel-engine/seatunnel-engine-ui [seatunnel]

2025-02-08 Thread via GitHub


dependabot[bot] commented on PR #8606:
URL: https://github.com/apache/seatunnel/pull/8606#issuecomment-2646081059

   OK, I won't notify you again about this release, but will get in touch when 
a new version is available. If you'd rather skip all updates until the next 
major or minor version, let me know by commenting `@dependabot ignore this 
major version` or `@dependabot ignore this minor version`.
   
   If you change your mind, just re-open this PR and I'll resolve any conflicts 
on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



(seatunnel) branch dev updated: [Improve][e2e] Remove duplicate dependencies (#8628)

2025-02-08 Thread lidongdai
This is an automated email from the ASF dual-hosted git repository.

lidongdai pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/seatunnel.git


The following commit(s) were added to refs/heads/dev by this push:
 new f473bf49a7 [Improve][e2e] Remove duplicate dependencies (#8628)
f473bf49a7 is described below

commit f473bf49a7168964f83bae37e278a1cc91b5a652
Author: ChunFuWu <319355...@qq.com>
AuthorDate: Sun Feb 9 13:42:27 2025 +0800

[Improve][e2e] Remove duplicate dependencies (#8628)
---
 seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/pom.xml | 5 -
 1 file changed, 5 deletions(-)

diff --git 
a/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/pom.xml 
b/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/pom.xml
index 668747b9db..d27478d52c 100644
--- a/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/pom.xml
+++ b/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-kafka-e2e/pom.xml
@@ -115,11 +115,6 @@
 ${testcontainer.version}
 test
 
-
-mysql
-mysql-connector-java
-test
-
 
 
 



(seatunnel) branch dependabot/maven/seatunnel-connectors-v2/connector-jdbc/net.snowflake-snowflake-jdbc-3.22.0 deleted (was a5a474bddc)

2025-02-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/maven/seatunnel-connectors-v2/connector-jdbc/net.snowflake-snowflake-jdbc-3.22.0
in repository https://gitbox.apache.org/repos/asf/seatunnel.git


 was a5a474bddc Bump net.snowflake:snowflake-jdbc

The revisions that were on this branch are still contained in
other references; therefore, this change does not discard any commits
from the repository.



Re: [PR] Bump net.snowflake:snowflake-jdbc from 3.13.29 to 3.22.0 in /seatunnel-connectors-v2/connector-jdbc [seatunnel]

2025-02-08 Thread via GitHub


dependabot[bot] commented on PR #8605:
URL: https://github.com/apache/seatunnel/pull/8605#issuecomment-2646081056

   OK, I won't notify you again about this release, but will get in touch when 
a new version is available. If you'd rather skip all updates until the next 
major or minor version, let me know by commenting `@dependabot ignore this 
major version` or `@dependabot ignore this minor version`.
   
   If you change your mind, just re-open this PR and I'll resolve any conflicts 
on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] 【2.3.9】【又来BUG了】mysql到starrocks跑批,source加上过滤条件,结果读不到数据,导致写SR不生效 [seatunnel]

2025-02-08 Thread via GitHub


FrommyMind commented on issue #8567:
URL: https://github.com/apache/seatunnel/issues/8567#issuecomment-2644815326

   Verified with Seatunnel 2.3.9, and it works perfectly.
   
   MySQL data:
   
   
![Image](https://github.com/user-attachments/assets/b7697da9-8a50-4d21-850f-061c44c75716)
   
   Config file:
   
   ```
   #定义一些作业的运行参数,具体可以参考 
https://seatunnel.apache.org/docs/2.3.1/concept/JobEnvConfig
   env {
 job.mode="BATCH"  #作业的运行模式,BATCH=离线批同步,STREAMING=实时同步
 job.name="SeaTunnel_market_new_58_163_sr_Job"
 checkpoint.interval=1 #每1ms进行一次checkpoint,后面会详细介绍checkpoint对JDBC 
Source和StarRocks Sink这两个连接器的影响
 read_limit.bytes_per_second=700
 read_limit.rows_per_second=400
   }
   source {
 Jdbc {
   plugin_output="Table9210050164000"
   connection_check_timeout_sec = 1000
   parallelism=5 # 并行度,这里是启动5个Source Task来并行的读取数据
   partition_column="id" # 
使用id字段来进行split的拆分,目前只支持数字类型的主键列,而且该列的值最好是离线的,自增id最佳
   partition_num="10" # 拆分成20个split,这20个split会被分配给5个Source Task来处理
   query="SELECT `id`,username, `email` FROM `test_db`.`users` where `id` > 
2 "
   password=""
   driver="com.mysql.cj.jdbc.Driver"
   user=test_user
   
url="jdbc:mysql://10.191.80.xxx:23306/test_db?useUnicode=true&characterEncoding=utf-8&autoReconnect=true&zeroDateTimeBehavior=convertToNull&allowPublicKeyRetrieval=true&useSSL=false"
 }
   }
   transform {
 # 在本次示例中我们不需要做任务的Transform操作,所以这里为空,也可以将transform整个元素删除
   }
   sink {
 StarRocks {
   data_save_mode="APPEND_DATA"
   plugin_input="Table9210050164000"
   nodeUrls = ["10.191.80.xxx:8040"]
   base-url = "jdbc:mysql://10.191.80.xxx:9030/"
   username = test_user
   password = ""
   database = "test_db"
   table = "users"
   batch_max_rows = 5
   starrocks.config = {
 format = "JSON"
 strip_outer_array = true
   }
 }
   }
   ```
   Execution log:
   
   
![Image](https://github.com/user-attachments/assets/81139f26-ce0d-4c2e-9cd1-d975cebfea98)
   
   
   Starrocks  result:
   
   
![Image](https://github.com/user-attachments/assets/2df5f4ae-04de-46f4-8bd2-c760fb2a78a8)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Bug] [Sink] mongodb change stream sink into kafka format error [seatunnel]

2025-02-08 Thread via GitHub


KRISHNA-798 commented on issue #8619:
URL: https://github.com/apache/seatunnel/issues/8619#issuecomment-2645011156

   Hi @SoulSong , yes you are right but mongodb cdc works with "debezium_json" 
format in kafka source and sink.
   
   1st config:
   
   ```
   env {
 parallelism = 1
 job.name = "mongo_kafka"
 job.mode = "STREAMING"
 checkpoint.interval = 5000
   }
   
   source {
 MongoDB-CDC {
   hosts = "mongo:27017"
   database = [""]
   collection = ["."]
   username = 
   password = 
   schema = {
 table = "."
 fields {
   "_id" : string,
   "name" : string,
   "age": int
 }
   }
 }
   }
   
   sink {
 Console {
   parallelism = 1
 }
 kafka {
 topic = "mongo_cdc"
 bootstrap.servers = "ka:9092"
 format = debezium_json
 kafka.request.timeout.ms = 6
 semantics = EXACTLY_ONCE
 kafka.config = {
   acks = "all"
   request.timeout.ms = 6
   buffer.memory = 33554432
 }
 }
   }
   ```
   
   
   2nd config:
   
   ```
   env {
 parallelism = 1
 job.mode = "STREAMING"
 job.name = "kafka_mongo"
 logging.level = "DEBUG"
   }
   
   source {
 Kafka {
   topic = "mongo_cdc"
   bootstrap.servers = "ka:9092"
   # start_mode="earliest"
   consumer.group = "group1"
   format = debezium_json
   debezium_record_include_schema = false
   schema {
fields {
   _id = string
   name = string
   age = int
 }
   }
   kafka.config = {
 auto.offset.reset = "earliest"
 enable.auto.commit = "false"
 max.poll.records = 1
   }
 }
   }
   
   sink {
 Console{}
 MongoDB {
   uri = "mongodb://mo:27017/"
   database = ""
   collection = "_target"
   upsert-enable = true
   primary-key = ["_id"]
   schema = {
 fields {
   _id = string
   name = string
   age = int
 }
   }
 }
   }
   ```
   
   Hope this helps.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[I] [Feature][Module Name] mysql cdc Is there a plan to support table schema changes through pt-osc and gh-ost methods? [seatunnel]

2025-02-08 Thread via GitHub


forkTemi opened a new issue, #8629:
URL: https://github.com/apache/seatunnel/issues/8629

   ### Search before asking
   
   - [x] I had searched in the 
[feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Description
   
   mysql cdc Is there a plan to support table schema changes through pt-osc and 
gh-ost methods?
   
   ### Usage Scenario
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2025-02-08 Thread via GitHub


KRISHNA-798 commented on issue #6550:
URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2645731926

   hi @chess3cake so the solution for above might be we need to specify 
schema-names field in source postgres cdc. Hope this helps.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Bug] [Apache Pulsar]java.util.concurrent.CompletionException: org.apache.seatunnel.engine.common.exception.JobException: com.hazelcast.nio.serialization.HazelcastSerializationException: java.

2025-02-08 Thread via GitHub


github-actions[bot] commented on issue #8490:
URL: https://github.com/apache/seatunnel/issues/8490#issuecomment-2645999684

   This issue has been automatically marked as stale because it has not had 
recent activity for 30 days. It will be closed in next 7 days if no further 
activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [I] [Bug] [connectors] Unable to read files without extension in tar.gz file [seatunnel]

2025-02-08 Thread via GitHub


github-actions[bot] commented on issue #8478:
URL: https://github.com/apache/seatunnel/issues/8478#issuecomment-2645999688

   This issue has been automatically marked as stale because it has not had 
recent activity for 30 days. It will be closed in next 7 days if no further 
activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[PR] [Fix][Connector-v2][DorisIT]Fix the problem that DorisIT cannot run local [seatunnel]

2025-02-08 Thread via GitHub


zhangshenghang opened a new pull request, #8630:
URL: https://github.com/apache/seatunnel/pull/8630

   ### Purpose of this pull request
   
   Fix the problem that DorisIT cannot run local
   
   ### Does this PR introduce _any_ user-facing change?
   
   
   
   
   ### How was this patch tested?
   
   
   
   
   ### Check list
   
   * [ ] If any new Jar binary package adding in your PR, please add License 
Notice according
 [New License 
Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/contribution/new-license.md)
   * [ ] If necessary, please update the documentation to describe the new 
feature. https://github.com/apache/seatunnel/tree/dev/docs
   * [ ] If you are contributing the connector code, please check that the 
following files are updated:
 1. Update 
[plugin-mapping.properties](https://github.com/apache/seatunnel/blob/dev/plugin-mapping.properties)
 and add new connector information in it
 2. Update the pom file of 
[seatunnel-dist](https://github.com/apache/seatunnel/blob/dev/seatunnel-dist/pom.xml)
 3. Add ci label in 
[label-scope-conf](https://github.com/apache/seatunnel/blob/dev/.github/workflows/labeler/label-scope-conf.yml)
 4. Add e2e testcase in 
[seatunnel-e2e](https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/)
 5. Update connector 
[plugin_config](https://github.com/apache/seatunnel/blob/dev/config/plugin_config)
   * [ ] Update the 
[`release-note`](https://github.com/apache/seatunnel/blob/dev/release-note.md).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [PR] [Fix][Connector-v2][DorisIT]Fix the problem that DorisIT cannot run local [seatunnel]

2025-02-08 Thread via GitHub


zhangshenghang commented on PR #8630:
URL: https://github.com/apache/seatunnel/pull/8630#issuecomment-2646001297

   @hawk9821 @Hisoka-X PTAL.  
   If `initializeBE()` is not run locally, it will report an error.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org