Re: [PR] [feature][Transform] Transform supports multi-table scenarios [seatunnel]

2024-07-21 Thread via GitHub
cobolbaby commented on PR #5646: URL: https://github.com/apache/seatunnel/pull/5646#issuecomment-2241502538 Can transform-v2 improve this feature? Certain tables need to be transformed during multi-table CDC synchronization. @EricJoy2048 @ic4y -- This is an automated message from

Re: [I] Seatunnel Vs (DataX, Canal, flume) [seatunnel]

2024-07-21 Thread via GitHub
cobolbaby commented on issue #1242: URL: https://github.com/apache/seatunnel/issues/1242#issuecomment-2241518058 Here is a comparison of several data synchronization tools for your reference. If any information is incorrect, please let me know. Thanks. https://github.com/cobolbaby/doc

Re: [PR] [improve][shade] Upgrade hadoop client to 3.3.4 [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on PR #7175: URL: https://github.com/apache/seatunnel/pull/7175#issuecomment-2241536578 This pr has been merged into jdk17, so i will close it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [improve][shade] Upgrade hadoop client to 3.3.4 [seatunnel]

2024-07-21 Thread via GitHub
liugddx closed pull request #7175: [improve][shade] Upgrade hadoop client to 3.3.4 URL: https://github.com/apache/seatunnel/pull/7175 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [improve][shade] Upgrade hadoop client to 3.3.4 [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on PR #7175: URL: https://github.com/apache/seatunnel/pull/7175#issuecomment-2241536733 > This pr has been merged into jdk17, so i will close it. https://github.com/apache/seatunnel/pull/7086 -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on code in PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#discussion_r1685708027 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/serialization/RowBatch.java: ## @@ -71,21 +75,22 @@ @Slf4j

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on code in PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#discussion_r1685720362 ## seatunnel-connectors-v2/connector-doris/src/test/java/org/apache/seatunnel/connectors/doris/serialize/SeaTunnelRowConverterTest.java: ## @@ -1,54 +0,0 @@ -/* - * L

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on code in PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#discussion_r1685720530 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/serialization/RowBatch.java: ## @@ -71,21 +75,22 @@ @Slf4j p

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on code in PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#discussion_r1685720659 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/serialization/RowBatch.java: ## @@ -267,7 +272,7 @@ private void

[I] [Feature][Activemq] Support Activemq connector source/sink [seatunnel]

2024-07-21 Thread via GitHub
asapekia opened a new issue, #7237: URL: https://github.com/apache/seatunnel/issues/7237 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Feature][Activemq] Support Activemq connector source/sink [seatunnel]

2024-07-21 Thread via GitHub
asapekia commented on issue #7237: URL: https://github.com/apache/seatunnel/issues/7237#issuecomment-2241592723 Hi Team, I am working on this. I am implementing the source using AbstractSingleSplitSource. Can anyone confirm if I am doing the right things. -- This is an automated message

Re: [I] [Bug] [FTP Connector] The reading and writing of FTP are very slow [seatunnel]

2024-07-21 Thread via GitHub
github-actions[bot] commented on issue #7048: URL: https://github.com/apache/seatunnel/issues/7048#issuecomment-2241839566 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] seatunnel不支持hbase-source [seatunnel]

2024-07-21 Thread via GitHub
github-actions[bot] commented on issue #7042: URL: https://github.com/apache/seatunnel/issues/7042#issuecomment-2241839603 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Bug] [connector-cdc] from mysql to starrocks : Generate Splits for table xxxx error [seatunnel]

2024-07-21 Thread via GitHub
github-actions[bot] commented on issue #7044: URL: https://github.com/apache/seatunnel/issues/7044#issuecomment-2241839585 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Elasticsearch] Support multi-table sink write [seatunnel]

2024-07-21 Thread via GitHub
github-actions[bot] commented on issue #7041: URL: https://github.com/apache/seatunnel/issues/7041#issuecomment-2241839623 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][Activemq] Support Activemq connector source/sink [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on issue #7237: URL: https://github.com/apache/seatunnel/issues/7237#issuecomment-2241878411 > Hi Team, I am working on this. I am implementing the source using AbstractSingleSplitSource. Can anyone confirm if I am doing the right things. Hi @asapekia , welcome for

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#issuecomment-2241906321 After https://github.com/apache/doris/issues/38174 is resolved, I will upgrade to the latest doris version as a image for test cases. -- This is an automated message from the

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#issuecomment-2241908342 > After [apache/doris#38174](https://github.com/apache/doris/issues/38174) is resolved, I will upgrade to the latest doris version as a image for test cases. Please create an is

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on code in PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#discussion_r1685880044 ## seatunnel-connectors-v2/connector-doris/src/test/java/org/apache/seatunnel/connectors/doris/serialize/SeaTunnelRowConverterTest.java: ## @@ -1,54 +0,0 @@ -/* - *

[I] [Feature][Module Name] Feature title [seatunnel]

2024-07-21 Thread via GitHub
hailin0 opened a new issue, #7238: URL: https://github.com/apache/seatunnel/issues/7238 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-07-21 Thread via GitHub
hailin0 commented on issue #7238: URL: https://github.com/apache/seatunnel/issues/7238#issuecomment-2241934859 @hailin0 - https://github.com/apache/seatunnel/pull/7131 - https://github.com/apache/seatunnel/pull/7083 - https://github.com/apache/seatunnel/issues?q=is%3Aopen+is%3Aissu

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-07-21 Thread via GitHub
hailin0 commented on issue #7238: URL: https://github.com/apache/seatunnel/issues/7238#issuecomment-2241935242 @Hisoka-X - https://github.com/apache/seatunnel/pull/7135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-07-21 Thread via GitHub
hailin0 commented on issue #7238: URL: https://github.com/apache/seatunnel/issues/7238#issuecomment-2241935815 @liugddx - https://github.com/apache/seatunnel/pull/4405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

(seatunnel) branch dev updated: [Improve][Restapi] Add ip and port to monitoring information (#7203)

2024-07-21 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 063f83ca6c [Improve][Restapi] Add ip and port t

Re: [PR] [Improve][Restapi] Add ip and port to monitoring information [seatunnel]

2024-07-21 Thread via GitHub
hailin0 merged PR #7203: URL: https://github.com/apache/seatunnel/pull/7203 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on code in PR #7229: URL: https://github.com/apache/seatunnel/pull/7229#discussion_r1685900178 ## seatunnel-connectors-v2/connector-doris/src/main/java/org/apache/seatunnel/connectors/doris/source/serialization/RowBatch.java: ## @@ -71,21 +75,22 @@ @Slf4j

Re: [PR] [BUG][DOC] fix doc link page 404 [seatunnel]

2024-07-21 Thread via GitHub
wuchunfu commented on PR #6222: URL: https://github.com/apache/seatunnel/pull/6222#issuecomment-2241958897 Fixed #7018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] [BUG][DOC] fix doc link page 404 [seatunnel]

2024-07-21 Thread via GitHub
wuchunfu closed pull request #6222: [BUG][DOC] fix doc link page 404 URL: https://github.com/apache/seatunnel/pull/6222 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [I] [Feature][Prometheus] Support Prometheus connector source/sink [seatunnel]

2024-07-21 Thread via GitHub
hailin0 commented on issue #7201: URL: https://github.com/apache/seatunnel/issues/7201#issuecomment-2241960190 hi @CosmosNi Is there any progress on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] [Feature][Memcached] Support Memcached connector source/sink [seatunnel]

2024-07-21 Thread via GitHub
hailin0 commented on issue #7200: URL: https://github.com/apache/seatunnel/issues/7200#issuecomment-2241961381 hi @asapekia Is there any progress on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [I] SeaTunnel community meeting Topic collect [seatunnel]

2024-07-21 Thread via GitHub
liugddx commented on issue #7238: URL: https://github.com/apache/seatunnel/issues/7238#issuecomment-2241967051 https://github.com/apache/seatunnel/pull/7086 support JDK17 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [I] [Feature][Prometheus] Support Prometheus connector source/sink [seatunnel]

2024-07-21 Thread via GitHub
CosmosNi commented on issue #7201: URL: https://github.com/apache/seatunnel/issues/7201#issuecomment-2241971782 > hi @CosmosNi Is there any progress on this task? Looking at other modules -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [Fix][Connector kafka]Fix Kafka consumer stop fetching after TM node restarted [seatunnel]

2024-07-21 Thread via GitHub
hailin0 merged PR #7233: URL: https://github.com/apache/seatunnel/pull/7233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [I] [Bug] [Connector Kafka] Kafka consumer stop fetching after TM node restarted [seatunnel]

2024-07-21 Thread via GitHub
hailin0 closed issue #7230: [Bug] [Connector Kafka] Kafka consumer stop fetching after TM node restarted URL: https://github.com/apache/seatunnel/issues/7230 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

(seatunnel) branch dev updated: [Fix][Connector kafka]Fix Kafka consumer stop fetching after TM node restarted (#7233)

2024-07-21 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 7dc3fa8a13 [Fix][Connector kafka]Fix Kafka cons

[I] [Bug] [Zeta] TaskGroup Failed MSG lost when job restore time more than one [seatunnel]

2024-07-21 Thread via GitHub
EricJoy2048 opened a new issue, #7239: URL: https://github.com/apache/seatunnel/issues/7239 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happen

Re: [PR] [Fix][Zeta] Fix release slot resource twice [seatunnel]

2024-07-21 Thread via GitHub
EricJoy2048 merged PR #7236: URL: https://github.com/apache/seatunnel/pull/7236 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

Re: [I] [Bug] [Zeta ] Repeatedly releasing [seatunnel]

2024-07-21 Thread via GitHub
EricJoy2048 closed issue #7210: [Bug] [Zeta ] Repeatedly releasing URL: https://github.com/apache/seatunnel/issues/7210 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

(seatunnel) branch dev updated: [Fix][Zeta] Fix release slot resource twice (#7236)

2024-07-21 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4ec25f345f [Fix][Zeta] Fix release slot resourc

Re: [PR] [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema [seatunnel]

2024-07-21 Thread via GitHub
liugddx merged PR #7229: URL: https://github.com/apache/seatunnel/pull/7229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

(seatunnel) branch dev updated: [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema (#7229)

2024-07-21 Thread liugddx
This is an automated email from the ASF dual-hosted git repository. liugddx pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 4b3af9bef4 [Improve][Doris Connector] Unified seri

[I] The result was achieved, but the printed result was not successfully written [seatunnel]

2024-07-21 Thread via GitHub
wxp2023 opened a new issue, #7240: URL: https://github.com/apache/seatunnel/issues/7240 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-21 Thread via GitHub
EricJoy2048 opened a new pull request, #7241: URL: https://github.com/apache/seatunnel/pull/7241 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-21 Thread via GitHub
hailin0 commented on code in PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#discussion_r1685998478 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/dag/physical/PhysicalVertex.java: ## @@ -214,7 +214,7 @@ public PassiveCo

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#issuecomment-2242165913 shall we add test case? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-21 Thread via GitHub
EricJoy2048 commented on PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#issuecomment-2242184464 > shall we add test case? Test cases are not easy to simulate -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on code in PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#discussion_r1686050516 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/dag/physical/PhysicalVertex.java: ## @@ -485,6 +485,8 @@ private void re

Re: [PR] [Hotfix][Zeta] Fix taskgroup failed log lost [seatunnel]

2024-07-21 Thread via GitHub
Hisoka-X commented on code in PR #7241: URL: https://github.com/apache/seatunnel/pull/7241#discussion_r1686051515 ## seatunnel-engine/seatunnel-engine-server/src/main/java/org/apache/seatunnel/engine/server/dag/physical/PhysicalVertex.java: ## @@ -485,6 +485,8 @@ private void re