Re: [I] [Feature][LOG] Recording the data obtained in each of the E, T, and L processes separately [seatunnel]

2024-08-05 Thread via GitHub
Wudadada commented on issue #7296: URL: https://github.com/apache/seatunnel/issues/7296#issuecomment-2270504485 > Can you give an example? For example, save the extracted raw data and the cleaned data obtained after transformation as log records in Excel or CSV format. If any issu

Re: [I] Keycloak authentication [seatunnel]

2024-08-05 Thread via GitHub
ManuGeodis commented on issue #7308: URL: https://github.com/apache/seatunnel/issues/7308#issuecomment-2270384703 Can anyone suggest on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[I] [Bug] Mysql bug [seatunnel]

2024-08-05 Thread via GitHub
panmyuan opened a new issue, #7317: URL: https://github.com/apache/seatunnel/issues/7317 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] [Bug] [FTP SOURCE] FTP SOURCE Unable to return file list under FTP path in the code & FTP SINK NOT CONFIG ROOT PATH [seatunnel]

2024-08-05 Thread via GitHub
xiaominyan88 commented on issue #6070: URL: https://github.com/apache/seatunnel/issues/6070#issuecomment-2270321065 Hello, I meet the same issue when I use ftp source in seatunnel v2.3.3, but when I rewrite the source code according to ftp source connector code in seatunnel v2.3.8 or seatun

(seatunnel) branch dev updated: [Fix][Doc] Fix miss sink-options-placeholders.md in sidebars (#7310)

2024-08-05 Thread wuchunfu
This is an automated email from the ASF dual-hosted git repository. wuchunfu pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new c94ea325b7 [Fix][Doc] Fix miss sink-options-place

Re: [PR] [Fix][Doc] Fix miss sink-options-placeholders.md in sidebars [seatunnel]

2024-08-05 Thread via GitHub
wuchunfu merged PR #7310: URL: https://github.com/apache/seatunnel/pull/7310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

[I] [Doc] [Improve] can not find config about sub-table in connector-tdengine document [seatunnel]

2024-08-05 Thread via GitHub
alextinng opened a new issue, #7316: URL: https://github.com/apache/seatunnel/issues/7316 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Bug] [doris] 1.当sink是doris时,varchar类型的数据如果是空会自动加上\N2.自动建表模式提示找不到主键,但是上游source是有主键的 [seatunnel]

2024-08-05 Thread via GitHub
Hisoka-X commented on issue #7314: URL: https://github.com/apache/seatunnel/issues/7314#issuecomment-2270230581 Please add `table_path` in source config. https://seatunnel.apache.org/docs/2.3.6/connector-v2/source/Jdbc#tips -- This is an automated message from the Apache Git Service. To r

(seatunnel) branch dev updated: [Hotfix][Zeta] Fix task cannot be stopped when system is busy (#7292)

2024-08-05 Thread zhouyao2023
This is an automated email from the ASF dual-hosted git repository. zhouyao2023 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 73632bad2b [Hotfix][Zeta] Fix task cannot be s

Re: [PR] [Hotfix][Zeta] Fix task cannot be stopped when system is busy [seatunnel]

2024-08-05 Thread via GitHub
Carl-Zhou-CN merged PR #7292: URL: https://github.com/apache/seatunnel/pull/7292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@sea

[PR] [Bugfix](doris) Fix the abnormality of deleting data in CDC scenario. [seatunnel]

2024-08-05 Thread via GitHub
liugddx opened a new pull request, #7315: URL: https://github.com/apache/seatunnel/pull/7315 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list * [

Re: [PR] Feature/split transform [seatunnel]

2024-08-05 Thread via GitHub
liunaijie commented on PR #7218: URL: https://github.com/apache/seatunnel/pull/7218#issuecomment-2270189554 @Hisoka-X PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[I] [Bug] [doris] 1.当sink是doris时,varchar类型的数据如果是空会自动加上\N2.自动建表模式提示找不到主键,但是上游source是有主键的 [seatunnel]

2024-08-05 Thread via GitHub
13813586515 opened a new issue, #7314: URL: https://github.com/apache/seatunnel/issues/7314 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happen

Re: [I] [Feature][ConnectorV2] new option for determining split owners [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] commented on issue #7043: URL: https://github.com/apache/seatunnel/issues/7043#issuecomment-2270143491 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][Kafka-connector] Proposal to Add Kafka Protobuf Data Parsing Support [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] commented on issue #7059: URL: https://github.com/apache/seatunnel/issues/7059#issuecomment-2270143424 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][ConnectorV2] new option for determining split owners [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] closed issue #7043: [Feature][ConnectorV2] new option for determining split owners URL: https://github.com/apache/seatunnel/issues/7043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] Mysql-CDC -> Doris Sink [BUG] [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] closed issue #7050: Mysql-CDC -> Doris Sink [BUG] URL: https://github.com/apache/seatunnel/issues/7050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] Mysql-CDC -> Doris Sink [BUG] [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] commented on issue #7050: URL: https://github.com/apache/seatunnel/issues/7050#issuecomment-2270143466 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Question] Synchronizing data from PostgreSQL to MySQL with error: not a valid URL [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] commented on issue #7051: URL: https://github.com/apache/seatunnel/issues/7051#issuecomment-2270143443 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Question] Synchronizing data from PostgreSQL to MySQL with error: not a valid URL [seatunnel]

2024-08-05 Thread via GitHub
github-actions[bot] closed issue #7051: [Question] Synchronizing data from PostgreSQL to MySQL with error: not a valid URL URL: https://github.com/apache/seatunnel/issues/7051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence [seatunnel]

2024-08-05 Thread via GitHub
dailai commented on code in PR #7261: URL: https://github.com/apache/seatunnel/pull/7261#discussion_r1704745957 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/oceanbase/OceanBaseOracleCatalog.java: ## @@ -53,6 +52,2

[PR] [Bug] [Seatunnel-web] gc.log, nohup.out is created outside of logs directory [seatunnel-web]

2024-08-05 Thread via GitHub
arshadmohammad opened a new pull request, #172: URL: https://github.com/apache/seatunnel-web/pull/172 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binar

Re: [PR] [Improve] [Seatunnel-Web] Add support for Seatunnel 2.3.6 in Seatunnel-Web [seatunnel-web]

2024-08-05 Thread via GitHub
arshadmohammad commented on PR #170: URL: https://github.com/apache/seatunnel-web/pull/170#issuecomment-2269510471 I have changed seatunnel version to 2.3.6. Now seatunnel-ui started failing in PR CI. Seems the failure not related to this change but need to find out root cause of build fail

[PR] [Improve][Jdbc] Merge user config primary key when create table [seatunnel]

2024-08-05 Thread via GitHub
hailin0 opened a new pull request, #7313: URL: https://github.com/apache/seatunnel/pull/7313 ### Purpose of this pull request [Jdbc] Merge user config primary key when create table ### Does this PR introduce _any_ user-facing change? No ### How was this patch t

Re: [PR] [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver [seatunnel]

2024-08-05 Thread via GitHub
Hisoka-X commented on PR #7311: URL: https://github.com/apache/seatunnel/pull/7311#issuecomment-2269033744 cc @whhe -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [I] [Feature][LOG] Recording the data obtained in each of the E, T, and L processes separately [seatunnel]

2024-08-05 Thread via GitHub
hailin0 commented on issue #7296: URL: https://github.com/apache/seatunnel/issues/7296#issuecomment-2269024494 Can you give an example? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] [Feature][Connectors-V2-Paimon] Upgrade Paimon version to 8.0.1 [seatunnel]

2024-08-05 Thread via GitHub
hawk9821 commented on PR #7302: URL: https://github.com/apache/seatunnel/pull/7302#issuecomment-226486 > Please do not add additional features to the pr of the upgraded paimon version. If other features are provided, please submit the pr separately. If you are just upgrading paimon, ple

Re: [PR] [Feature][Connectors-V2-Paimon] Upgrade Paimon version to 8.0.1 [seatunnel]

2024-08-05 Thread via GitHub
hawk9821 closed pull request #7302: [Feature][Connectors-V2-Paimon] Upgrade Paimon version to 8.0.1 URL: https://github.com/apache/seatunnel/pull/7302 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] [Feature][Connectors-V2-Paimon] Upgrade Paimon version to 8.0.1 [seatunnel]

2024-08-05 Thread via GitHub
hawk9821 commented on PR #7302: URL: https://github.com/apache/seatunnel/pull/7302#issuecomment-2268884312 > Please do not add additional features to the pr of the upgraded paimon version. If other features are provided, please submit the pr separately. If you are just upgrading paimon, ple

Re: [PR] [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence [seatunnel]

2024-08-05 Thread via GitHub
Hisoka-X commented on code in PR #7261: URL: https://github.com/apache/seatunnel/pull/7261#discussion_r1703958995 ## seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/catalog/oceanbase/OceanBaseOracleCatalog.java: ## @@ -53,6 +52

[PR] [Hotfix][Connector] Fix kafka consumer log next startup offset [seatunnel]

2024-08-05 Thread via GitHub
hailin0 opened a new pull request, #7312: URL: https://github.com/apache/seatunnel/pull/7312 ### Purpose of this pull request [Connector] Fix kafka consumer log next startup offset ### Does this PR introduce _any_ user-facing change? No ### How was this pat

Re: [PR] [Bug][Connector-v2][KafkaSource]Fix the abnormal exit of KafkaConsumerThread. [seatunnel]

2024-08-05 Thread via GitHub
lightzhao commented on PR #7273: URL: https://github.com/apache/seatunnel/pull/7273#issuecomment-2268680927 > > Of course, but what strategies should we adopt after a Kafka cluster failure? > > The job should be failed. When the Kafka cluster fails, KafkaConsumer.poll will not

(seatunnel) branch dev updated: Update Oracle-CDC.md (#7285)

2024-08-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 9d56cc33b4 Update Oracle-CDC.md (#7285) 9d56cc3

Re: [PR] Update Oracle-CDC.md [seatunnel]

2024-08-05 Thread via GitHub
hailin0 merged PR #7285: URL: https://github.com/apache/seatunnel/pull/7285 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunne

Re: [PR] [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver [seatunnel]

2024-08-05 Thread via GitHub
xxsc0529 closed pull request #7311: [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver URL: https://github.com/apache/seatunnel/pull/7311 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver [seatunnel]

2024-08-05 Thread via GitHub
xxsc0529 commented on PR #7311: URL: https://github.com/apache/seatunnel/pull/7311#issuecomment-2268580907 > ### Purpose of this pull request > The original oceanbase catalog directly inherits the mysql catalog, which results in the need to add an additional mysql driver to the lib direct

[PR] [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver [seatunnel]

2024-08-05 Thread via GitHub
xxsc0529 opened a new pull request, #7311: URL: https://github.com/apache/seatunnel/pull/7311 ### Purpose of this pull request The original oceanbase catalog directly inherits the mysql catalog, which results in the need to add an additional mysql driver to the lib directo

(seatunnel-website) branch main updated: [Fix][Doc] Fix miss sink-options-placeholders.md in sidebars (#321)

2024-08-05 Thread wanghailin
This is an automated email from the ASF dual-hosted git repository. wanghailin pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/seatunnel-website.git The following commit(s) were added to refs/heads/main by this push: new 0f1cc505d07 [Fix][Doc] Fix miss sink-

Re: [PR] [Fix][Doc] Fix miss sink-options-placeholders.md in sidebars [seatunnel-website]

2024-08-05 Thread via GitHub
hailin0 merged PR #321: URL: https://github.com/apache/seatunnel-website/pull/321 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@se

Re: [PR] Update Oracle-CDC.md [seatunnel]

2024-08-05 Thread via GitHub
Hisoka-X commented on code in PR #7285: URL: https://github.com/apache/seatunnel/pull/7285#discussion_r1703631706 ## docs/en/connector-v2/source/Oracle-CDC.md: ## @@ -91,6 +91,8 @@ GRANT SELECT ON V_$ARCHIVED_LOG TO logminer_user; GRANT SELECT ON V_$ARCHIVE_DEST_STATUS TO logmi