[I] transform generates a uuid from a postgresql function and updates the ID field value in the database table [seatunnel]

2024-03-20 Thread via GitHub
sandyustc opened a new issue, #6555: URL: https://github.com/apache/seatunnel/issues/6555 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[PR] [Improve][CDC] Optimize memory allocation in increment phase [seatunnel]

2024-03-20 Thread via GitHub
hailin0 opened a new pull request, #6554: URL: https://github.com/apache/seatunnel/pull/6554 ### Purpose of this pull request [CDC] Optimize memory allocation in increment phase ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested?

[PR] [feature][datasource] Main add datasource-jdbc-db2 [seatunnel-web]

2024-03-20 Thread via GitHub
haneeshmv opened a new pull request, #159: URL: https://github.com/apache/seatunnel-web/pull/159 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package

Re: [I] Provider org.apache.seatunnel.connectors.seatunnel.jdbc.sink.JdbcSink could not be instantiated [seatunnel]

2024-03-20 Thread via GitHub
EricJoy2048 closed issue #5801: Provider org.apache.seatunnel.connectors.seatunnel.jdbc.sink.JdbcSink could not be instantiated URL: https://github.com/apache/seatunnel/issues/5801 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] 在 dev 版本中source 是 iceberg 却报错sink could not be instantiated [seatunnel]

2024-03-20 Thread via GitHub
EricJoy2048 closed issue #6485: 在 dev 版本中source 是 iceberg 却报错sink could not be instantiated URL: https://github.com/apache/seatunnel/issues/6485 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

(seatunnel) branch dev updated: [Fix][Connector-V2] Fix connector support SPI but without no args constructor (#6551)

2024-03-20 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 5f3c9c36a5 [Fix][Connector-V2] Fix connector su

Re: [PR] [Fix][Connector-V2] Fix connector support SPI but without no args constructor [seatunnel]

2024-03-20 Thread via GitHub
EricJoy2048 merged PR #6551: URL: https://github.com/apache/seatunnel/pull/6551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

Re: [I] [Bug] [ElasticSearch2Hive Fail] Failed to synchronize data from ElasticSearch to Hive. [seatunnel]

2024-03-20 Thread via GitHub
EricJoy2048 closed issue #6506: [Bug] [ElasticSearch2Hive Fail] Failed to synchronize data from ElasticSearch to Hive. URL: https://github.com/apache/seatunnel/issues/6506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [I] [Bug] [rest-api]/hazelcast/rest/maps/submit-job java.lang.NullPointerException: null [seatunnel]

2024-03-20 Thread via GitHub
sandyustc closed issue #6530: [Bug] [rest-api]/hazelcast/rest/maps/submit-job java.lang.NullPointerException: null URL: https://github.com/apache/seatunnel/issues/6530 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [Bug] [Spark Translation] scala.collection.immutable.Map$Map1 cannot be cast to scala.collection.immutable.HashMap$HashTrieMap [seatunnel]

2024-03-20 Thread via GitHub
Hisoka-X closed issue #6504: [Bug] [Spark Translation] scala.collection.immutable.Map$Map1 cannot be cast to scala.collection.immutable.HashMap$HashTrieMap URL: https://github.com/apache/seatunnel/issues/6504 -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [I] [Feature][e2e] support run mutiple job onetime [seatunnel]

2024-03-20 Thread via GitHub
liunaijie closed issue #6548: [Feature][e2e] support run mutiple job onetime URL: https://github.com/apache/seatunnel/issues/6548 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

(seatunnel) branch dev updated: [BugFix][Spark-translation] map type cast error (#6552)

2024-03-20 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new b1dcd4a2bc [BugFix][Spark-translation] map type cas

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
liunaijie closed pull request #6549: [Improve][e2e] support run multiple job at same time URL: https://github.com/apache/seatunnel/pull/6549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [BugFix][Spark-translation] map type cast error [seatunnel]

2024-03-20 Thread via GitHub
Hisoka-X merged PR #6552: URL: https://github.com/apache/seatunnel/pull/6552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011185126 For example, kafka sink data is stored in kafka server -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011184096 The data path of the sink can be used for the next task to read -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
liunaijie commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011177394 > reference > > https://github.com/apache/seatunnel/blob/216efb764b31e5d3078036219e73c30fad16aea5/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-local-e2e/src/test/java

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011170174 reference https://github.com/apache/seatunnel/blob/216efb764b31e5d3078036219e73c30fad16aea5/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-local-e2e/src/test/java/org/apa

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
liunaijie commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011100890 > Why do you need this feature? For now, if we run jobs within mutiple command, like this ``` container.executeJob("conf1"); container.executeJob("conf2") ``` t

Re: [PR] [Improve][Zeta][storage] update hdfs configuration, support more parameters [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6547: URL: https://github.com/apache/seatunnel/pull/6547#issuecomment-2011089826 cc @EricJoy2048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011087415 reference https://github.com/apache/seatunnel/blob/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-fake-e2e/src/test/java/org/apache/seatunnel/e2e/connector/fake/FakeIT.jav

Re: [PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6549: URL: https://github.com/apache/seatunnel/pull/6549#issuecomment-2011085953 Why do you need this feature? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-03-20 Thread via GitHub
Carl-Zhou-CN commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2011009786 > Are you referring to the issue of account permissions for connecting to pg? It could be, or it could happen because of a connection timeout, or because of a table name

[PR] [Fix][SQLTransform] fix the scale loss for the sql transform [seatunnel]

2024-03-20 Thread via GitHub
dailai opened a new pull request, #6553: URL: https://github.com/apache/seatunnel/pull/6553 ### Purpose of this pull request Fix the scale loss for the sql transform. For example, the filed with the timestamp type can be the timestamp(n). ### Does this PR introduce

Re: [I] [Bug] [seatunnel-engine-server] when using rest-api hazelcast/rest/maps/running-job/:job-id,return exception:java.lang.ClassNotFoundException: org.apache.seatunnel.connectors.seatunnel.kafka.s

2024-03-20 Thread via GitHub
github-actions[bot] commented on issue #6192: URL: https://github.com/apache/seatunnel/issues/6192#issuecomment-2010958536 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Feature][web] 安装手册简单点 [seatunnel]

2024-03-20 Thread via GitHub
github-actions[bot] commented on issue #6204: URL: https://github.com/apache/seatunnel/issues/6204#issuecomment-2010958484 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [SeaTunnel-Web] Bugs and maintenance plan for seatunnel-web(seatunnel-web的Bug反馈,以及了解维护计划) [seatunnel]

2024-03-20 Thread via GitHub
github-actions[bot] commented on issue #6197: URL: https://github.com/apache/seatunnel/issues/6197#issuecomment-2010958504 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [SeaTunnel-Web] Bugs and maintenance plan for seatunnel-web(seatunnel-web的Bug反馈,以及了解维护计划) [seatunnel]

2024-03-20 Thread via GitHub
github-actions[bot] closed issue #6197: [Bug] [SeaTunnel-Web] Bugs and maintenance plan for seatunnel-web(seatunnel-web的Bug反馈,以及了解维护计划) URL: https://github.com/apache/seatunnel/issues/6197 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [Bug] [seatunnel-engine-server] when using rest-api hazelcast/rest/maps/running-job/:job-id,return exception:java.lang.ClassNotFoundException: org.apache.seatunnel.connectors.seatunnel.kafka.s

2024-03-20 Thread via GitHub
github-actions[bot] closed issue #6192: [Bug] [seatunnel-engine-server] when using rest-api hazelcast/rest/maps/running-job/:job-id,return exception:java.lang.ClassNotFoundException: org.apache.seatunnel.connectors.seatunnel.kafka.source.KafkaSource URL: https://github.com/apache/seatunnel/is

Re: [I] password is visible in the task log when use jdbc source [seatunnel]

2024-03-20 Thread via GitHub
github-actions[bot] commented on issue #6357: URL: https://github.com/apache/seatunnel/issues/6357#issuecomment-2010958459 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Feature][web] 安装手册简单点 [seatunnel]

2024-03-20 Thread via GitHub
github-actions[bot] closed issue #6204: [Feature][web] 安装手册简单点 URL: https://github.com/apache/seatunnel/issues/6204 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [I] [Feature][Connector-v2] Support iceberg sink [seatunnel]

2024-03-20 Thread via GitHub
hailin0 closed issue #2645: [Feature][Connector-v2] Support iceberg sink URL: https://github.com/apache/seatunnel/issues/2645 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [BugFix][Spark-translation] map type cast error [seatunnel]

2024-03-20 Thread via GitHub
Carl-Zhou-CN opened a new pull request, #6552: URL: https://github.com/apache/seatunnel/pull/6552 close #6504 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### C

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-03-20 Thread via GitHub
Asura7969 commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2009451360 > hi, @Asura7969 Most likely, the catalog fails to query the table you specified Are you referring to the issue of account permissions for connecting to pg? -- This is a

Re: [PR] [Fix][Connector-V2] Fix connector support SPI but without no args constructor [seatunnel]

2024-03-20 Thread via GitHub
Hisoka-X commented on code in PR #6551: URL: https://github.com/apache/seatunnel/pull/6551#discussion_r1531990370 ## seatunnel-connectors-v2/connector-file/connector-file-jindo-oss/src/main/java/org/apache/seatunnel/connectors/seatunnel/file/oss/jindo/config/OssConf.java: ## @@

[PR] [Fix][Connector-V2] Fix connector support SPI but without no args constructor [seatunnel]

2024-03-20 Thread via GitHub
Hisoka-X opened a new pull request, #6551: URL: https://github.com/apache/seatunnel/pull/6551 ### Purpose of this pull request This PR remove SPI on SeaTunnelSource/SeaTunnelSink class when it had TableSourceFactory/TableSinkFactory. Also do some check for SPI on SeaTunnelSource/

[I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-03-20 Thread via GitHub
Asura7969 opened a new issue, #6550: URL: https://github.com/apache/seatunnel/issues/6550 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [I] 在 dev 版本中source 是 iceberg 却报错sink could not be instantiated [seatunnel]

2024-03-20 Thread via GitHub
173lyb commented on issue #6485: URL: https://github.com/apache/seatunnel/issues/6485#issuecomment-2009133078 我也遇到了 s3file-hive报错: ![1d690fb4a19d65acf4e406390533d49](https://github.com/apache/seatunnel/assets/95527066/3aabcc6c-adbf-4523-a5fd-c77fde033a1f) -- This is an automated me

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-03-20 Thread via GitHub
Carl-Zhou-CN commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2009368453 hi, @Asura7969 Most likely, the catalog fails to query the table you specified -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [I] 在 dev 版本中source 是 iceberg 却报错sink could not be instantiated [seatunnel]

2024-03-20 Thread via GitHub
173lyb commented on issue #6485: URL: https://github.com/apache/seatunnel/issues/6485#issuecomment-2009133841 2.3.4 zeta引擎 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [I] [Bug] Can not find catalog table with factoryId [Postgres] [seatunnel]

2024-03-20 Thread via GitHub
Asura7969 commented on issue #6550: URL: https://github.com/apache/seatunnel/issues/6550#issuecomment-2009163280 @Carl-Zhou-CN cc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] [Bug] [ElasticSearch2Hive Fail] Failed to synchronize data from ElasticSearch to Hive. [seatunnel]

2024-03-20 Thread via GitHub
173lyb commented on issue #6506: URL: https://github.com/apache/seatunnel/issues/6506#issuecomment-2009136378 我也遇到了,2.3.4,s3file-hive报错: ![1d690fb4a19d65acf4e406390533d49](https://github.com/apache/seatunnel/assets/95527066/c237d613-ad14-490d-8d46-4236cec81443) -- This is an automa

[PR] [Improve][e2e] support run multiple job at same time [seatunnel]

2024-03-20 Thread via GitHub
liunaijie opened a new pull request, #6549: URL: https://github.com/apache/seatunnel/pull/6549 ### Purpose of this pull request close #6548 ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check lis

[I] [Feature][e2e] support run mutiple job onetime [seatunnel]

2024-03-20 Thread via GitHub
liunaijie opened a new issue, #6548: URL: https://github.com/apache/seatunnel/issues/6548 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

Re: [I] [Bug] [seatunnel-api] SeaTunnelRowType不支持数据库字段转义 [seatunnel]

2024-03-20 Thread via GitHub
heheyo commented on issue #6155: URL: https://github.com/apache/seatunnel/issues/6155#issuecomment-2009065917 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [I] [Feature][Connector-v2] Support iceberg sink [seatunnel]

2024-03-20 Thread via GitHub
bing-h commented on issue #2645: URL: https://github.com/apache/seatunnel/issues/2645#issuecomment-2008996731 > > I have finished two connector, sqs source connector and iceberg sink connector > > @bing-h upload your code ? I'm going to submit my codes, and find someone else ha

[PR] [Improve][Zeta][storage] update hdfs configuration, support more para… [seatunnel]

2024-03-20 Thread via GitHub
liunaijie opened a new pull request, #6547: URL: https://github.com/apache/seatunnel/pull/6547 …meters ### Purpose of this pull request close #6494 1. checkpoint HDFS configuration add hdfs_site parameter 2. imap HDFS configuration copy from checkpoint HDFS config cla

Re: [PR] [Chore] Remove unused configuration for log4j1.x [seatunnel]

2024-03-20 Thread via GitHub
hailin0 commented on PR #6544: URL: https://github.com/apache/seatunnel/pull/6544#issuecomment-2008941856 https://github.com/apache/seatunnel/assets/14371345/1438f687-f391-4787-ab57-7b1062e95d60";> -- This is an automated message from the Apache Git Service. To respond to the message,