[GitHub] [incubator-seatunnel] zhilinli123 closed pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
zhilinli123 closed pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321 URL: https://github.com/apache/incubator-seatunnel/pull/4400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [incubator-seatunnel] zhilinli123 commented on issue #4395: [Bug] [Transform SQL] ClassNotFoundException:org.apache.comons.dbcp.ConnectionFactory run in Spark Engine

2023-03-23 Thread via GitHub
zhilinli123 commented on issue #4395: URL: https://github.com/apache/incubator-seatunnel/issues/4395#issuecomment-1480778704 Can the boss assign it to me temporarily? I want to try to complete it. If there are problems in the repair, I think I will ask you thanks -- This is an automate

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on a diff in pull request #4372: [Feature][Connector] http connector support pagable

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on code in PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#discussion_r1145858156 ## seatunnel-connectors-v2/connector-http/connector-http-base/src/main/java/org/apache/seatunnel/connectors/seatunnel/http/config/HttpPage.java: ##

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on pull request #4372: [Feature][Connector] http connector support pagable

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#issuecomment-1480799569 > Hi , How's it going It is currently used in this way: source { Http { url = "http://mockserver:1080/paging/mock"; method = "GET" forma

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on pull request #4372: [Feature][Connector] http connector support pagable

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#issuecomment-1480810328 > Hi , How's it going There is a problem with self-increment, that is, when the data cannot be obtained by paging, the api obtains the response body. Different

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on pull request #4372: [Feature][Connector] http connector support pagable

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#issuecomment-1480812568 > Hi , How's it going so, it is only supported: pageNo = "1,2,4,10-50", // Support single page, range page -- This is an automated message from the Apache Gi

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #4302: [Bug][Connector-v2][KafkaSink]Fix KafkaProducer resources have never been released.

2023-03-23 Thread via GitHub
lightzhao commented on PR #4302: URL: https://github.com/apache/incubator-seatunnel/pull/4302#issuecomment-1480850234 @EricJoy2048 @ruanwenjun @ashulin @TaoZex @TyrantLucifer PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [incubator-seatunnel] 521daichen commented on pull request #4364: [Feature][Connector-V2][Kafka]Kafka source supports data deserializat…

2023-03-23 Thread via GitHub
521daichen commented on PR #4364: URL: https://github.com/apache/incubator-seatunnel/pull/4364#issuecomment-1480861347 > fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [incubator-seatunnel] zhilinli123 commented on pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
zhilinli123 commented on PR #4400: URL: https://github.com/apache/incubator-seatunnel/pull/4400#issuecomment-1480896499 > This is just to delete the directory when commit, and the directory should still exist after the task exits. You mean it shouldn't be deleted? -- This

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
lightzhao commented on PR #4400: URL: https://github.com/apache/incubator-seatunnel/pull/4400#issuecomment-1480910303 > > This is just to delete the directory when commit, and the directory should still exist after the task exits. > > You mean it shouldn't be deleted? It is on

[GitHub] [incubator-seatunnel] zhangzhaohuazai commented on issue #4385: [Bug] [Connector-V2] Source Kafka

2023-03-23 Thread via GitHub
zhangzhaohuazai commented on issue #4385: URL: https://github.com/apache/incubator-seatunnel/issues/4385#issuecomment-1480923244 Has the problem been solved?I meet it too in2.3.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [incubator-seatunnel] chenchurong commented on issue #4385: [Bug] [Connector-V2] Source Kafka

2023-03-23 Thread via GitHub
chenchurong commented on issue #4385: URL: https://github.com/apache/incubator-seatunnel/issues/4385#issuecomment-1480931065 > Has the problem been solved?I meet it too in2.3.0 not yet -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [incubator-seatunnel] chaorongzhi opened a new issue, #4403: [Bug] [connector-v2] [MySQL-CDC] The zeta engine is buggy in Cluster mode with MySQL-CDC as source and clickhouse as sink.

2023-03-23 Thread via GitHub
chaorongzhi opened a new issue, #4403: URL: https://github.com/apache/incubator-seatunnel/issues/4403 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] hailin0 opened a new pull request, #4404: [Feature][Transform] Support copy field list

2023-03-23 Thread via GitHub
hailin0 opened a new pull request, #4404: URL: https://github.com/apache/incubator-seatunnel/pull/4404 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [incubator-seatunnel] zhilinli123 commented on pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
zhilinli123 commented on PR #4400: URL: https://github.com/apache/incubator-seatunnel/pull/4400#issuecomment-1481101747 > commit结束后才删除 > > > 这只是提交时删除目录,任务退出后目录应还存在。 > > > > > > 你的意思是它不应该被删除? > > commit结合后才删除,面会创建,但任务结合后该目录仍然存在,任务退出时应删除该临时目录。 >

[GitHub] [incubator-seatunnel] zhilinli123 commented on pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
zhilinli123 commented on PR #4400: URL: https://github.com/apache/incubator-seatunnel/pull/4400#issuecomment-1481109438 > > > This is just to delete the directory when commit, and the directory should still exist after the task exits. > > > > > > You mean it shouldn't be deleted?

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #4145: [Feature][Zeta][REST-API] Get all completed jobs information.

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on issue #4145: URL: https://github.com/apache/incubator-seatunnel/issues/4145#issuecomment-1481159056 @Zzih Will this pr go ahead? If not, I would like to take over and finish it -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [incubator-seatunnel] liugddx opened a new pull request, #4405: [WIP][Feature][Connector-V2] [Hudi]Add hudi sink connector

2023-03-23 Thread via GitHub
liugddx opened a new pull request, #4405: URL: https://github.com/apache/incubator-seatunnel/pull/4405 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [incubator-seatunnel-website] CalvinKirs merged pull request #215: add doris icon

2023-03-23 Thread via GitHub
CalvinKirs merged PR #215: URL: https://github.com/apache/incubator-seatunnel-website/pull/215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-u

[incubator-seatunnel-website] branch main updated: add doris icon (#215)

2023-03-23 Thread kirs
This is an automated email from the ASF dual-hosted git repository. kirs pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git The following commit(s) were added to refs/heads/main by this push: new a87a118cc8 add doris icon (#215)

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2411: [Bug] [seatunnel-connector-flink-clickhouse] ClickhouseBatchSink config: fields

2023-03-23 Thread via GitHub
github-actions[bot] closed issue #2411: [Bug] [seatunnel-connector-flink-clickhouse] ClickhouseBatchSink config: fields URL: https://github.com/apache/incubator-seatunnel/issues/2411 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2411: [Bug] [seatunnel-connector-flink-clickhouse] ClickhouseBatchSink config: fields

2023-03-23 Thread via GitHub
github-actions[bot] commented on issue #2411: URL: https://github.com/apache/incubator-seatunnel/issues/2411#issuecomment-1482082419 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2394: [Feature]Support CDC

2023-03-23 Thread via GitHub
github-actions[bot] commented on issue #2394: URL: https://github.com/apache/incubator-seatunnel/issues/2394#issuecomment-1482082469 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2398: [ST-Engine][JobHistoryStorage] Job History Storage Design

2023-03-23 Thread via GitHub
github-actions[bot] closed issue #2398: [ST-Engine][JobHistoryStorage] Job History Storage Design URL: https://github.com/apache/incubator-seatunnel/issues/2398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2398: [ST-Engine][JobHistoryStorage] Job History Storage Design

2023-03-23 Thread via GitHub
github-actions[bot] commented on issue #2398: URL: https://github.com/apache/incubator-seatunnel/issues/2398#issuecomment-1482082442 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. --

[GitHub] [incubator-seatunnel] zhangzhaohuazai opened a new issue, #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-23 Thread via GitHub
zhangzhaohuazai opened a new issue, #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] zhangzhaohuazai commented on issue #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-23 Thread via GitHub
zhangzhaohuazai commented on issue #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406#issuecomment-1482144524 this is my connector in /seatunnel/connectors/seatunnel: ![image](https://user-images.githubusercontent.com/28680957/227404692-023fced2-0c77-478a-853a-1783b9d8

[GitHub] [incubator-seatunnel] lightzhao commented on pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
lightzhao commented on PR #4400: URL: https://github.com/apache/incubator-seatunnel/pull/4400#issuecomment-1482145262 > > > > This is just to delete the directory when commit, and the directory should still exist after the task exits. > > > > > > > > > You mean it

[GitHub] [incubator-seatunnel] zhangzhaohuazai commented on issue #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-23 Thread via GitHub
zhangzhaohuazai commented on issue #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406#issuecomment-1482146594 by the way, I use minIO for s3,but I didn't find "endpoint" param in s3file sink part of Official website: ![image](https://user-images.githubusercontent.com

[GitHub] [incubator-seatunnel] ashulin opened a new pull request, #4407: [e2e] Add TiDB JDBC e2e

2023-03-23 Thread via GitHub
ashulin opened a new pull request, #4407: URL: https://github.com/apache/incubator-seatunnel/pull/4407 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary p

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on pull request #4372: [Feature][Connector] http connector support pagable

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#issuecomment-1482169096 cc @TyrantLucifer PTAL, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-seatunnel] LYL41011 opened a new issue, #4408: [Bug] [clickhouse source] Unsupported data type data type in array is not supported

2023-03-23 Thread via GitHub
LYL41011 opened a new issue, #4408: URL: https://github.com/apache/incubator-seatunnel/issues/4408 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] middlemountainlee opened a new issue, #4409: [Feature request][V2sink-StarRocks/Doris] Ensure exactly-once semantics

2023-03-23 Thread via GitHub
middlemountainlee opened a new issue, #4409: URL: https://github.com/apache/incubator-seatunnel/issues/4409 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar fea

[GitHub] [incubator-seatunnel] zhangzhaohuazai commented on issue #4129: [Bug] [Seatunnel Engine] Unable to get S3 Source in local mode

2023-03-23 Thread via GitHub
zhangzhaohuazai commented on issue #4129: URL: https://github.com/apache/incubator-seatunnel/issues/4129#issuecomment-1482201059 Have you solved it yet? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-seatunnel] TyrantLucifer commented on pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
TyrantLucifer commented on PR #4400: URL: https://github.com/apache/incubator-seatunnel/pull/4400#issuecomment-1482201767 This pull request not make sense, I will close it, if you have any other questions, please reopen it and send an email to d...@seatunnel.apache.org -- This is an auto

[GitHub] [incubator-seatunnel] TyrantLucifer closed pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321

2023-03-23 Thread via GitHub
TyrantLucifer closed pull request #4400: [Bug] [Writer] hdfs temp folder has not been cleaned up #4321 URL: https://github.com/apache/incubator-seatunnel/pull/4400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [incubator-seatunnel] TyrantLucifer merged pull request #4377: [Feature][CDC][SqlServer] Support multi-table read

2023-03-23 Thread via GitHub
TyrantLucifer merged PR #4377: URL: https://github.com/apache/incubator-seatunnel/pull/4377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[incubator-seatunnel] branch dev updated (39dbe21a2 -> c4e3f2dc0)

2023-03-23 Thread tyrantlucifer
This is an automated email from the ASF dual-hosted git repository. tyrantlucifer pushed a change to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git from 39dbe21a2 [Hotfix][Zeta] Fix LogicalDagGeneratorTest testcase (#4401) add c4e3f2dc0 [Feature][CD

[GitHub] [incubator-seatunnel] TyrantLucifer closed issue #4370: [Bug] [connector-v2] [Eleasticsearch] document description error

2023-03-23 Thread via GitHub
TyrantLucifer closed issue #4370: [Bug] [connector-v2] [Eleasticsearch] document description error URL: https://github.com/apache/incubator-seatunnel/issues/4370 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [incubator-seatunnel] zhangzhaohuazai commented on issue #4406: [Bug] [hdfs to s3] java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found

2023-03-23 Thread via GitHub
zhangzhaohuazai commented on issue #4406: URL: https://github.com/apache/incubator-seatunnel/issues/4406#issuecomment-1482203168 whne I add these jar to plugins,I got new error: `2023-03-24 11:36:34,319 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel

[GitHub] [incubator-seatunnel] TyrantLucifer commented on a diff in pull request #4372: [Feature][Connector] http connector support pagable

2023-03-23 Thread via GitHub
TyrantLucifer commented on code in PR #4372: URL: https://github.com/apache/incubator-seatunnel/pull/4372#discussion_r1147086678 ## docs/en/connector-v2/source/Http.md: ## @@ -34,6 +34,10 @@ Used to read data from Http. | retry_backoff_multiplier_ms | int| No | 100

[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on issue #4408: [Bug] [clickhouse source] Unsupported data type data type in array is not supported

2023-03-23 Thread via GitHub
MonsterChenzhuo commented on issue #4408: URL: https://github.com/apache/incubator-seatunnel/issues/4408#issuecomment-1482207487 please assign to me; thx。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-seatunnel] LYL41011 opened a new issue, #4410: [Bug] [connectors-v2] ClickHouse to HIVE : java.io.UncheckedIOException: Failed to read column #10 of 601: state String

2023-03-23 Thread via GitHub
LYL41011 opened a new issue, #4410: URL: https://github.com/apache/incubator-seatunnel/issues/4410 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #4378: [Feature][Doc] Add Release Manager Document To WebSite

2023-03-23 Thread via GitHub
EricJoy2048 commented on issue #4378: URL: https://github.com/apache/incubator-seatunnel/issues/4378#issuecomment-1482214475 Hi, @lianghuan-xatu What is the progress of this issue now? -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[incubator-seatunnel-website] branch add_security_page created (now a95fae146c)

2023-03-23 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a change to branch add_security_page in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git at a95fae146c Add Security Page To WebSite This branch includes the following new c

[incubator-seatunnel-website] 01/01: Add Security Page To WebSite

2023-03-23 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch add_security_page in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel-website.git commit a95fae146cf6668b4b12ed5325c9d2b778b75f8c Author: gaojun AuthorDate: Fri Mar 24 11:5

[GitHub] [incubator-seatunnel] lianghuan-xatu commented on issue #4378: [Feature][Doc] Add Release Manager Document To WebSite

2023-03-23 Thread via GitHub
lianghuan-xatu commented on issue #4378: URL: https://github.com/apache/incubator-seatunnel/issues/4378#issuecomment-1482226625 Translation work is done. There is one last step left to change the link to the image. I will finish as soon as possible. -- This is an automated message from t

[GitHub] [incubator-seatunnel-website] lianghuan-xatu opened a new pull request, #217: [Feature][Doc] Add Release Manager Document To WebSite

2023-03-23 Thread via GitHub
lianghuan-xatu opened a new pull request, #217: URL: https://github.com/apache/incubator-seatunnel-website/pull/217 Add Release Manager Document To WebSite[https://github.com/apache/incubator-seatunnel/issues/4378](issues) -- This is an automated message from the Apache Git Service. To re