[GitHub] [seatunnel] lightzhao commented on a diff in pull request #4494: [Feature][KafkaSource]Add customize the row separator.

2023-07-25 Thread via GitHub
lightzhao commented on code in PR #4494: URL: https://github.com/apache/seatunnel/pull/4494#discussion_r1273142646 ## seatunnel-connectors-v2/connector-kafka/src/main/java/org/apache/seatunnel/connectors/seatunnel/kafka/source/KafkaSourceReader.java: ## @@ -150,8 +160,27 @@ publ

[GitHub] [seatunnel] ic4y commented on pull request #5147: [Feature][CDC base] Support string type shard fields.

2023-07-25 Thread via GitHub
ic4y commented on PR #5147: URL: https://github.com/apache/seatunnel/pull/5147#issuecomment-1649317846 Wait for #5150 to merge and resubmit this pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [seatunnel] Hisoka-X opened a new pull request, #5151: [Docs][Connector-V2][S3File]Reconstruct the S3File connector document

2023-07-25 Thread via GitHub
Hisoka-X opened a new pull request, #5151: URL: https://github.com/apache/seatunnel/pull/5151 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package ad

[GitHub] [seatunnel] Hisoka-X commented on a diff in pull request #5129: [Docs][Connector-V2][MyHours]Reconstruct the MyHours connector document

2023-07-25 Thread via GitHub
Hisoka-X commented on code in PR #5129: URL: https://github.com/apache/seatunnel/pull/5129#discussion_r1273227985 ## docs/en/connector-v2/source/MyHours.md: ## @@ -15,71 +17,104 @@ Used to read data from My Hours. - [ ] [parallelism](../../concept/connector-v2-features.md) - [

[GitHub] [seatunnel] Hisoka-X opened a new pull request, #5152: [Fix][Zeta] Fix SinkFlowLifeCycle without init lastCommitInfo

2023-07-25 Thread via GitHub
Hisoka-X opened a new pull request, #5152: URL: https://github.com/apache/seatunnel/pull/5152 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package ad

[GitHub] [seatunnel] lightzhao commented on pull request #4871: [Docs][Connector-V2][HDFS]Refactor connector-v2 docs using unified format HDFS.

2023-07-25 Thread via GitHub
lightzhao commented on PR #4871: URL: https://github.com/apache/seatunnel/pull/4871#issuecomment-1649617960 > kerberos done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [seatunnel] patsxy commented on issue #4971: [Bug] [Module Name] NoClassDefFoundError: com/sun/jersey/client/impl/CopyOnWriteHashMap

2023-07-25 Thread via GitHub
patsxy commented on issue #4971: URL: https://github.com/apache/seatunnel/issues/4971#issuecomment-1649656134 add lib jar ![image](https://github.com/apache/seatunnel/assets/16276664/5c4497d4-59de-4200-a54f-9ef36c8d90c3) -- This is an automated message from the Apache Git Service.

[GitHub] [seatunnel] TaoZex commented on a diff in pull request #5129: [Docs][Connector-V2][MyHours]Reconstruct the MyHours connector document

2023-07-25 Thread via GitHub
TaoZex commented on code in PR #5129: URL: https://github.com/apache/seatunnel/pull/5129#discussion_r1273403943 ## docs/en/connector-v2/source/MyHours.md: ## @@ -15,71 +17,104 @@ Used to read data from My Hours. - [ ] [parallelism](../../concept/connector-v2-features.md) - [ ]

[GitHub] [seatunnel] sunxiaojian commented on pull request #4516: [Feature][Connector-V2] connector-kafka source support data conversion extracted by kafka connect source

2023-07-25 Thread via GitHub
sunxiaojian commented on PR #4516: URL: https://github.com/apache/seatunnel/pull/4516#issuecomment-1649684809 > @sunxiaojian please resolve the conflict > @sunxiaojian please resolve the conflict @hailin0 done -- This is an automated message from the Apache Git Servic

[GitHub] [seatunnel] sunxiaojian commented on pull request #4516: [Feature][Connector-V2] connector-kafka source support data conversion extracted by kafka connect source

2023-07-25 Thread via GitHub
sunxiaojian commented on PR #4516: URL: https://github.com/apache/seatunnel/pull/4516#issuecomment-1649687093 > @sunxiaojian please resolve the conflict @hailin0 done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [seatunnel] FlechazoW opened a new pull request, #5153: [Feature][Connector V2][File] Add config of 'file_filter_pattern', which used for filtering files.

2023-07-25 Thread via GitHub
FlechazoW opened a new pull request, #5153: URL: https://github.com/apache/seatunnel/pull/5153 Add config of 'file_filter_pattern', which used for filtering files. WIP: miss doc. miss e2e. ## Purpose of this pull request ## Check list * [ ] Co

[GitHub] [seatunnel] FlechazoW commented on pull request #5153: [Feature][Connector V2][File] Add config of 'file_filter_pattern', which used for filtering files.

2023-07-25 Thread via GitHub
FlechazoW commented on PR #5153: URL: https://github.com/apache/seatunnel/pull/5153#issuecomment-1649732338 Issue ping #5098 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [seatunnel] XiaoJiang521 opened a new pull request, #5154: [feature][web] hive add option because web need

2023-07-25 Thread via GitHub
XiaoJiang521 opened a new pull request, #5154: URL: https://github.com/apache/seatunnel/pull/5154 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary packag

[GitHub] [seatunnel] chen0623-bak closed issue #5040: [Feature][seatunnel-transforms-v2] Custom function issues UDF问题

2023-07-25 Thread via GitHub
chen0623-bak closed issue #5040: [Feature][seatunnel-transforms-v2] Custom function issues UDF问题 URL: https://github.com/apache/seatunnel/issues/5040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [seatunnel] chen0623-bak closed issue #5040: [Feature][seatunnel-transforms-v2] Custom function issues UDF问题

2023-07-25 Thread via GitHub
chen0623-bak closed issue #5040: [Feature][seatunnel-transforms-v2] Custom function issues UDF问题 URL: https://github.com/apache/seatunnel/issues/5040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [seatunnel] hailin0 commented on pull request #4918: [feature][Connector-V2][cdc] Support flink running cdc job

2023-07-25 Thread via GitHub
hailin0 commented on PR #4918: URL: https://github.com/apache/seatunnel/pull/4918#issuecomment-1649870889 Please merge dev branch into this pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [seatunnel] mgierdal commented on issue #4599: Seatunnel with Spark: Caused by: java.lang.OutOfMemoryError: Java heap space

2023-07-25 Thread via GitHub
mgierdal commented on issue #4599: URL: https://github.com/apache/seatunnel/issues/4599#issuecomment-1649901207 I can use only `-m local`, having no access to sparc or kafka. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [seatunnel] hailin0 commented on pull request #4713: [draft][Spark streaming] fix spark streaming

2023-07-25 Thread via GitHub
hailin0 commented on PR #4713: URL: https://github.com/apache/seatunnel/pull/4713#issuecomment-1649919752 please resolve the conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [seatunnel] chenhaonan313 opened a new issue, #5155: Join the slack community

2023-07-25 Thread via GitHub
chenhaonan313 opened a new issue, #5155: URL: https://github.com/apache/seatunnel/issues/5155 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

[GitHub] [seatunnel] MonsterChenzhuo commented on pull request #4778: [Improve][Docs][Kafka]Reconstruct the kafka connector document

2023-07-25 Thread via GitHub
MonsterChenzhuo commented on PR #4778: URL: https://github.com/apache/seatunnel/pull/4778#issuecomment-1650157673 > Hi, please resolve conflict, thanks. done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [seatunnel] github-actions[bot] commented on issue #4920: [Bug] [hive-sink] 2PC Task failure processing logic, class HiveSinkAggregatedCommitter method abort

2023-07-25 Thread via GitHub
github-actions[bot] commented on issue #4920: URL: https://github.com/apache/seatunnel/issues/4920#issuecomment-1650745006 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

[GitHub] [seatunnel] github-actions[bot] closed issue #4920: [Bug] [hive-sink] 2PC Task failure processing logic, class HiveSinkAggregatedCommitter method abort

2023-07-25 Thread via GitHub
github-actions[bot] closed issue #4920: [Bug] [hive-sink] 2PC Task failure processing logic, class HiveSinkAggregatedCommitter method abort URL: https://github.com/apache/seatunnel/issues/4920 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [seatunnel] github-actions[bot] commented on issue #4602: [Feature][TDengine] Using http rest connection instead of jdbc driver

2023-07-25 Thread via GitHub
github-actions[bot] commented on issue #4602: URL: https://github.com/apache/seatunnel/issues/4602#issuecomment-1650745066 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

[GitHub] [seatunnel] github-actions[bot] closed issue #4602: [Feature][TDengine] Using http rest connection instead of jdbc driver

2023-07-25 Thread via GitHub
github-actions[bot] closed issue #4602: [Feature][TDengine] Using http rest connection instead of jdbc driver URL: https://github.com/apache/seatunnel/issues/4602 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [seatunnel] EricJoy2048 merged pull request #5150: [Feature][CDC] Support tables without primary keys (with unique keys)

2023-07-25 Thread via GitHub
EricJoy2048 merged PR #5150: URL: https://github.com/apache/seatunnel/pull/5150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seat

[seatunnel] branch dev updated: [Feature][CDC] Support tables without primary keys (with unique keys) (#163) (#5150)

2023-07-25 Thread gaojun2048
This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new 32b7f2b690 [Feature][CDC] Support tables withou

[GitHub] [seatunnel] EricJoy2048 commented on a diff in pull request #5154: [feature][web] hive add option because web need

2023-07-25 Thread via GitHub
EricJoy2048 commented on code in PR #5154: URL: https://github.com/apache/seatunnel/pull/5154#discussion_r1274301058 ## seatunnel-connectors-v2/connector-hive/src/main/java/org/apache/seatunnel/connectors/seatunnel/hive/config/HiveConfig.java: ## @@ -43,6 +45,14 @@ public class

[GitHub] [seatunnel] hailin0 opened a new issue, #5156: [Feature][CDC] Support for preferring numeric fields as split keys

2023-07-25 Thread via GitHub
hailin0 opened a new issue, #5156: URL: https://github.com/apache/seatunnel/issues/5156 ### Search before asking - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. #

[GitHub] [seatunnel] hailin0 commented on issue #5156: [Feature][CDC] Support for preferring numeric fields as split keys

2023-07-25 Thread via GitHub
hailin0 commented on issue #5156: URL: https://github.com/apache/seatunnel/issues/5156#issuecomment-1650887913 reference https://github.com/apache/seatunnel/pull/5147/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [seatunnel] EricJoy2048 commented on a diff in pull request #5086: [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source

2023-07-25 Thread via GitHub
EricJoy2048 commented on code in PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#discussion_r1274312687 ## docs/en/connector-v2/source/Doris.md: ## @@ -0,0 +1,121 @@ +# Doris + +> Doris source connector + +## Description + +Used to read data from Doris. + +## Key fe

[GitHub] [seatunnel] EricJoy2048 commented on pull request #5086: [Feature-WIP][Connector-V2][Doris] Add Doris ConnectorV2 Source

2023-07-25 Thread via GitHub
EricJoy2048 commented on PR #5086: URL: https://github.com/apache/seatunnel/pull/5086#issuecomment-1650893997 Please fix code style. you can use ` sh tools/spotless_check/pre-commit.sh` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [seatunnel] Hisoka-X commented on pull request #5148: [Fix][Zeta] Resolve out-of-heap memory overflow

2023-07-25 Thread via GitHub
Hisoka-X commented on PR #5148: URL: https://github.com/apache/seatunnel/pull/5148#issuecomment-1650901151 Good catch, but I think we should figure out why class loader not release after job finished. This is the reason of metaspace OOM. Is some thread not finished? -- This is an automat

[GitHub] [seatunnel] hailin0 commented on pull request #5148: [Fix][Zeta] Resolve out-of-heap memory overflow

2023-07-25 Thread via GitHub
hailin0 commented on PR #5148: URL: https://github.com/apache/seatunnel/pull/5148#issuecomment-1650907597 > Good catch, but I think we should figure out why class loader not release after job finished. This is the reason of metaspace OOM. Is some thread not finished? Reuse classloade

[GitHub] [seatunnel] Anandonzy commented on issue #4971: [Bug] [Module Name] NoClassDefFoundError: com/sun/jersey/client/impl/CopyOnWriteHashMap

2023-07-25 Thread via GitHub
Anandonzy commented on issue #4971: URL: https://github.com/apache/seatunnel/issues/4971#issuecomment-1650928034 > Try to put this file to $seatunnel/lib, and restart. https://repo.maven.apache.org/maven2/org/apache/seatunnel/seatunnel-hadoop3-3.1.4-uber/2.3.2/ You shuould add` seatun

[seatunnel] branch davidzollo-patch-3 created (now 9a11698344)

2023-07-25 Thread lidongdai
This is an automated email from the ASF dual-hosted git repository. lidongdai pushed a change to branch davidzollo-patch-3 in repository https://gitbox.apache.org/repos/asf/seatunnel.git at 9a11698344 Update bug-report.yml This branch includes the following new commits: new 9a116983

[seatunnel] 01/01: Update bug-report.yml

2023-07-25 Thread lidongdai
This is an automated email from the ASF dual-hosted git repository. lidongdai pushed a commit to branch davidzollo-patch-3 in repository https://gitbox.apache.org/repos/asf/seatunnel.git commit 9a11698344fda3e724fedbe8047d2a0974d61b1b Author: David Zollo AuthorDate: Wed Jul 26 11:47:07 2023 +080

[GitHub] [seatunnel] chen0623-bak commented on issue #4939: [Feature][connector-kafka] kafka source无法解析复杂字段 (connector-kafka does not seem to support parsing complex fields)

2023-07-25 Thread via GitHub
chen0623-bak commented on issue #4939: URL: https://github.com/apache/seatunnel/issues/4939#issuecomment-1650938675 炸裂应该是不可以的, 上层接口规定一行输入 一行输出 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [seatunnel] WhatAKitty opened a new issue, #5157: [Bug] [Cdc] checkpoint is always increment

2023-07-25 Thread via GitHub
WhatAKitty opened a new issue, #5157: URL: https://github.com/apache/seatunnel/issues/5157 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happene

[GitHub] [seatunnel] patsxy opened a new issue, #5158: [Bug] [Module Name] Bug title partition_column and schema cannot be used simultaneously. It will result in the following error: Caused by: org.ap

2023-07-25 Thread via GitHub
patsxy opened a new issue, #5158: URL: https://github.com/apache/seatunnel/issues/5158 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[GitHub] [seatunnel] hailin0 commented on pull request #4516: [Feature][Connector-V2] connector-kafka source support data conversion extracted by kafka connect source

2023-07-25 Thread via GitHub
hailin0 commented on PR #4516: URL: https://github.com/apache/seatunnel/pull/4516#issuecomment-1651034607 > > @sunxiaojian please resolve the conflict > > @hailin0 done Duplicate with https://github.com/apache/seatunnel/pull/5066 feature? -- This is an automated message from

[GitHub] [seatunnel-web] zhangchengming601 commented on pull request #92: [IMPROVE] Add plugin isolation function

2023-07-25 Thread via GitHub
zhangchengming601 commented on PR #92: URL: https://github.com/apache/seatunnel-web/pull/92#issuecomment-1651053428 > good job Licenses don't pass the check script, please update or add the related licenses, the detail are as follows, https://user-images.githubusercontent.com/15833811/255897

[GitHub] [seatunnel-web] zhangchengming601 commented on pull request #92: [IMPROVE] Add plugin isolation function

2023-07-25 Thread via GitHub
zhangchengming601 commented on PR #92: URL: https://github.com/apache/seatunnel-web/pull/92#issuecomment-1651054286 > good job Licenses don't pass the check script, please update or add the related licenses, the detail are as follows, https://user-images.githubusercontent.com/15833811/255897

[GitHub] [seatunnel] liugddx commented on issue #5158: [Bug] [Module Name] Bug title partition_column and schema cannot be used simultaneously. It will result in the following error: Caused by: org.ap

2023-07-25 Thread via GitHub
liugddx commented on issue #5158: URL: https://github.com/apache/seatunnel/issues/5158#issuecomment-1651054410 `"partition_num"=1`, is there any problem with this configuration. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [seatunnel] hailin0 commented on a diff in pull request #4516: [Feature][Connector-V2] connector-kafka source support data conversion extracted by kafka connect source

2023-07-25 Thread via GitHub
hailin0 commented on code in PR #4516: URL: https://github.com/apache/seatunnel/pull/4516#discussion_r1274428263 ## seatunnel-connectors-v2/connector-kafka/pom.xml: ## @@ -61,6 +62,33 @@ seatunnel-format-compatible-debezium-json ${project.version}

[GitHub] [seatunnel] CheneyYin opened a new issue, #5159: [Bug] [Spark] Fail to execute transform when schema of source table contains any row type fields.

2023-07-25 Thread via GitHub
CheneyYin opened a new issue, #5159: URL: https://github.com/apache/seatunnel/issues/5159 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[GitHub] [seatunnel] davidzollo opened a new pull request, #5160: [Improve] Update bug-report.yml

2023-07-25 Thread via GitHub
davidzollo opened a new pull request, #5160: URL: https://github.com/apache/seatunnel/pull/5160 ## Purpose of this pull request ## Check list * [ ] Code changed are covered with tests, or it does not need tests for reason: * [ ] If any new Jar binary package