Re: [I] [Bug] [connector-cdc-postgres] Table public.postgres_cdc_table_1 does not exist in Catalog Postgres [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6043: URL: https://github.com/apache/seatunnel/issues/6043#issuecomment-1868456918 What version of the code are you using? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [I] [Bug] [connector-jdbc] OracleCatalog's SELECT_COLUMNS_SQL_TEMPLATE have some COLUMN_LENGTH issue when the column‘s type is NVARCHAR2 or NCHAR [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6054: URL: https://github.com/apache/seatunnel/issues/6054#issuecomment-1868458784 @LoverAndrew hi, are you willing to contribute a pr to fix it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [Feature][TIDB] TiDB Connector supports CDC or not. [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6031: URL: https://github.com/apache/seatunnel/issues/6031#issuecomment-1868460153 hi, @CodeExplorer10 not yet. Would you like to contribute to this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] seatunnels&postgresql [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6028: URL: https://github.com/apache/seatunnel/issues/6028#issuecomment-1868461115 > 这里报错说找不到这个class文件java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry,我去看了postgis-jdbc.jar的包结构,只能找到net/postgis/jdbc这一级目录,往后的找不到了。我不确定是代码找的目录写错了,或者是我用的包版本不对,又或者是

Re: [I] [Bug] can not execute myssql-to-clickhouse job [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6021: URL: https://github.com/apache/seatunnel/issues/6021#issuecomment-1868462047 @wjhphp hi,Can you give us more information,will you contribute to this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] [Bug] [connectoer v2 sink clickhouse] mysql cdc -> clickhnouse [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6014: URL: https://github.com/apache/seatunnel/issues/6014#issuecomment-1868462945 hi, @spihiker This seems to be caused by the fact that the c3 field itself cannot be null, can you check the ddl for this? -- This is an automated message from the Apache G

Re: [I] SQL server uses datatime2 to synchronize data and an exception occurs [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6011: URL: https://github.com/apache/seatunnel/issues/6011#issuecomment-1868463803 Look forward to your contribution -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] hdfs to elasticsearch report error [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #6001: URL: https://github.com/apache/seatunnel/issues/6001#issuecomment-1868465881 @maqw666 You can try the dev branch because it may have been fixed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] [BUG][connector-file-base][HIVE]If hive serves as sink, an error message is reported when not all hive fields are mapped to the source [seatunnel]

2023-12-24 Thread via GitHub
Carl-Zhou-CN commented on issue #5995: URL: https://github.com/apache/seatunnel/issues/5995#issuecomment-1868466431 @t1234849 Look forward to your contributions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] [WIP-Improve][Connector-V2][CDC] Remove `CommonErrorCodeDeprecated.UNSUPPORTED_DATA_TYPE` [seatunnel]

2023-12-24 Thread via GitHub
CheneyYin opened a new pull request, #6069: URL: https://github.com/apache/seatunnel/pull/6069 ### Purpose of this pull request Remove `CommonErrorCodeDeprecated.UNSUPPORTED_DATA_TYPE` ### Does this PR introduce _any_ user-facing change? ### How wa

Re: [PR] [Feature][OssFile Connector] Make Oss implement source factory and sink factory [seatunnel]

2023-12-24 Thread via GitHub
hailin0 commented on code in PR #6062: URL: https://github.com/apache/seatunnel/pull/6062#discussion_r1435849724 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-oss-e2e/src/test/resources/excel/fake_to_oss_excel.conf: ## @@ -0,0 +1,77 @@ +# +# Licensed to the Apache S

Re: [I] [Improve][E2E] Change log level to WARN in e2e [seatunnel]

2023-12-24 Thread via GitHub
github-actions[bot] closed issue #5842: [Improve][E2E] Change log level to WARN in e2e URL: https://github.com/apache/seatunnel/issues/5842 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [I] > > Hello, when using jdbc, I need to set some properties before executing the query. It is not supported currently, so I added some things to help with the review. Implement jdbc:hive2 custom

2023-12-24 Thread via GitHub
github-actions[bot] commented on issue #5913: URL: https://github.com/apache/seatunnel/issues/5913#issuecomment-1868623053 This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

Re: [I] [Improve][E2E] Change log level to WARN in e2e [seatunnel]

2023-12-24 Thread via GitHub
github-actions[bot] commented on issue #5842: URL: https://github.com/apache/seatunnel/issues/5842#issuecomment-1868623071 This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future. -- This is a

Re: [I] [Bug] [hive] [hdp] Failed to import data into Hive in the HDP cluster [seatunnel]

2023-12-24 Thread via GitHub
Komorebiyho commented on issue #6060: URL: https://github.com/apache/seatunnel/issues/6060#issuecomment-1868649074 I have seen the question you raised, but I am using the hive exec 2.3.9. jar package and have also tried matching versions of the package, but it reported another error -- T

Re: [I] [Bug] [hive] [hdp] Failed to import data into Hive in the HDP cluster [seatunnel]

2023-12-24 Thread via GitHub
Komorebiyho commented on issue #6060: URL: https://github.com/apache/seatunnel/issues/6060#issuecomment-1868650957 > 根据错误日志,也许 hive 的配置是错误的。这是我在使用 Hive 时遇到的问题 #5861,对您有帮助。 I have seen the question you raised, but I am using the hive exec 2.3.9. jar package and have also tried matching

Re: [PR] [Improve][Formats] Refactor exception catch for `ignoreParseErrors`. [seatunnel]

2023-12-24 Thread via GitHub
Hisoka-X commented on code in PR #6065: URL: https://github.com/apache/seatunnel/pull/6065#discussion_r1435913816 ## seatunnel-formats/seatunnel-format-json/src/main/java/org/apache/seatunnel/format/json/JsonDeserializationSchema.java: ## @@ -132,11 +133,11 @@ private SeaTunnelR

Re: [PR] [Improve][Formats] Refactor exception catch for `ignoreParseErrors`. [seatunnel]

2023-12-24 Thread via GitHub
Hisoka-X commented on code in PR #6065: URL: https://github.com/apache/seatunnel/pull/6065#discussion_r1435913816 ## seatunnel-formats/seatunnel-format-json/src/main/java/org/apache/seatunnel/format/json/JsonDeserializationSchema.java: ## @@ -132,11 +133,11 @@ private SeaTunnelR

Re: [PR] [Feature][OssFile Connector] Make Oss implement source factory and sink factory [seatunnel]

2023-12-24 Thread via GitHub
EricJoy2048 commented on code in PR #6062: URL: https://github.com/apache/seatunnel/pull/6062#discussion_r1435922176 ## seatunnel-e2e/seatunnel-connector-v2-e2e/connector-file-oss-e2e/src/test/resources/parquet/e2e.parquet: ## Review Comment: > Based on #5545 , we need to r

Re: [I] [Bug] [seatunnel-connectors-v2][Kudu] Output kudu table error java.lang.NullPointerException [seatunnel]

2023-12-24 Thread via GitHub
luyfuMinimalism commented on issue #4336: URL: https://github.com/apache/seatunnel/issues/4336#issuecomment-1868685314 我也遇到了这个问题,该问题解决了吗? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [Feature][OssFile Connector] Make Oss implement source factory and sink factory [seatunnel]

2023-12-24 Thread via GitHub
EricJoy2048 commented on code in PR #6062: URL: https://github.com/apache/seatunnel/pull/6062#discussion_r1435923473 ## seatunnel-examples/seatunnel-engine-examples/pom.xml: ## @@ -29,6 +29,9 @@ 3.1.4 +3.1.4 Review Comment: > Whether it needs to appe

Re: [I] [Bug] [connector-jdbc] OracleCatalog's SELECT_COLUMNS_SQL_TEMPLATE have some COLUMN_LENGTH issue when the column‘s type is NVARCHAR2 or NCHAR [seatunnel]

2023-12-24 Thread via GitHub
LoverAndrew commented on issue #6054: URL: https://github.com/apache/seatunnel/issues/6054#issuecomment-1868688022 > @LoverAndrew hi, are you willing to contribute a pr to fix it? Certainly, but I don't know the process of contribute. Could you guide me the process? -- This is an a

Re: [PR] [Hotfix][Zeta] Fix zeta scheduler bug [seatunnel]

2023-12-24 Thread via GitHub
EricJoy2048 commented on code in PR #6050: URL: https://github.com/apache/seatunnel/pull/6050#discussion_r1435938203 ## seatunnel-engine/seatunnel-engine-client/src/main/java/org/apache/seatunnel/engine/client/job/ClientJobProxy.java: ## @@ -117,10 +115,6 @@ public JobResult wai

Re: [PR] [Feature][Zeta] Add operation retry params to seatunnel.yaml [seatunnel]

2023-12-24 Thread via GitHub
EricJoy2048 closed pull request #4443: [Feature][Zeta] Add operation retry params to seatunnel.yaml URL: https://github.com/apache/seatunnel/pull/4443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [Improve][Formats] Refactor exception catch for `ignoreParseErrors`. [seatunnel]

2023-12-24 Thread via GitHub
CheneyYin commented on code in PR #6065: URL: https://github.com/apache/seatunnel/pull/6065#discussion_r1435955006 ## seatunnel-formats/seatunnel-format-json/src/main/java/org/apache/seatunnel/format/json/JsonDeserializationSchema.java: ## @@ -132,11 +133,11 @@ private SeaTunnel

[I] [Bug] [FTP SOURCE] Unable to return file list under FTP path in the code [seatunnel]

2023-12-24 Thread via GitHub
WilliamTan778 opened a new issue, #6070: URL: https://github.com/apache/seatunnel/issues/6070 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happ

Re: [I] [Bug] 使用Seatunnel Engine 运行作业时,-i city=bj 无法将 bj 赋值到配置文件中的变量;但是linux中export city=bj 可以赋值变量 [seatunnel]

2023-12-24 Thread via GitHub
liugddx closed issue #5316: [Bug] 使用Seatunnel Engine 运行作业时,-i city=bj 无法将 bj 赋值到配置文件中的变量;但是linux中export city=bj 可以赋值变量 URL: https://github.com/apache/seatunnel/issues/5316 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[PR] [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) [seatunnel]

2023-12-24 Thread via GitHub
WilliamTan778 opened a new pull request, #6071: URL: https://github.com/apache/seatunnel/pull/6071 [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) ### Purpose of this pull request ### Does this PR introduce _any_ user-facing

Re: [I] [Bug] [Starter] Checkpoint Config Use HDFS Namespace [seatunnel]

2023-12-24 Thread via GitHub
PINK97 commented on issue #5906: URL: https://github.com/apache/seatunnel/issues/5906#issuecomment-1868774690 > I have determined that the current seatunel runtime environment can be accessed through the HDFS namespace and has also been configured with HADOOP_ HOME and related configuration

Re: [PR] [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) [seatunnel]

2023-12-24 Thread via GitHub
WilliamTan778 closed pull request #6071: [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) URL: https://github.com/apache/seatunnel/pull/6071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] [Fix] [Connectors-v2-file-ftp] Unable to return file list under FTP path (#6070) [seatunnel]

2023-12-24 Thread via GitHub
WilliamTan778 opened a new pull request, #6072: URL: https://github.com/apache/seatunnel/pull/6072 ### Purpose of this pull request ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ### Check list

[I] [Bug] [seatunnel web ] source name is empty [seatunnel]

2023-12-24 Thread via GitHub
sunyaf opened a new issue, #6073: URL: https://github.com/apache/seatunnel/issues/6073 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

[I] [Bug] [web] web ui cannot be displayed [seatunnel]

2023-12-24 Thread via GitHub
impactCn opened a new issue, #6074: URL: https://github.com/apache/seatunnel/issues/6074 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened

Re: [PR] [Improve][Formats] Refactor exception catch for `ignoreParseErrors`. [seatunnel]

2023-12-24 Thread via GitHub
Hisoka-X commented on code in PR #6065: URL: https://github.com/apache/seatunnel/pull/6065#discussion_r1435991268 ## seatunnel-formats/seatunnel-format-json/src/main/java/org/apache/seatunnel/format/json/JsonDeserializationSchema.java: ## @@ -132,11 +133,11 @@ private SeaTunnelR

Re: [PR] [Improve][Formats] Refactor exception catch for `ignoreParseErrors`. [seatunnel]

2023-12-24 Thread via GitHub
Hisoka-X merged PR #6065: URL: https://github.com/apache/seatunnel/pull/6065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunn

Re: [I] [Bug] [Formats] When `ignoreParseErrors` is enabled, overly broad exception catching might catch exceptions that can't be handled. [seatunnel]

2023-12-24 Thread via GitHub
Hisoka-X closed issue #6064: [Bug] [Formats] When `ignoreParseErrors` is enabled, overly broad exception catching might catch exceptions that can't be handled. URL: https://github.com/apache/seatunnel/issues/6064 -- This is an automated message from the Apache Git Service. To respond to the

(seatunnel) branch dev updated: [Improve][Formats] Refactor exception catch for `ignoreParseErrors`. (#6065)

2023-12-24 Thread fanjia
This is an automated email from the ASF dual-hosted git repository. fanjia pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/seatunnel.git The following commit(s) were added to refs/heads/dev by this push: new f248f97703 [Improve][Formats] Refactor exception ca

Re: [PR] [feature][doc] update doc for jdbc-connector [seatunnel]

2023-12-24 Thread via GitHub
chl-wxp commented on code in PR #5765: URL: https://github.com/apache/seatunnel/pull/5765#discussion_r1435996600 ## docs/en/connector-v2/sink/Jdbc.md: ## @@ -231,6 +269,8 @@ sink { database = "sink_database" table = "sink_table" primary_keys = ["key1",