Re: [PR] feat(oceanbase-catalog): Support schema operations for OceanBase JDBC catalog. [gravitino]

2024-10-11 Thread via GitHub
mchades commented on PR #5013: URL: https://github.com/apache/gravitino/pull/5013#issuecomment-2408316508 > > LGTM. Thanks for your contributions and sorry for my later response. > > I think the next PR should be `support simple table operations for Oceanbase catalog` > > I think i

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on PR #5058: URL: https://github.com/apache/gravitino/pull/5058#issuecomment-2408393991 @shaofengshi @diqiu50 @yuqi1129 @mchades if you could review agian that would be appreciated -- This is an automated message from the Apache Git Service. To respond to the messag

[PR] [#5059] Add commands to create, delete and modify metalakes, catalogs and schema. [gravitino]

2024-10-11 Thread via GitHub
justinmclean opened a new pull request, #5117: URL: https://github.com/apache/gravitino/pull/5117 ### What changes were proposed in this pull request? Add commands to create, delete and modify metalakes, catalogs and schema. ### Why are the changes needed? stage 2 of the

Re: [PR] [#4951] improvement(test): Reduce fields shares between different IT to make AbstractIT more independent. [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #4996: URL: https://github.com/apache/gravitino/pull/4996#discussion_r1796601197 ## trino-connector/integration-test/src/test/java/org/apache/gravitino/trino/connector/integration/test/TrinoQueryITBase.java: ## @@ -68,14 +68,17 @@ public class Tr

Re: [I] [Bug report] 'ndbinfo','performance_schema','FEDERATED' engines are not supported in Gravitino MySQL catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on issue #5100: URL: https://github.com/apache/gravitino/issues/5100#issuecomment-2406965454 @danhuawang Starting from MySQL 5.5, the FEDERATED engine is installed by default but is not enabled, so you need to enable the `FEDERATED` first. -- This is an automate

Re: [PR] [#4952] feat(hudi-catalog): add implementation of HMSBackend for Hudi catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao merged PR #4942: URL: https://github.com/apache/gravitino/pull/4942 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

Re: [I] [Subtask] Support read operations of HMSBackend for Hudi catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao closed issue #4952: [Subtask] Support read operations of HMSBackend for Hudi catalog URL: https://github.com/apache/gravitino/issues/4952 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

(gravitino) branch main updated: [#4952] feat(hudi-catalog): add implementation of HMSBackend for Hudi catalog (#4942)

2024-10-11 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new fdb07abfb [#4952] feat(hudi-catalog): add implemen

[PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerqi opened a new pull request, #5102: URL: https://github.com/apache/gravitino/pull/5102 ### What changes were proposed in this pull request? Fix the document error about access control ### Why are the changes needed? Fix: #5101 ### Does this PR introduce _any_

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796518199 ## scripts/mysql/upgrade-0.6.0-to-0.7.0-mysql.sql: ## @@ -0,0 +1,41 @@ +-- +-- Licensed to the Apache Software Foundation (ASF) under one +-- or more contributor li

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796521933 ## scripts/mysql/upgrade-0.6.0-to-0.7.0-mysql.sql: ## @@ -0,0 +1,41 @@ +-- +-- Licensed to the Apache Software Foundation (ASF) under one +-- or more contributor li

Re: [PR] [#4940] feat(lakehouse-paimon): Support OSS filesystem for Paimon catalog. [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #4941: URL: https://github.com/apache/gravitino/pull/4941#discussion_r1796527212 ## catalogs/catalog-lakehouse-paimon/src/test/java/org/apache/gravitino/catalog/lakehouse/paimon/integration/test/CatalogPaimonOSSIT.java: ## @@ -0,0 +1,101 @@ +/* +

Re: [PR] [#4657] Improvement (docs): Add documentation for the Gravitino-Trino connector running on AWS S3. [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on PR #4658: URL: https://github.com/apache/gravitino/pull/4658#issuecomment-2406740079 Generally LGTM, @FANNG1 , do you have any further comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerryshao merged PR #5102: URL: https://github.com/apache/gravitino/pull/5102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

Re: [I] [Improvement] Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerryshao closed issue #5101: [Improvement] Fix the document error about access control URL: https://github.com/apache/gravitino/issues/5101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] [Improvement] Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerryshao closed issue #5101: [Improvement] Fix the document error about access control URL: https://github.com/apache/gravitino/issues/5101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

(gravitino) branch main updated: [#5101] improvement(docs): Fix the document error about access control (#5102)

2024-10-11 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new df2ce81e8 [#5101] improvement(docs): Fix the docum

[PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
github-actions[bot] opened a new pull request, #5104: URL: https://github.com/apache/gravitino/pull/5104 ### What changes were proposed in this pull request? Fix the document error about access control ### Why are the changes needed? Fix: #5101 ### Does this PR in

(gravitino) branch cherry-pick-branch-0.6-df2ce81e857851e234021e49d49c94bad702519c created (now 072582199)

2024-10-11 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch cherry-pick-branch-0.6-df2ce81e857851e234021e49d49c94bad702519c in repository https://gitbox.apache.org/repos/asf/gravitino.git at 072582199 [#5101] improvement(docs): Fix the document

Re: [PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerryshao closed pull request #5104: [#5101] improvement(docs): Fix the document error about access control URL: https://github.com/apache/gravitino/pull/5104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [#4951] improvement(test): Reduce fields shares between different IT to make AbstractIT more independent. [gravitino]

2024-10-11 Thread via GitHub
mchades commented on code in PR #4996: URL: https://github.com/apache/gravitino/pull/4996#discussion_r1796557198 ## trino-connector/integration-test/src/test/java/org/apache/gravitino/trino/connector/integration/test/TrinoQueryITBase.java: ## @@ -68,14 +68,17 @@ public class Tri

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on PR #5020: URL: https://github.com/apache/gravitino/pull/5020#issuecomment-2406752097 @xloya can you please also help to review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796568717 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/FileSystemProvider.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Fo

Re: [PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5102: URL: https://github.com/apache/gravitino/pull/5102#discussion_r1796531401 ## docs/docker-image-details.md: ## @@ -14,7 +14,7 @@ You can deploy the service with the Gravitino Docker image. Container startup commands ```shell -docker run

Re: [PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerqi commented on code in PR #5102: URL: https://github.com/apache/gravitino/pull/5102#discussion_r1796542631 ## docs/docker-image-details.md: ## @@ -14,7 +14,7 @@ You can deploy the service with the Gravitino Docker image. Container startup commands ```shell -docker run --

[PR] [MINOR] fix(docs): update javaDoc link from 0.6.0-incubating to 0.7.0-incubating [gravitino]

2024-10-11 Thread via GitHub
mchades opened a new pull request, #5103: URL: https://github.com/apache/gravitino/pull/5103 ### What changes were proposed in this pull request? update javaDoc link from 0.6.0-incubating to 0.7.0-incubating ### Why are the changes needed? Fix version info ### Does

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796548589 ## core/src/main/java/org/apache/gravitino/storage/relational/service/TableMetaService.java: ## @@ -144,30 +153,47 @@ public TableEntity updateTable( Co

Re: [PR] [MINOR] fix(docs): update javaDoc link from 0.6.0-incubating to 0.7.0-incubating [gravitino]

2024-10-11 Thread via GitHub
jerryshao merged PR #5103: URL: https://github.com/apache/gravitino/pull/5103 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

(gravitino) branch main updated: [MINOR] fix(docs): update javaDoc link from 0.6.0-incubating to 0.7.0-incubating (#5103)

2024-10-11 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new d956d5d23 [MINOR] fix(docs): update javaDoc link f

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796584976 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/HadoopCatalogOperations.java: ## @@ -119,32 +135,59 @@ public void initialize( M

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on PR #5020: URL: https://github.com/apache/gravitino/pull/5020#issuecomment-2406873415 Can you please do several rounds of self polishing to make the code better? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796603274 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/HadoopCatalogOperations.java: ## @@ -742,4 +785,44 @@ private boolean checkSingleFile(F

Re: [PR] [#4951] improvement(test): Reduce fields shares between different IT to make AbstractIT more independent. [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #4996: URL: https://github.com/apache/gravitino/pull/4996#discussion_r1796601197 ## trino-connector/integration-test/src/test/java/org/apache/gravitino/trino/connector/integration/test/TrinoQueryITBase.java: ## @@ -68,14 +68,17 @@ public class Tr

(gravitino) branch cherry-pick-branch-0.6-df2ce81e857851e234021e49d49c94bad702519c deleted (was 072582199)

2024-10-11 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a change to branch cherry-pick-branch-0.6-df2ce81e857851e234021e49d49c94bad702519c in repository https://gitbox.apache.org/repos/asf/gravitino.git was 072582199 [#5101] improvement(docs): Fix the document erro

Re: [PR] [#5072]Improvement(docs): Add docs for Trino cascading query [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on PR #5012: URL: https://github.com/apache/gravitino/pull/5012#issuecomment-2406895287 @mchades @FANNG1 Would you like to take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [PR] [#5055] support spark authentication with Gravitino [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5040: URL: https://github.com/apache/gravitino/pull/5040#discussion_r1796624990 ## docs/spark-connector/spark-authentication-with-gravitino.md: ## @@ -0,0 +1,47 @@ +--- +title: "Spark authentication with Gravitino server" +slug: /spark-connector

Re: [PR] [#5101] improvement(docs): Fix the document error about access control [gravitino]

2024-10-11 Thread via GitHub
jerryshao merged PR #5104: URL: https://github.com/apache/gravitino/pull/5104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

(gravitino) branch branch-0.6 updated: [#5101] improvement(docs): Fix the document error about access control (#5104)

2024-10-11 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new f3dd6430a [#5101] improvement(docs): F

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796609977 ## core/src/main/java/org/apache/gravitino/storage/relational/service/MetalakeMetaService.java: ## @@ -191,6 +192,10 @@ public boolean deleteMetalake(NameIdentifier

Re: [PR] [#5077] feat(core): Add the check of user before creating metadata object [gravitino]

2024-10-11 Thread via GitHub
xunliu commented on code in PR #5096: URL: https://github.com/apache/gravitino/pull/5096#discussion_r1796661464 ## clients/client-java/src/test/java/org/apache/gravitino/client/integration/test/authorization/CheckCurrentUserIT.java: ## @@ -0,0 +1,237 @@ +/* + * Licensed to the A

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797060667 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797485740 ## clients/cli/src/main/java/org/apache/gravitino/cli/GravitinoCommandLine.java: ## @@ -0,0 +1,191 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

(gravitino) branch main updated: [#5094] Fix(catalog-lakehouse-paimon): make some table properties from reserved to immutable (#5095)

2024-10-11 Thread fanng
This is an automated email from the ASF dual-hosted git repository. fanng pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new 8de31cdb3 [#5094] Fix(catalog-lakehouse-paimon): m

Re: [PR] [#5094] Fix(catalog-lakehouse-paimon): make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
FANNG1 merged PR #5095: URL: https://github.com/apache/gravitino/pull/5095 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravitino

Re: [I] [Improvement][catalog-lakehouse-paimon] make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
FANNG1 closed issue #5094: [Improvement][catalog-lakehouse-paimon] make some table properties from reserved to immutable URL: https://github.com/apache/gravitino/issues/5094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] [Improvement][catalog-lakehouse-paimon] make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
FANNG1 closed issue #5094: [Improvement][catalog-lakehouse-paimon] make some table properties from reserved to immutable URL: https://github.com/apache/gravitino/issues/5094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [#4953] feat(hudi-catalog): add Hudi catalog IT and enable module [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #4965: URL: https://github.com/apache/gravitino/pull/4965#discussion_r1797529352 ## catalogs/catalog-lakehouse-hudi/build.gradle.kts: ## @@ -115,12 +110,29 @@ dependencies { testImplementation(libs.hadoop2.auth) { exclude("*") } + te

Re: [PR] [#4951] improvement(test): Reduce fields shares between different IT to make AbstractIT more independent. [gravitino]

2024-10-11 Thread via GitHub
mchades commented on code in PR #4996: URL: https://github.com/apache/gravitino/pull/4996#discussion_r1797529498 ## integration-test-common/src/test/java/org/apache/gravitino/integration/test/util/AbstractIT.java: ## @@ -58,61 +58,61 @@ import org.apache.gravitino.server.web.Je

Re: [PR] [#4953] feat(hudi-catalog): add Hudi catalog IT and enable module [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #4965: URL: https://github.com/apache/gravitino/pull/4965#discussion_r1797529512 ## catalogs/catalog-lakehouse-hudi/build.gradle.kts: ## @@ -138,3 +150,60 @@ dependencies { testRuntimeOnly("org.apache.hudi:hudi-spark$sparkVersion-bundle_$sca

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
xloya commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796583051 ## core/src/main/java/org/apache/gravitino/storage/relational/service/MetalakeMetaService.java: ## @@ -191,6 +192,10 @@ public boolean deleteMetalake(NameIdentifier ide

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
xloya commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796583051 ## core/src/main/java/org/apache/gravitino/storage/relational/service/MetalakeMetaService.java: ## @@ -191,6 +192,10 @@ public boolean deleteMetalake(NameIdentifier ide

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
xloya commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1796577811 ## scripts/mysql/upgrade-0.6.0-to-0.7.0-mysql.sql: ## @@ -0,0 +1,41 @@ +-- +-- Licensed to the Apache Software Foundation (ASF) under one +-- or more contributor licens

Re: [PR] [#5071] Improvement (test): Add integration tests for Trino cascading queries [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5073: URL: https://github.com/apache/gravitino/pull/5073#discussion_r1796556952 ## .github/workflows/trino-integration-test.yml: ## @@ -76,7 +76,7 @@ jobs: - name: Package Gravitino run: | - ./gradlew compileDistributi

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797484945 ## clients/cli/README.md: ## @@ -0,0 +1,140 @@ + + +# Apache Gravitino CLI + +Apache Gravitino CLI is a command-line tool that interacts with the Gravitino serv

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797485394 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797493441 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797524367 ## clients/cli/build.gradle.kts: ## @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements.

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797524621 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or m

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
xloya commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1797525379 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/FileSystemProvider.java: ## @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Software Founda

Re: [PR] [#4951] improvement(test): Reduce fields shares between different IT to make AbstractIT more independent. [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #4996: URL: https://github.com/apache/gravitino/pull/4996#discussion_r1797525238 ## integration-test-common/build.gradle.kts: ## @@ -43,6 +43,8 @@ dependencies { testImplementation(libs.httpclient5) testImplementation(libs.testcontainers)

Re: [PR] [#5094] Fix(catalog-lakehouse-paimon): make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
caican00 commented on code in PR #5095: URL: https://github.com/apache/gravitino/pull/5095#discussion_r1797525769 ## docs/lakehouse-paimon-catalog.md: ## @@ -168,11 +168,16 @@ The Gravitino server doesn't allow passing the following reserved fields. | `comment`

Re: [PR] [#5094] Fix(catalog-lakehouse-paimon): make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
caican00 commented on PR #5095: URL: https://github.com/apache/gravitino/pull/5095#issuecomment-2408295403 > Overal LGTM @FANNG1 please review again, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [#4953] feat(hudi-catalog): add Hudi catalog IT and enable module [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #4965: URL: https://github.com/apache/gravitino/pull/4965#discussion_r1797529512 ## catalogs/catalog-lakehouse-hudi/build.gradle.kts: ## @@ -138,3 +150,60 @@ dependencies { testRuntimeOnly("org.apache.hudi:hudi-spark$sparkVersion-bundle_$sca

[I] [Improvement] We should have a full version list for documents [gravitino]

2024-10-11 Thread via GitHub
JunpingDu opened a new issue, #5108: URL: https://github.com/apache/gravitino/issues/5108 ### What would you like to be improved? Our project's documentation is version specific which is a general case for all open source projects. For users who want to quickly access the specific

(gravitino) 01/01: remove unnecessary changes

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a commit to branch pull/5111/head in repository https://gitbox.apache.org/repos/asf/gravitino.git commit 03bf4e60027e1493b1e0a43e67437b59f213bf55 Author: mchades AuthorDate: Fri Oct 11 19:20:45 2024 +0800 rem

(gravitino) branch pull/5111/head created (now 03bf4e6002)

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a change to branch pull/5111/head in repository https://gitbox.apache.org/repos/asf/gravitino.git at 03bf4e6002 remove unnecessary changes This branch includes the following new commits: new 03bf4e600

(gravitino) branch cherry-pick-branch-0.6-02c2ef0ec547351e4efdc8653eacf2d58d3c43cb updated (d778c0f59 -> 03bf4e600)

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a change to branch cherry-pick-branch-0.6-02c2ef0ec547351e4efdc8653eacf2d58d3c43cb in repository https://gitbox.apache.org/repos/asf/gravitino.git from d778c0f59 [MINOR] fix(docs): change version info from 0.

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796902289 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/HadoopCatalogOperations.java: ## @@ -742,4 +785,44 @@ private boolean checkSingleFile(Fi

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
diqiu50 commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1796841490 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mo

Re: [PR] [#4940] feat(lakehouse-paimon): Support OSS filesystem for Paimon catalog. [gravitino]

2024-10-11 Thread via GitHub
FANNG1 merged PR #4941: URL: https://github.com/apache/gravitino/pull/4941 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravitino

Re: [I] [FEATURE] Support OSS storage for paimon catalog. [gravitino]

2024-10-11 Thread via GitHub
FANNG1 closed issue #4940: [FEATURE] Support OSS storage for paimon catalog. URL: https://github.com/apache/gravitino/issues/4940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [FEATURE] Support OSS storage for paimon catalog. [gravitino]

2024-10-11 Thread via GitHub
FANNG1 closed issue #4940: [FEATURE] Support OSS storage for paimon catalog. URL: https://github.com/apache/gravitino/issues/4940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

(gravitino) branch main updated: [#4940] feat(lakehouse-paimon): Support OSS filesystem for Paimon catalog. (#4941)

2024-10-11 Thread fanng
This is an automated email from the ASF dual-hosted git repository. fanng pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new 0d2435e25 [#4940] feat(lakehouse-paimon): Support

Re: [PR] [#5094] Fix(catalog-lakehouse-paimon): make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
FANNG1 commented on PR #5095: URL: https://github.com/apache/gravitino/pull/5095#issuecomment-2407348939 Overal LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

Re: [PR] [#5094] Fix(catalog-lakehouse-paimon): make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
FANNG1 commented on code in PR #5095: URL: https://github.com/apache/gravitino/pull/5095#discussion_r1796903247 ## docs/lakehouse-paimon-catalog.md: ## @@ -168,11 +168,16 @@ The Gravitino server doesn't allow passing the following reserved fields. | `comment`

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797047448 ## clients/cli/examples.sh: ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797060667 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797049049 ## clients/cli/build.gradle.kts: ## @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreement

Re: [PR] [MINOR] fix(docs): change version info from 0.6.0 to 0.6.0-incubating [gravitino]

2024-10-11 Thread via GitHub
FANNG1 merged PR #5111: URL: https://github.com/apache/gravitino/pull/5111 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravitino

(gravitino) branch branch-0.6 updated: [MINOR] fix(docs): change version info from 0.6.0 to 0.6.0-incubating (#5111)

2024-10-11 Thread fanng
This is an automated email from the ASF dual-hosted git repository. fanng pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new 9298b8f8f [MINOR] fix(docs): change ve

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1796715573 ## clients/cli/build.gradle.kts: ## @@ -0,0 +1,59 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements.

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796854218 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/fs/HDFSFileSystemProvider.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Softw

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796859126 ## clients/filesystem-hadoop3/src/main/java/org/apache/gravitino/filesystem/hadoop/GravitinoVirtualFileSystem.java: ## @@ -385,6 +423,23 @@ private FilesetContextPai

svn commit: r72262 - /dev/incubator/gravitino/v0.6.1-incubating-rc4/

2024-10-11 Thread mchades
Author: mchades Date: Fri Oct 11 12:03:51 2024 New Revision: 72262 Log: Apache Gravitino v0.6.1-incubating-rc4 Added: dev/incubator/gravitino/v0.6.1-incubating-rc4/ dev/incubator/gravitino/v0.6.1-incubating-rc4/gravitino-0.6.1-incubating-bin.tar.gz (with props) dev/incubator/grav

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796864197 ## clients/filesystem-hadoop3/src/main/java/org/apache/gravitino/filesystem/hadoop/GravitinoVirtualFileSystem.java: ## @@ -125,13 +136,33 @@ public void initialize(U

[PR] [#5106] improve(auth-ranger): Filter Catalog securiable object in authorization Ranger [gravitino]

2024-10-11 Thread via GitHub
xunliu opened a new pull request, #5113: URL: https://github.com/apache/gravitino/pull/5113 ### What changes were proposed in this pull request? Filter Catalog securiable object in the authorization Ranger. ### Why are the changes needed? Fix: #5106 ### Does this P

Re: [PR] [#5055] support spark authentication with Gravitino [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5040: URL: https://github.com/apache/gravitino/pull/5040#discussion_r1797001132 ## docs/spark-connector/spark-authentication-with-gravitino.md: ## @@ -0,0 +1,47 @@ +--- +title: "Spark authentication with Gravitino server" +slug: /spark-connector

Re: [I] [Improvement] We should have a full version list for documents [gravitino]

2024-10-11 Thread via GitHub
mchades commented on issue #5108: URL: https://github.com/apache/gravitino/issues/5108#issuecomment-2407484657 we already have the version list in the top left corner of the page, do we still need a separate page to list the historical versions? https://github.com/user-attachments/assets/

Re: [PR] [#4867] feat(core): Add storage support for columns in Gravitino [gravitino]

2024-10-11 Thread via GitHub
jerryshao commented on code in PR #5078: URL: https://github.com/apache/gravitino/pull/5078#discussion_r1797009827 ## core/src/main/java/org/apache/gravitino/storage/relational/service/CatalogMetaService.java: ## @@ -215,6 +215,10 @@ public boolean deleteCatalog(NameIdentifier i

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797021945 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

[PR] [SIP] support pre event [gravitino]

2024-10-11 Thread via GitHub
FANNG1 opened a new pull request, #5110: URL: https://github.com/apache/gravitino/pull/5110 ### What changes were proposed in this pull request? (Please outline the changes and how this PR fixes the issue.) ### Why are the changes needed? (Please clarify why the c

(gravitino) tag v0.6.1-incubating-rc4 created (now d2b42e0f1)

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a change to tag v0.6.1-incubating-rc4 in repository https://gitbox.apache.org/repos/asf/gravitino.git at d2b42e0f1 (commit) This tag includes the following new commits: new d2b42e0f1 Preparing Gravitin

(gravitino) branch branch-0.6 updated (9298b8f8f -> 72bb01fa4)

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a change to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git from 9298b8f8f [MINOR] fix(docs): change version info from 0.6.0 to 0.6.0-incubating (#5111) add d2b42e0f1 Pr

Re: [I] [Improvement] make some table properties from reserved to immutable [gravitino]

2024-10-11 Thread via GitHub
caican00 commented on issue #5094: URL: https://github.com/apache/gravitino/issues/5094#issuecomment-2407246905 > IMO, we could make `merge-engine` , `sequence.field`, `rowkind.field` to immutable, @caican00 WDYT? yes, it is resonable. i will update the related pr. -- This is an au

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796848483 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/FileSystemProvider.java: ## @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Software Fou

(gravitino) 01/01: Preparing Gravitino release v0.6.1-incubating-rc4

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a commit to tag v0.6.1-incubating-rc4 in repository https://gitbox.apache.org/repos/asf/gravitino.git commit d2b42e0f17c86dde2092aef372775ad115e5fafa Author: Minghuang Li AuthorDate: Fri Oct 11 11:51:13 2024 +

(gravitino) 01/01: Preparing development version 0.6.2-incubating-SNAPSHOT

2024-10-11 Thread mchades
This is an automated email from the ASF dual-hosted git repository. mchades pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git commit 72bb01fa4f24c8509e82880d3991835fa5d1e4a8 Author: Minghuang Li AuthorDate: Fri Oct 11 11:51:13 2024 + Pr

Re: [PR] [#5019] feat: (hadoop-catalog): Add a framework to support multi-storage in a pluginized manner for fileset catalog [gravitino]

2024-10-11 Thread via GitHub
yuqi1129 commented on code in PR #5020: URL: https://github.com/apache/gravitino/pull/5020#discussion_r1796854218 ## catalogs/catalog-hadoop/src/main/java/org/apache/gravitino/catalog/hadoop/fs/HDFSFileSystemProvider.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Softw

Re: [PR] [#5057] Added first part of CLI code [gravitino]

2024-10-11 Thread via GitHub
justinmclean commented on code in PR #5058: URL: https://github.com/apache/gravitino/pull/5058#discussion_r1797025808 ## clients/cli/src/main/java/org/apache/gravitino/cli/FullName.java: ## @@ -0,0 +1,123 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + *

[I] [Improvement] use incubating version in docs [gravitino]

2024-10-11 Thread via GitHub
mchades opened a new issue, #5114: URL: https://github.com/apache/gravitino/issues/5114 ### What would you like to be improved? Gravitino has become an Apache Incubator project since version 0.6.0, so it is necessary to follow the Apache versioning convention like `0.6.0-incubating`

  1   2   >