Re: [PR] [#4959] feat(Iceberg): support Iceberg REST extend API [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on PR #4987: URL: https://github.com/apache/gravitino/pull/4987#issuecomment-2372623460 > @FANNG1 Thanks for sharing this. I am curious in this PR, how can users access `icebergCatalogWrapperManager` instance if user plugin their API into IRC? 1. `IcebergCatalogWrap

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
jun-ma commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1774303874 ## docs/manage-metalake-using-gravitino.md: ## @@ -136,9 +133,6 @@ GravitinoMetalake renamed = gravitinoAdminClient.alterMetalake( ```python changes = ( Metala

Re: [I] [Bug report] CI: clients:client-java:test run timeout in some jobs ( Cron Integration Test 20240917) [gravitino]

2024-09-24 Thread via GitHub
mchades commented on issue #4949: URL: https://github.com/apache/gravitino/issues/4949#issuecomment-2372741458 I suggest increasing the timeout period first. The current information cannot determine the specific cause of failure, and increasing the timeout period will help further ju

Re: [PR] [#4962] feat(trino-connector): Support the Trino cascading connector [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4935: URL: https://github.com/apache/gravitino/pull/4935#discussion_r1774296293 ## docs/trino-connector/trino-cascading-query.md: ## @@ -0,0 +1,162 @@ +--- +title: "Apache Gravitino connector Trino cascading query" +slug: /trino-connector/trino-

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
jun-ma commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1774296728 ## docs/manage-metalake-using-gravitino.md: ## @@ -107,15 +109,10 @@ curl -X PUT -H "Accept: application/vnd.gravitino.v1+json" \ "updates": [ { "@type

Re: [PR] [#5010] Add LICENSE and NOTICE files for Iceberg REST binary [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on PR #5011: URL: https://github.com/apache/gravitino/pull/5011#issuecomment-2372718952 @justinmclean thanks for your work, do you mind copy the LICENCE and NOTICE files to the Iceberg REST package in https://github.com/apache/gravitino/blob/main/build.gradle.kts#L624-

Re: [PR] [#4962] feat(trino-connector): Support the Trino cascading connector [gravitino]

2024-09-24 Thread via GitHub
mchades commented on code in PR #4935: URL: https://github.com/apache/gravitino/pull/4935#discussion_r1774308980 ## docs/trino-connector/trino-cascading-query.md: ## @@ -0,0 +1,162 @@ +--- +title: "Apache Gravitino connector Trino cascading query" +slug: /trino-connector/trino-c

Re: [PR] [#4545] improvement(paimon-catalog): reduce catalog-lakehouse-paimon libs size from 222MB to 75MB [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on PR #4547: URL: https://github.com/apache/gravitino/pull/4547#issuecomment-2372754832 > > Also, why do we need hdfs jar? I assume the hdfs client jar should be enough. > > Kerberos relies on the default HDFS configuration, removing hdfs jar may cause Kerberos ope

[PR] [TEST]Improvement(docs): Add docs for Trino cascading query [gravitino]

2024-09-24 Thread via GitHub
diqiu50 opened a new pull request, #5012: URL: https://github.com/apache/gravitino/pull/5012 ### What changes were proposed in this pull request? Add docs for Trino cascading query ### Why are the changes needed? Fix: # (issue) ### Does this PR introduce _any_ user

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
jun-ma commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1774318675 ## docs/manage-metalake-using-gravitino.md: ## @@ -136,9 +133,6 @@ GravitinoMetalake renamed = gravitinoAdminClient.alterMetalake( ```python changes = ( Metala

Re: [PR] [#4962] feat(trino-connector): Support the Trino cascading connector [gravitino]

2024-09-24 Thread via GitHub
mchades commented on code in PR #4935: URL: https://github.com/apache/gravitino/pull/4935#discussion_r1774320926 ## trino-connector/trino-connector/src/main/java/org/apache/gravitino/trino/connector/catalog/DefaultCatalogConnectorFactory.java: ## @@ -35,25 +36,49 @@ public clas

Re: [PR] [#4984] improvement(core, doris): Add the random distribution strategy [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4985: URL: https://github.com/apache/gravitino/pull/4985#discussion_r1774324507 ## api/src/main/java/org/apache/gravitino/rel/expressions/distributions/Strategy.java: ## @@ -50,7 +50,10 @@ public enum Strategy { RANGE, /** Distributes da

[PR] feat(oceanbase-catalog): Support schema operations for OceanBase JDBC catalog. [gravitino]

2024-09-24 Thread via GitHub
yuanoOo opened a new pull request, #5013: URL: https://github.com/apache/gravitino/pull/5013 ### What changes were proposed in this pull request? - Support schema operations for OceanBase JDBC catalog. - Add OceanBaseContainer to test schema operations. ### Why are th

Re: [PR] feat(oceanbase-catalog): Support schema operations for OceanBase JDBC catalog. [gravitino]

2024-09-24 Thread via GitHub
yuanoOo commented on PR #5013: URL: https://github.com/apache/gravitino/pull/5013#issuecomment-2372771659 @mchades PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [#5008] improve(core): reorganize the sql provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
jerryshao opened a new pull request, #5009: URL: https://github.com/apache/gravitino/pull/5009 ### What changes were proposed in this pull request? This PR adjust and add some package for SQL provider to make the code more separately and clear. ### Why are the changes needed?

[PR] [#4868][0.6] improvement(core): Modify tag and user related mapper class to use the new framework to support multiple JDBC backend. (#4869) [gravitino]

2024-09-24 Thread via GitHub
jerqi opened a new pull request, #5001: URL: https://github.com/apache/gravitino/pull/5001 ### What changes were proposed in this pull request? Change tag, user, and role-related code to support the new framework introduced by #4832 ### Why are the changes needed? To sup

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772960525 ## core/src/main/java/org/apache/gravitino/audit/AuditLogWriter.java: ## @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mor

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772980833 ## .github/workflows/python-integration-test.yml: ## @@ -48,7 +48,7 @@ jobs: needs: changes if: needs.changes.outputs.source_changes == 'true' runs-on:

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772988398 ## authorizations/authorization-ranger/build.gradle.kts: ## @@ -57,36 +61,26 @@ dependencies { exclude("net.java.dev.jna") exclude("javax.ws.rs") exclud

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772988398 ## authorizations/authorization-ranger/build.gradle.kts: ## @@ -57,36 +61,26 @@ dependencies { exclude("net.java.dev.jna") exclude("javax.ws.rs") exclud

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772988398 ## authorizations/authorization-ranger/build.gradle.kts: ## @@ -57,36 +61,26 @@ dependencies { exclude("net.java.dev.jna") exclude("javax.ws.rs") exclud

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772996496 ## authorizations/authorization-ranger/src/test/java/org/apache/gravitino/authorization/ranger/integration/test/RangerHiveE2EIT.java: ## @@ -77,63 +76,195 @@ public cl

(gravitino) branch main updated: [#5008] improve(core): reorganize the sql provider package to make it more clear (#5009)

2024-09-24 Thread yuqi4733
This is an automated email from the ASF dual-hosted git repository. yuqi4733 pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new 1f9895633 [#5008] improve(core): reorganize the

Re: [PR] [#5008] improve(core): reorganize the sql provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 merged PR #5009: URL: https://github.com/apache/gravitino/pull/5009 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@graviti

Re: [I] [Improvement] Reorganize the SQL provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 closed issue #5008: [Improvement] Reorganize the SQL provider package to make it more clear URL: https://github.com/apache/gravitino/issues/5008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] [Improvement] Reorganize the SQL provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 closed issue #5008: [Improvement] Reorganize the SQL provider package to make it more clear URL: https://github.com/apache/gravitino/issues/5008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [#4984] improvement(core, doris): Add the random distribution strategy [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4985: URL: https://github.com/apache/gravitino/pull/4985#discussion_r1774364299 ## api/src/main/java/org/apache/gravitino/rel/expressions/distributions/Strategy.java: ## @@ -50,7 +50,10 @@ public enum Strategy { RANGE, /** Distributes da

[I] [FEATURE] adding support for aliyun Maxcompute(aka. ODPS) catalog [gravitino]

2024-09-24 Thread via GitHub
haitaoyao opened a new issue, #5014: URL: https://github.com/apache/gravitino/issues/5014 ### Describe the feature Add support for MaxCompute catalogs ### Motivation Since Aliyun(aka. Alicloud) is very popular in China, Maxcompute, which is a in-house cloud datawarehouse

Re: [PR] [#4545] improvement(paimon-catalog): reduce catalog-lakehouse-paimon libs size from 222MB to 75MB [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on PR #4547: URL: https://github.com/apache/gravitino/pull/4547#issuecomment-2372853670 > > > Also, why do we need hdfs jar? I assume the hdfs client jar should be enough. > > > > > > Kerberos relies on the default HDFS configuration, removing hdfs jar may caus

Re: [PR] [#4545] improvement(paimon-catalog): reduce catalog-lakehouse-paimon libs size from 222MB to 75MB [gravitino]

2024-09-24 Thread via GitHub
caican00 commented on PR #4547: URL: https://github.com/apache/gravitino/pull/4547#issuecomment-2372857636 > > > Why the paimon format jar is so big, is it correct? > > > > > > Paimon format jar packages the dependences in the jar, @caican00 do you know any other alternative jars?

Re: [PR] [#4959] feat(Iceberg): support Iceberg REST extend API [gravitino]

2024-09-24 Thread via GitHub
puchengy commented on PR #4987: URL: https://github.com/apache/gravitino/pull/4987#issuecomment-2372492708 @FANNG1 Thanks for sharing this. I am curious in this PR, how can users access `icebergCatalogWrapperManager` instance if user plugin their API into IRC? -- This is an automated mes

Re: [PR] [#4661] improvement(iceberg-rest): Adding License and Notice to the i… [gravitino]

2024-09-24 Thread via GitHub
justinmclean commented on PR #4909: URL: https://github.com/apache/gravitino/pull/4909#issuecomment-2372691576 See #5011 for the LICENSE and NOTICE files -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] [#5008] improve(core): reorganize the sql provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
jerryshao opened a new pull request, #5015: URL: https://github.com/apache/gravitino/pull/5015 ### What changes were proposed in this pull request? This PR adjusts and adds some packages for SQL provider to make the code more separately and clear. ### Why are the changes needed

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2371029293 > @mchades > > > I am confused about why it worked before without needing an explicit call? > > Because the module after the shadow, there is no longer this file structur

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1773189087 ## clients/client-java/src/main/java/org/apache/gravitino/client/GenericRole.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
xunliu commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1773302725 ## core/src/main/java/org/apache/gravitino/storage/relational/database/H2Database.java: ## @@ -54,6 +54,12 @@ public String startH2Database(Config config) { Str

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1772861356 ## docs/manage-metalake-using-gravitino.md: ## @@ -107,15 +109,10 @@ curl -X PUT -H "Accept: application/vnd.gravitino.v1+json" \ "updates": [ { "@t

Re: [PR] [#4868] improvement(core): Modify tag and user related mapper class to use the new framework to support multiple JDBC backend. [gravitino]

2024-09-24 Thread via GitHub
jerryshao merged PR #5001: URL: https://github.com/apache/gravitino/pull/5001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on PR #4997: URL: https://github.com/apache/gravitino/pull/4997#issuecomment-2370946021 @shaofengshi , do you want to take another look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
xunliu commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1773122955 ## integration-test-common/src/test/java/org/apache/gravitino/integration/test/container/RangerContainer.java: ## @@ -38,7 +38,7 @@ public class RangerContainer extend

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
xunliu commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2371046591 > @xunliu need answer. Because Jetty server default load https://github.com/jetty/jetty.project/blob/jetty-12.0.x/jetty-core/jetty-deploy/src/test/resources/etc/webdefault.xml#L37,

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
shaofengshi commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1773191237 ## docs/manage-metalake-using-gravitino.md: ## @@ -107,15 +109,10 @@ curl -X PUT -H "Accept: application/vnd.gravitino.v1+json" \ "updates": [ { "

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
shaofengshi commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1773198517 ## docs/manage-metalake-using-gravitino.md: ## @@ -136,9 +133,6 @@ GravitinoMetalake renamed = gravitinoAdminClient.alterMetalake( ```python changes = ( M

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
shaofengshi commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1773199300 ## docs/manage-metalake-using-gravitino.md: ## @@ -136,9 +133,6 @@ GravitinoMetalake renamed = gravitinoAdminClient.alterMetalake( ```python changes = ( M

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
shaofengshi commented on PR #4997: URL: https://github.com/apache/gravitino/pull/4997#issuecomment-2371062385 > @shaofengshi , do you want to take another look? Cool, thanks jun for the PR! @jun-ma -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1772980454 ## clients/client-java/src/main/java/org/apache/gravitino/client/GenericRole.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

Re: [PR] [#3348] feat(core,server): Add the list operation of the user [gravitino]

2024-09-24 Thread via GitHub
jerryshao merged PR #5004: URL: https://github.com/apache/gravitino/pull/5004 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

(gravitino) branch branch-0.6 updated: [#3348] feat(core,server): Add the list operation of the user (#5004)

2024-09-24 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new 98aab197a [#3348] feat(core,server): A

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1773008723 ## core/src/main/java/org/apache/gravitino/storage/relational/database/H2Database.java: ## @@ -54,6 +54,12 @@ public String startH2Database(Config config) { Str

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2370799049 I'm afraid the current shade implement seems to lead some unexpected behavior, makes the test class more complicated. -- This is an automated message from the Apache Git Service. To r

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1773019387 ## core/src/main/java/org/apache/gravitino/audit/AuditLogConfig.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerqi commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1773022484 ## api/src/main/java/org/apache/gravitino/authorization/Role.java: ## @@ -53,4 +52,13 @@ public interface Role extends Auditable { * @return The securable objects o

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerqi commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1773023679 ## clients/client-java/src/main/java/org/apache/gravitino/client/GenericRole.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2370807652 BTW, I prefer to drop the support for MiniGravitino to avoid to struggle for the class conflict related problems. @mchades @yuqi1129 @xunliu WDYT? -- This is an automated message from

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerqi commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1773027953 ## common/src/main/java/org/apache/gravitino/dto/authorization/RoleDTO.java: ## @@ -43,9 +44,13 @@ public class RoleDTO implements Role { @JsonProperty("properties")

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1773001932 ## authorizations/authorization-ranger/src/test/java/org/apache/gravitino/authorization/ranger/integration/test/RangerHiveE2EIT.java: ## @@ -77,63 +76,195 @@ public cl

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerqi commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1773030140 ## clients/client-java/src/main/java/org/apache/gravitino/client/GenericRole.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
mchades commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2370818659 > BTW, I prefer to drop the support for MiniGravitino to avoid to struggle for the class conflict related problems. @mchades @yuqi1129 @xunliu WDYT? Do you mean to remove the embe

Re: [PR] fix: support check for `docker compose` [gravitino-playground]

2024-09-24 Thread via GitHub
kahnwong commented on PR #79: URL: https://github.com/apache/gravitino-playground/pull/79#issuecomment-2370822764 forgot to update the actual compose command, will create a commit for it -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerqi commented on code in PR #4894: URL: https://github.com/apache/gravitino/pull/4894#discussion_r1773030140 ## clients/client-java/src/main/java/org/apache/gravitino/client/GenericRole.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772694796 ## core/src/main/java/org/apache/gravitino/storage/relational/database/H2Database.java: ## @@ -54,6 +54,12 @@ public String startH2Database(Config config) { S

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772694796 ## core/src/main/java/org/apache/gravitino/storage/relational/database/H2Database.java: ## @@ -54,6 +54,12 @@ public String startH2Database(Config config) { S

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772694796 ## core/src/main/java/org/apache/gravitino/storage/relational/database/H2Database.java: ## @@ -54,6 +54,12 @@ public String startH2Database(Config config) { S

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on code in PR #4948: URL: https://github.com/apache/gravitino/pull/4948#discussion_r1772694796 ## core/src/main/java/org/apache/gravitino/storage/relational/database/H2Database.java: ## @@ -54,6 +54,12 @@ public String startH2Database(Config config) { S

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2370842614 > Do you mean to remove the embedded tests? Yes, MiniGravitino provides the facilities to debug easily, but leading complicated class conflict problems, it takes much more time to

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1773054315 ## core/src/main/java/org/apache/gravitino/audit/AuditLogConfig.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1773054315 ## core/src/main/java/org/apache/gravitino/audit/AuditLogConfig.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or

[PR] [MINOR] docs(core): fix iceberg event listener configuration [gravitino]

2024-09-24 Thread via GitHub
FANNG1 opened a new pull request, #5003: URL: https://github.com/apache/gravitino/pull/5003 ### What changes were proposed in this pull request? ### Why are the changes needed? (Please clarify why the changes are needed. For instance, 1. If you propose a new API, clarif

(gravitino) branch main updated: [MINOR] docs(core): fix iceberg event listener configuration (#5003)

2024-09-24 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/main by this push: new a89fe9250 [MINOR] docs(core): fix iceberg event li

(gravitino) branch cherry-pick-branch-0.6-a89fe92506221d2d2f7a90c2c8681befdca074e7 created (now c2e6f40aa)

2024-09-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch cherry-pick-branch-0.6-a89fe92506221d2d2f7a90c2c8681befdca074e7 in repository https://gitbox.apache.org/repos/asf/gravitino.git at c2e6f40aa [MINOR] docs(core): fix iceberg event liste

[PR] [MINOR] docs(core): fix iceberg event listener configuration [gravitino]

2024-09-24 Thread via GitHub
github-actions[bot] opened a new pull request, #5007: URL: https://github.com/apache/gravitino/pull/5007 ### What changes were proposed in this pull request? correct `gravitino.eventListener.{name}.className` to `gravitino.eventListener.{name}.class` ### Why are the changes nee

Re: [PR] [MINOR] docs(core): fix iceberg event listener configuration [gravitino]

2024-09-24 Thread via GitHub
jerryshao merged PR #5003: URL: https://github.com/apache/gravitino/pull/5003 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

Re: [PR] [MINOR] docs(core): fix iceberg event listener configuration [gravitino]

2024-09-24 Thread via GitHub
jerryshao closed pull request #5007: [MINOR] docs(core): fix iceberg event listener configuration URL: https://github.com/apache/gravitino/pull/5007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] [#4545] improvement(paimon-catalog): reduce catalog-lakehouse-paimon libs size from 222MB to 75MB [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on PR #4547: URL: https://github.com/apache/gravitino/pull/4547#issuecomment-2370968832 > > Why the paimon format jar is so big, is it correct? > > Paimon format jar packages the dependences in the jar, @caican00 do you know any other alternative jars? @caic

(gravitino) branch cherry-pick-branch-0.6-a89fe92506221d2d2f7a90c2c8681befdca074e7 deleted (was c2e6f40aa)

2024-09-24 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a change to branch cherry-pick-branch-0.6-a89fe92506221d2d2f7a90c2c8681befdca074e7 in repository https://gitbox.apache.org/repos/asf/gravitino.git was c2e6f40aa [MINOR] docs(core): fix iceberg event listener c

(gravitino) branch branch-0.6 updated: [MINOR] docs(core): fix iceberg event listener configuration (#5007)

2024-09-24 Thread jshao
This is an automated email from the ASF dual-hosted git repository. jshao pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new b30aa2b78 [MINOR] docs(core): fix iceb

Re: [PR] [MINOR] docs(core): fix iceberg event listener configuration [gravitino]

2024-09-24 Thread via GitHub
jerryshao merged PR #5007: URL: https://github.com/apache/gravitino/pull/5007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravit

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
xunliu commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2370989769 > > Do you mean to remove the embedded tests? > > Yes, MiniGravitino provides the facilities to debug easily, but leading complicated class conflict problems, it takes much more ti

Re: [PR] [#4832] feat(core): Add basic framework to support multiple JDBC backend [gravitino]

2024-09-24 Thread via GitHub
diqiu50 merged PR #4998: URL: https://github.com/apache/gravitino/pull/4998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gravitin

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772936186 ## core/src/main/java/org/apache/gravitino/audit/AuditLogConfig.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mor

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772941030 ## core/src/main/java/org/apache/gravitino/audit/AuditLogManager.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or m

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772941793 ## core/src/main/java/org/apache/gravitino/audit/AuditLogManager.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or m

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772950327 ## core/src/main/java/org/apache/gravitino/audit/AuditLogManager.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or m

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772950327 ## core/src/main/java/org/apache/gravitino/audit/AuditLogManager.java: ## @@ -0,0 +1,114 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or m

Re: [PR] [#3973] improvement(core):support audit log [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4575: URL: https://github.com/apache/gravitino/pull/4575#discussion_r1772960525 ## core/src/main/java/org/apache/gravitino/audit/AuditLogWriter.java: ## @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mor

Re: [PR] [#5008] improve(core): reorganize the sql provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 commented on PR #5009: URL: https://github.com/apache/gravitino/pull/5009#issuecomment-2371520220 LGTM, @jerqi Would you like to take another look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] [Improvement] Make property `cloud.name` and `cloud.region-code` mutable [gravitino]

2024-09-24 Thread via GitHub
LindaSummer commented on issue #4999: URL: https://github.com/apache/gravitino/issues/4999#issuecomment-2371521852 Hi @mchades , Sorry to bother you. I'm not sure related test case should be put in which test class. Could you give me some advice? Best Regards, E

Re: [PR] [#4759] feat(auth-ranger): Use Spark verify Ranger authorization Hive [gravitino]

2024-09-24 Thread via GitHub
xunliu commented on PR #4948: URL: https://github.com/apache/gravitino/pull/4948#issuecomment-2371333284 @FANNG1 @mchades @yuqi1129 I improved this PR based on your suggestion, Please help me review it again, Thanks. -- This is an automated message from the Apache Git Service. To respond

(gravitino) branch branch-0.6 updated: [#5008] improve(core): reorganize the sql provider package to make it more clear (#5015)

2024-09-24 Thread yuqi4733
This is an automated email from the ASF dual-hosted git repository. yuqi4733 pushed a commit to branch branch-0.6 in repository https://gitbox.apache.org/repos/asf/gravitino.git The following commit(s) were added to refs/heads/branch-0.6 by this push: new eb24835ff [#5008] improve(core): re

Re: [PR] [#5008] improve(core): reorganize the sql provider package to make it more clear [gravitino]

2024-09-24 Thread via GitHub
yuqi1129 merged PR #5015: URL: https://github.com/apache/gravitino/pull/5015 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@graviti

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
diqiu50 commented on code in PR #4925: URL: https://github.com/apache/gravitino/pull/4925#discussion_r1774594485 ## trino-connector/trino-connector/src/main/java/org/apache/gravitino/trino/connector/catalog/iceberg/IcebergMetadataAdapter.java: ## @@ -126,20 +120,12 @@ public Gra

Re: [PR] feat(oceanbase-catalog): Support schema operations for OceanBase JDBC catalog. [gravitino]

2024-09-24 Thread via GitHub
yuanoOo commented on code in PR #5013: URL: https://github.com/apache/gravitino/pull/5013#discussion_r1774596264 ## integration-test-common/src/test/java/org/apache/gravitino/integration/test/container/OceanBaseContainer.java: ## @@ -0,0 +1,160 @@ +/* + * Licensed to the Apache

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
diqiu50 commented on code in PR #4925: URL: https://github.com/apache/gravitino/pull/4925#discussion_r1774599971 ## trino-connector/trino-connector/src/main/java/org/apache/gravitino/trino/connector/catalog/iceberg/ExpressionUtil.java: ## @@ -0,0 +1,308 @@ +/* + * Licensed to th

Re: [PR] [#3346] feat(core,server): Supports to list roles operations [gravitino]

2024-09-24 Thread via GitHub
jerqi commented on PR #4894: URL: https://github.com/apache/gravitino/pull/4894#issuecomment-2372885355 @xunliu @jerqi `List role operation` only supports to list role names. Otherwise, it will have poor performance if we fetch objects, or it will be inconsistent with other interfaces if w

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
diqiu50 commented on code in PR #4925: URL: https://github.com/apache/gravitino/pull/4925#discussion_r1774575919 ## trino-connector/integration-test/build.gradle.kts: ## @@ -70,17 +70,24 @@ dependencies { testRuntimeOnly(libs.junit.jupiter.engine) } +tasks.register("setupD

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
diqiu50 commented on code in PR #4925: URL: https://github.com/apache/gravitino/pull/4925#discussion_r1774579129 ## trino-connector/integration-test/src/test/resources/trino-ci-testset/testsets/lakehouse-iceberg/5_partition_sort_order.sql: ## @@ -0,0 +1,63 @@ +CREATE SCHEMA

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
diqiu50 commented on code in PR #4925: URL: https://github.com/apache/gravitino/pull/4925#discussion_r1774579129 ## trino-connector/integration-test/src/test/resources/trino-ci-testset/testsets/lakehouse-iceberg/5_partition_sort_order.sql: ## @@ -0,0 +1,63 @@ +CREATE SCHEMA

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on code in PR #4925: URL: https://github.com/apache/gravitino/pull/4925#discussion_r1772898568 ## trino-connector/trino-connector/src/main/java/org/apache/gravitino/trino/connector/catalog/iceberg/IcebergMetadataAdapter.java: ## @@ -126,20 +120,12 @@ public Grav

Re: [PR] [#4757]feat(trino-connector): Support more partition and sort order features of the Iceberg catalog [gravitino]

2024-09-24 Thread via GitHub
FANNG1 commented on PR #4925: URL: https://github.com/apache/gravitino/pull/4925#issuecomment-2370630576 @yuqi1129 , do you have time to review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] [MINOR] improve(doc): Straight-forward improvements [gravitino]

2024-09-24 Thread via GitHub
jerryshao commented on code in PR #4997: URL: https://github.com/apache/gravitino/pull/4997#discussion_r1772907677 ## docs/manage-metalake-using-gravitino.md: ## @@ -107,15 +109,10 @@ curl -X PUT -H "Accept: application/vnd.gravitino.v1+json" \ "updates": [ { "@t

  1   2   >