An error in the integration of Kyuubi, Gravitino, and Iceberg.

[shashihoushengqia]

When I started Spark using kyuubi and then connected to it through DataGrip and DBeaver, I encountered an error.

Error operating GetSchemas: java.lang.IllegalArgumentException: Doesn't support listing namespaces with db_dev
at org.apache.gravitino.shaded.com.google.common.base.Preconditions.checkArgument(Preconditions.java:143)
at org.apache.gravitino.spark.connector.catalog.BaseCatalog.listNamespaces(BaseCatalog.java:346)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.$anonfun$listAllNamespaces$1(SparkCatalogUtils.scala:113)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.$anonfun$listAllNamespaces$1$adapted(SparkCatalogUtils.scala:112)
at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:293)
at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36)
at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:198)
at scala.collection.TraversableLike.flatMap(TraversableLike.scala:293)
at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:290)
at scala.collection.mutable.ArrayOps$ofRef.flatMap(ArrayOps.scala:198)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.listAllNamespaces(SparkCatalogUtils.scala:112)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.listAllNamespaces(SparkCatalogUtils.scala:129)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.getSchemasWithPattern(SparkCatalogUtils.scala:145)
at org.apache.kyuubi.engine.spark.util.SparkCatalogUtils$.getSchemas(SparkCatalogUtils.scala:98)
at org.apache.kyuubi.engine.spark.operation.GetSchemas.runInternal(GetSchemas.scala:43)
at org.apache.kyuubi.operation.AbstractOperation.run(AbstractOperation.scala:185)
at org.apache.kyuubi.session.AbstractSession.runOperation(AbstractSession.scala:104)
at org.apache.kyuubi.engine.spark.session.SparkSessionImpl.runOperation(SparkSessionImpl.scala:109)
at org.apache.kyuubi.session.AbstractSession.getSchemas(AbstractSession.scala:155)
at org.apache.kyuubi.service.AbstractBackendService.getSchemas(AbstractBackendService.scala:83)
at org.apache.kyuubi.service.TFrontendService.GetSchemas(TFrontendService.scala:307)
at org.apache.kyuubi.shaded.hive.service.rpc.thrift.TCLIService$Processor$GetSchemas.getResult(TCLIService.java:1745)
at org.apache.kyuubi.shaded.hive.service.rpc.thrift.TCLIService$Processor$GetSchemas.getResult(TCLIService.java:1725)
at org.apache.kyuubi.shaded.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.kyuubi.shaded.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:35)
at org.apache.kyuubi.shaded.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:250)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829).

This would cause both DataGrip and DBeaver to fail to display the database name of Iceberg properly. However, when I used SQL commands such as "show catalogs", "show databases", "show namespaces", and "show tables", everything worked normally and I was also able to query the data within the tables normally.I'm not sure whether this is a problem with gravitino or with kyuubi.

[shashihoushengqia]

I was assigned the catalog for the gravitino iceberg rest catalog through the dynamic-config-provider.My settings in gravitino are as follows：

[roryqi]

@FANNG1 Could u reply this question?

[FANNG1]

Do you have a nested namespace in your environment? It seems you are listing namespaces under db_dev. Currently, Gravitino does not support nested namespaces.

[shashihoushengqia]

Do you have a nested namespace in your environment? It seems you are listing namespaces under db_dev. Currently, Gravitino does not support nested namespaces.

"catalog" is "iceberg_catalog_yizhihangmu", "database" is "db_dev", and "table" is "tab_test01". There should be no nested namespaces. Additionally, I previously used "Static catalog configuration provider", and this issue did not occur. Both Datagrip and DBeaver can display the database name normally.

[shashihoushengqia]

Do you have a nested namespace in your environment? It seems you are listing namespaces under db_dev. Currently, Gravitino does not support nested namespaces.

This is the normal situation when I use the "Static Catalog Configuration Provider".

[FANNG1]

Be curious why calling of the listing namespaces API is under db_dev?

[shashihoushengqia]

Be curious why calling of the listing namespaces API is under db_dev?

I've identified the problem. It's a configuration error.