Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

org.apache.hudi.exception.HoodieException: Error checking Hoodie partition metadata for hdfs://controlnode-205.edp:8020/user/hive/warehouse/hudi_cow/partitionId=2021/01/02 #313

Open
turtoise opened this issue Mar 10, 2022 · 0 comments

Comments

@turtoise
Copy link

Software Environment:

  • OpenLooKeng version (source or binary):
    1.5.0
  • OS platform & distribution (eg., Linux Ubuntu 16.04):
    CentOS Linux release 7.9.2009 (Core)
  • Java version: jdk 1.8.0_312
  • Hudi version: 0.10
  • Hive version: HDP 3.1.0
  • Hadoop version: HDP 3.1.1
  • kerberos version: 1.10.3-30

Describe the current behavior

my environment is hive with kerberos. I already integrate hive with hudi,also i integrate Hetu with hive and hudi. However, i can select hive tables and hudi tables in hive beeline command. Also,I can select hive tables in Hetu,but when i select hudi tables ,it reports below errors like this:
org.apache.hudi.exception.HoodieException: Error checking Hoodie partition metadata for hdfs://controlnode-205.edp:8020/user/hive/warehouse/hudi_cow/partitionId=2021/01/02

Describe the expected behavior

I want to expected to select hudi tables in Hetu web.

Steps to reproduce the issue

1.First, integrate hive with hudi. Write a hudi table to hive database.
2.Second, configure hive datasorce with Hetu. My hive.properties like this:

connector.name=hive-hadoop2
hive.metastore.uri=thrift://controlnode-205.edp:9083
hive.config.resources=/etc/hadoop/conf/core-site.xml,/etc/hadoop/conf/hdfs-site.xml
hive.metastore.authentication.type=KERBEROS

hive.metastore.service.principal=hive/controlnode-205.edp@EVECOM.NET
hive.metastore.client.principal=hive/controlnode-205.edp@EVECOM.NET
hive.metastore.client.keytab=/etc/security/keytab/hive.service.keytab
hive.metastore.krb5.conf.path=/etc/krb5.conf

hive.hdfs.authentication.type=KERBEROS
hive.hdfs.impersonation.enabled=false
hive.hdfs.wire-encryption.enabled=true
hive.collect-column-statistics-on-write=true

hive.hdfs.presto.principal=hive/controlnode-205.edp@EVECOM.NET
hive.hdfs.presto.keytab=/etc/security/keytab/hive.service.keytab
hive.allow-drop-table=true

3.Third , integrate Hetu with hudi plugin according to the official document:
https://openlookeng.io/zh-cn/docs/docs/connector/hudi.html

4.After all above, I can only select hive tables in Hetu, but for hudi tables in hive database it reports errors.

Related log/screenshots

image
image

image

Special notes for this issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant