创建Hive表会自动更改mysql Metastore的charset设置

sca*_*cer 2 mysql meta integration hadoop hive

我配置Hive使用mysql Metastore.它工作正常.

但是当我试图放下一张桌子时,我会收到如下错误.

FAILED: Error in metadata: javax.jdo.JDODataStoreException: Error(s) were found while auto-creating/validating the datastore for classes. The errors are printed in the log, and are attached to this exception.
NestedThrowables:
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
Run Code Online (Sandbox Code Playgroud)

我做了一些研究,谷歌和官方faq告诉我,更改mysql字符集设置将解决这个问题.

我的mysql设置如下

mysql> show variables like '%char%';
+--------------------------+----------------------------------------+
| Variable_name            | Value                                  |
+--------------------------+----------------------------------------+
| character_set_client     | utf8                                   |
| character_set_connection | utf8                                   |
| character_set_database   | utf8                                   |
| character_set_filesystem | binary                                 |
| character_set_results    | utf8                                   |
| character_set_server     | utf8                                   |
| character_set_system     | utf8                                   |
| character_sets_dir       | /usr/local/mysql/share/mysql/charsets/ |
+--------------------------+----------------------------------------+
8 rows in set (0.02 sec)
Run Code Online (Sandbox Code Playgroud)

我改变了所有的字符集设置从utf8latin1,除了character_set_filesystem,character_set_system,character_sets_dir.

即使这样做,当我尝试删除表时仍然会遇到相同的错误.更糟糕的是,每当我创建一个新表时,mysql字符集设置将被重置为utf-8.

有人可以帮忙吗?

小智 5

问题是在hive-site.xml中它在下面的创建'hive'中使用了另一个数据库

 <property>
 <name>javax.jdo.option.ConnectionURL</name>
 <value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true</value>
 </property>
Run Code Online (Sandbox Code Playgroud)

将数据库名称更改为您已经在mysql中创建的'metastore',就像这样

<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://localhost:3306/metastore?createDatabaseIfNotExist=true</value>
</property>
Run Code Online (Sandbox Code Playgroud)

希望这可以解决我遇到同样问题的问题,我就这样修好了.朋友马图克