所有查询的Hive错误:找不到与操作句柄关联的日志

Question

在Hadoop上运行的所有配置单元查询都出错.

只需从存在的表中运行select语句并获得以下结果:

Fetching results ran into the following error(s):

Couldn't find log associated with operation handle: 
OperationHandle[opType=EXECUTE_STATEMENT,
getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]

查询的伴随日志是:

请求TFetchResultsReq的错误状态(fetchType = 1,operationHandle = TOperationHandle(hasResultSet = False,modifiedRowCount = None,operationType = 0,operationId = THandleIdentifier(secret ='%\ x1d\x0f\x11\xce\xf4B\xd6\xb8\xb5\x8ddv\xceKV',guid ="\ xbc5\xd9 |\xfa\x13J'\ x86\x8e4\xb3\x87\xa0\xf4\x05")),orientation = 4,maxRows = -1):TFetchResultsResp(status = TStatus(errorCode = 0,errorMessage ="找不到与操作句柄关联的日志:OperationHandle [opType = EXECUTE_STATEMENT,getHandleIdentifier()= bc35d97c-fa13-4a27-868e-34b387a0f405]",sqlState = None,infoMessages = ["*org.apache.hive.service.cli.HiveSQLException:找不到与操作句柄关联的日志:OperationHandle [opType = EXECUTE_STATEMENT,getHandleIdentifier()= bc35d97c-fa13-4a27-868e-34b387a0f405]:25:24",'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257','org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656','sun .reflect.GeneratedMethodAccessor29:invoke :: - 1','sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43','java.lang.reflect.Method:invoke:Method.java:606','org.apache .hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:79','org.apache.hive.service.cli.session.HiveSessionProxy:access $ 000:HiveSessionProxy.java:37','org.apache. hive.service.cli.session.HiveSessionProxy $ 1:run:HiveSessionProxy.java:64','java.security.AccessController:doPrivileged:AccessController.java:-2','javax.security.auth.Subject:doAs:Subject.java:415','org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1628','org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536',' org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:60','com.sun.proxy.$ Proxy28:fetchResults :: - 1','org.apache.hive.service.cli .CLIService:fetchResults:CLIService.java:427','org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587','org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1553','org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1538','org.apache.thrift.ProcessFunction :过程:ProcessFunction.java:39' ,'org.apache.thrift.TBaseProcessor:进程:TBaseProcessor.java:39','org.apache.hive.service.auth.TSetIpAddressProcessor:进程:TSetIpAddressProcessor.java:56','org.apache.thrift.server.TThreadPoolServer $ WorkerProcess:运行:TThreadPoolServer.java:206','java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145','java.util.concurrent.ThreadPoolExecutor $ Worker:run:ThreadPoolExecutor.java:615', 'java.lang.Thread:run:Thread.java:744'],statusCode = 3),results = None,hasMoreRows = None)请求的状态为TFetchResultsReq(fetchType = 1,operationHandle = TOperationHandle(hasResultSet = False,modifiedRowCount =无,operationType = 0,operationId = THandleIdentifier(secret ='c\xdf\xfe\xb7\x8a\x10D\xea\xbaD\x93} B\xb5\xc3\xe7',guid ='&=\xf9\xc3\xc0vEO\xa0%#\ xf5\xb9\x19\xe9W')),orientation = 0,maxRows = -1):TFetchResultsResp(status = TStatus(errorCode = 0,errorMessage ="找不到)与操作句柄关联的日志:OperationHandle [opType = EXECUTE_STATEMENT,getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957]",sqlState = None,infoMessages = ["*org.apache.hive.service.cli.HiveSQLException:couldn找不到与操作句柄相关的日志:OperationHandle [opType = EXECUTE_STATEMENT,getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957]:25:24",'org.apache.hive.service.cli.operation.OperationManager: getOperationLogRowSet:OperationManager.java:257','org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656','sun.reflect.GeneratedMethodAccessor29:invoke :: - 1','sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43','java.lang.reflect.Method:invoke:Method.java:606','org.apache.hive.service.cli.session.HiveSessionProxy:invoke :HiveSessionProxy.java:79','org.apache.hive.service.cli.session.HiveSessionProxy:access $ 000:HiveSessionProxy.java:37','org.apache.hive.service.cli.session.HiveSessionProxy $ 1:run :HiveSessionProxy.java:64','java.security.AccessController:doPrivileged:AccessController.java:-2','javax.security.auth.Subject:doAs:Subject.java:415','org.apache.hadoop. security.UserGroupInformation:doAs:UserGroupInformation.java:1628','org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536','org.apache.hive.service.cli.session.HiveSessionProxy:引用:HiveSessionProxy.java:60','com.sun.proxy.$ Proxy28:fetchResults :: - 1','org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427','org.apache .hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587','org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1553','org .apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1538','org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39','org.apache.thrift .TBaseProcessor:进程:TBaseProcessor.java:39','org.apache.hive.service.auth.TSetIpAddressProcessor:进程:TSetIpAddressProcessor.java:56','org.apache.thrift.server.TThreadPoolServer $ WorkerProcess:运行:TThreadPoolServer的.java:206','java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145','java.util.concurrent.ThreadPoolExecutor $ Worker:run:ThreadPoolExecutor.java:615','java.lang.Thread:run: Thread.java:744'],statusCode = 3),results = None,hasMoreRows = None)请求的状态为TFetchResultsReq(fetchType = 1,operationHandle = TOperationHandle(hasResultSet = False,modifiedRowCount = None,operationType = 0,operationId = THandleIdentifier) (secret ='c\xdf\xfe\xb7\x8a\x10D\xea\xbaD\x93} B\xb5\xc3\xe7',guid ='&=\xf9\xc3\xc0vEO\xa0%#\ xf5\xb9\x19\xe9W')),orientation = 0,maxRows = -1):TFetchResultsResp(status = TStatus(errorCode = 0,errorMessage ="找不到与操作句柄关联的日志:OperationHandle [opType = EXECUTE_STATEMENT,getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957]",sqlState = None,infoMessages = ["*org.apache.hive.service.cli.HiveSQLException:找不到与操作句柄关联的日志:OperationHandle [opType = EXECUTE_STATEMENT,getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957]:25:24",'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257','org. apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656','sun.reflect.GeneratedMethodAccessor29:invoke :: - 1','sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43' ,'java.lang.reflect.Method:invoke:Method.java:606','org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:79','org.apache.hive.service.cli.session.HiveSessionProxy:access $ 000:HiveSessionProxy.java:37','org.apache.hive.service.cli.session.HiveSessionProxy $ 1:run:HiveSessionProxy. java:64','java.security.AccessController:doPrivileged:AccessController.java:-2','javax.security.auth.Subject:doAs:Subject.java:415','org.apache.hadoop.security.UserGroupInformation :doAs:UserGroupInformation.java:1628','org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536','org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy .java:60','com.sun.proxy.$ Proxy28:fetchResults :: - 1','org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427','org.apache. hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587','org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1553','org.apache.hive.service.cli.thrift.TCLIService $处理器$ FetchResults:getResult:TCLIService.java:1538','org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39','org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39',' org.apache.hive.service.auth.TSetIpAddressProcessor:进程:TSetIpAddressProcessor.java:56','org.apache.thrift.server.TThreadPoolServer $ WorkerProcess:run:TThreadPoolServer.java:206','java.util.concurrent. ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145','java.util.concurrent.ThreadPoolExecutor $ Worker:run:ThreadPoolExecutor.java:615','java.lang.Thread:run:Thread.java:744'],statusCode = 3),results = None,hasMoreRows = None)

Answer 1

如果您在使用Hue时在Cloudera发行版中看到此内容,请将以下内容添加到Hive服务高级配置代码段(安全阀)以获取 Cloudera Manager中的hive-site.xml(或直接添加到hive-site.xml以获取其他内容)发行版):

<property>
    <name>hive.server2.logging.operation.enabled</name>
    <value>true</value>
</property>

Answer 2

ie("hive.server2.logging.operation.log.location")指向写入日志不存在的位置时,可能会发生此错误.

查看OperationManager.java中的代码

OperationLog operationLog = getOperation(opHandle).getOperationLog();
if (operationLog == null) {
  throw new HiveSQLException("Couldn't find log associated with operation handle: " + opHandle);
}