use*_*627 9 python numpy raiserror overflow numba
从这里开始跟进,我一直在溢出.所以我试图提出一个异常,以便我确切知道哪里出了问题.
我有这样的事情:
@jit
def train_function(X, y, H):
np.seterr(over="raise", under="raise", invalid="raise")
# do some stuff, start a double loop, and then do:
try:
z[i,j] = math.exp(-beta[j,i])
except OverflowError:
print "Calculation failed! z[i,j] = math.exp(-beta[j,i]), j: " + str(j) + ", i: " +str(i) + ", b: " + str(beta[j,i]) + ", omb: " + str(oneminusbeta[j,i])
raise
class MyClass(object):
# init and other methods
def train(self, X, y, H):
train_function(X, y, H)
Run Code Online (Sandbox Code Playgroud)
但我得到这个错误:
Traceback (most recent call last):
File "C:\work_asaaki\code\gbc_classifier_train_7.py", line 55, in <module>
gentlebooster.train(X_train, y_train, boosting_rounds)
File "C:\work_asaaki\code\gentleboost_c_class_jit_v7_nolimit.py", line 297, in train
self.g_per_round, self.g = train_function(X, y, H)
File "C:\Anaconda\lib\site-packages\numba\dispatcher.py", line 152, in _compile_for_args
return self.jit(sig)
File "C:\Anaconda\lib\site-packages\numba\dispatcher.py", line 143, in jit
return self.compile(sig, **kws)
File "C:\Anaconda\lib\site-packages\numba\dispatcher.py", line 131, in compile
flags=flags, locals=locs)
File "C:\Anaconda\lib\site-packages\numba\compiler.py", line 103, in compile_extra
bc = bytecode.ByteCode(func=func)
File "C:\Anaconda\lib\site-packages\numba\bytecode.py", line 305, in __init__
table = utils.SortedMap(ByteCodeIter(code))
File "C:\Anaconda\lib\site-packages\numba\utils.py", line 70, in __init__
for i, (k, v) in enumerate(sorted(seq)):
File "C:\Anaconda\lib\site-packages\numba\bytecode.py", line 219, in next
raise NotImplementedError(ts % tv)
NotImplementedError: offset=742 opcode=0x79 opname=SETUP_EXCEPT
Run Code Online (Sandbox Code Playgroud)
我在使用numba时不能提出异常吗?我在64位机器上使用带有Numba 0.13.x和Numpy 1.8.x的Anaconda 2.0.1.
http://numba.pydata.org/numba-doc/dev/reference/pysupported.html
2.6.1.1. 结构体
Numba 努力支持尽可能多的 Python 语言,但某些语言功能在 Numba 编译的函数中不可用。目前不支持以下 Python 语言功能:
Class definition
Exception handling (try .. except, try .. finally)
Context management (the with statement)
Run Code Online (Sandbox Code Playgroud)
raise 语句有多种形式支持:
raise (to re-raise the current exception)
raise SomeException
raise SomeException(<arguments>)
Run Code Online (Sandbox Code Playgroud)
所以我们就只剩下这里了:
z[i,j] = math.exp(-beta[j,i])
Run Code Online (Sandbox Code Playgroud)
exp(-1000) 以下的任何负值;非常非常小将计算为零而不会溢出
math.exp(-1000000000)“有效”并且可能不是你的问题(虽然它会返回 0.0,但它不是“真正的”零)
那么什么会导致这个失败呢?我们知道:
print(math.exp(100))
>>>
2.6881171418161356e+43
Run Code Online (Sandbox Code Playgroud)
是愚蠢的大,远不止于此......可能会溢出
果然
print(math.exp(1000))
>>>
OverflowError: math range error
Run Code Online (Sandbox Code Playgroud)
我没有引用,但我认为有效范围是 -700 到 700,从双浮点数的角度来看,它有效地评估为 0 和无穷大(溢出)
为了处理这个问题,我们打开函数:
n = beta
if n > 100:
n = 100
z = math.exp(n)
Run Code Online (Sandbox Code Playgroud)
但这也不起作用,因为 math.exp(n) 只接受浮点数,而你的 beta 似乎是一个列表;你必须使用 numpy.exp(n) 和 numpy.clip() 来窗口
b = numpy.array(-beta[j,i])
n = numpy.clip(b, a_max=100)
z = numpy.exp(n)
Run Code Online (Sandbox Code Playgroud)
或者引发溢出异常:
b = numpy.array(-beta[j,i])
n = numpy.clip(b, a_max=100)
if b != n:
print (j,i,-beta[j,i])
raise OverflowError
else:
z = numpy.exp(n)
Run Code Online (Sandbox Code Playgroud)