nem*_*emo 12 python floating-point binary ieee-754
我正在python中读取二进制文件,如下所示:
from struct import unpack
ns = 1000
f = open("binary_file", 'rb')
while True:
data = f.read(ns * 4)
if data == '':
break
unpacked = unpack(">%sf" % ns, data)
print str(unpacked)
Run Code Online (Sandbox Code Playgroud)
当我意识到unpack(">f", str)要解压缩IEEE浮点数时,我的数据是IBM的32位浮点数
我的问题是:我如何能够unpack解压缩IBM 32位浮点型数字?
我不介意使用ctypes扩展python来获得更好的性能.
编辑:我做了一些搜索:http: //mail.scipy.org/pipermail/scipy-user/2009-January/019392.html
这看起来非常有希望,但我希望提高效率:潜在的成千上万的循环.
编辑:发布以下答案.谢谢你的提示.
我想我明白了:首先将字符串解压为无符号4字节整数,然后使用这个函数:
def ibm2ieee(ibm):
"""
Converts an IBM floating point number into IEEE format.
:param: ibm - 32 bit unsigned integer: unpack('>L', f.read(4))
"""
if ibm == 0:
return 0.0
sign = ibm >> 31 & 0x01
exponent = ibm >> 24 & 0x7f
mantissa = (ibm & 0x00ffffff) / float(pow(2, 24))
return (1 - 2 * sign) * mantissa * pow(16, exponent - 64)
Run Code Online (Sandbox Code Playgroud)
感谢所有提供帮助的人!
IBM 浮点架构,如何编码和解码: http://en.wikipedia.org/wiki/IBM_Floating_Point_Architecture
我的解决方案: 我写了一个类,我认为这样,它可以快一点,因为使用了Struct对象,这样unpack fmt只编译一次。编辑:还因为它是一次性解包 size*bytes,并且解包可能是一项昂贵的操作。
from struct import Struct
class StructIBM32(object):
"""
see example in:
http://en.wikipedia.org/wiki/IBM_Floating_Point_Architecture#An_Example
>>> import struct
>>> c = StructIBM32(1)
>>> bit = '11000010011101101010000000000000'
>>> c.unpack(struct.pack('>L', int(bit, 2)))
[-118.625]
"""
def __init__(self, size):
self.p24 = float(pow(2, 24))
self.unpack32int = Struct(">%sL" % size).unpack
def unpack(self, data):
int32 = self.unpack32int(data)
return [self.ibm2ieee(i) for i in int32]
def ibm2ieee(self, int32):
if int32 == 0:
return 0.0
sign = int32 >> 31 & 0x01
exponent = int32 >> 24 & 0x7f
mantissa = (int32 & 0x00ffffff) / self.p24
return (1 - 2 * sign) * mantissa * pow(16, exponent - 64)
if __name__ == "__main__":
import doctest
doctest.testmod()
Run Code Online (Sandbox Code Playgroud)