无法解析Google Play应用评分数据

Question

Google Play生态系统允许从数据库即云存储中访问评级数据.虽然我可以从Play开发人员的控制台成功下载CSV并对其进行处理,但该文件采用utf-16编码.这是前180个字节:

'255,254,80,0,97,0,99,0,107,0,97,0,103,0,101,0,32,0,78,0,97,0,109,0,101,0,44,0,65,0,112,0,112,0,32,0,86,0,101,0,114,0,115,0,105,0,111,0,110,0,32,0,67,0,111,0,100,0,101,0,44,0,82,0,101,0,118,0,105,0,101,0,119,0,101,0,114,0,32,0,76,0,97,0,110,0,103,0,117,0,97,0,103,0,101,0,44,0,68,0,101,0,118,0,105,0,99,0,101,0,44,0,82,0,101,0,118,0,105,0,101,0,119,0,32,0,83,0,117,0,98,0,109,0,105,0,116,0,32,0,68,0,97,0,116,0,101,0,32,0,97,0,110,0,100,0,32,0,84,0,105,0,109,0,101,0,44,0,82,0,101,0,118,0,105,0,101,0,119,0'

或解码:

u'Package Name,App Version Code,Reviewer Language,Device,Review Submit Date and Time,Review Submit Millis Since Epoch,Review Last Update Date and Time,Review Last Update Millis Since'

但是,当我尝试通过云存储访问评级时:

try:
    stats = cloudstorage.listbucket(folder_path)
except Exception as e:
    raise
files = [stat for stat in stats]
newest = max(files, key=lambda f: f.st_ctime)
newest_ratings_file = cloudstorage.open(newest.filename)
s = newest_ratings_file.read()
newest_ratings_file.close()

,我收到下一个字节序列(这里是前180个):

31,139,8,0,0,0,0,0,0,0,228,189,201,147,44,219,150,222,181,75,74,53,85,42,149,132,74,133,138,82,53,231,189,42,189,71,137,155,85,209,55,247,221,115,239,203,38,154,236,251,150,65,146,125,223,247,73,47,76,48,96,0,162,4,234,104,198,48,131,17,19,16,102,96,134,193,95,112,7,175,94,25,67,13,48,195,140,25,3,224,251,126,219,35,79,158,200,136,188,55,162,210,12,51,220,210,118,100,132,135,251,246,237,238,43,214,222,107,173,111,125,235,255,249,191,103,195,102,216,14,199,122,221,15,187,225,67,152,214,187,83,189,251,34,12,133,11,253,125,8,203,250,116,21,174,195,97,56,15,103,250,60,162,255,59,236,49,175,215,59,109,223,13,247,236,243,33,76,234,232

这对我来说看起来不像任何已知的编码.尝试使用'utf-8','utf-16','utf-16-be','utf-16-le'进行解码会导致解码错误,例如:

UnicodeDecodeError: 'utf16' codec can't decode bytes in position 170-171: illegal encoding

CharDetect(https://pypi.python.org/pypi/chardet)也没有帮助:(

我不知道下一步要去哪里.伙计们/女孩们,有什么建议如何解决这个问题？Muchas gracias!

Answer 1

您可以使用Cloud Storage 浏览器检查文件内容类型和内容编码，或者gsutil ls -L <file>获取有关如何解码它的一些线索。

在这种情况下（Content-Encoding: gzip Content-Type:text/csv; charset=utf-16le），文件需要解压缩然后解码。