我想用一句话替换出现一次的单词'<unk>'.喜欢一句话:hello hello world my world,我想要输出hello hello world <unk> world,怎么做?
现在我这样做:
wordlist1 = trainfiles.split(None)
wordlist2 = []
for word1 in wordlist1:
lastchar = word1[-1:]
if lastchar in [",",".","!","?",";"]:
word2 = word1.rstrip(lastchar)
else:
word2 = word1
wordlist2.append(word2)
freq = {}
for word2 in wordlist2:
freq[word2] = freq.get(word2,0)+1
keylist = freq.keys()
keylist.sort()
for key2 in keylist:
if freq[key2] == 1:
print "%-10s %d" % ('<unk>', freq[key2])
else:
print "%-10s %d" % (key2, freq[key2])
Run Code Online (Sandbox Code Playgroud)
这给了我一个输出:
hello 2
<unk> …Run Code Online (Sandbox Code Playgroud) python ×1