以下代码是我的词嵌入神经网络的入口点:
negative_ratio, n_positive = 1, 10
t = Trainer()
epoch = t.generate_batch(n_positive, negative_ratio=negative_ratio)
model = t.model()
h = model.fit_generator(
epoch,
epochs=15,
steps_per_epoch=negative_ratio,
verbose=2
)
Run Code Online (Sandbox Code Playgroud)
epoch上面是来自生成器的数据,该生成器生成以下格式的(编码)训练数据:
[[list([57, 41, 49, 50, 55, 19, 26, 38, 5, 14, 51])
list([50, 0, 0, 0, 0, 49, 0, 0, 0, 0, 26, 0, 0, 0, 0, 41, 55, 19, 38, 5, 51, 0, 0, 0, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 0, 0, 0, 0, 57, 0, 0, 0, 0, 0, 0, 0])
1]
[list([35, 50, 12, 15, 21, 19, 26, 34, 13, 52])
list([50, 12, 0, 0, 0, 0, 0, 0, 0, 0, 26, 34, 0, 0, 0, 21, 19, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 52, 0, 0, 0, 0, 0, 0, 0, 0, 15, 13, 0, 0, 0, 0, 0, 0])
1]
[list([20, 28, 41, 56, 2, 1, 51, 23, 22])
list([28, 0, 0, 22, 0, 0, 0, 0, 0, 0, 2, 23, 0, 0, 0, 41, 51, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 20, 56, 0, 0, 0, 0, 0, 0, 0])
1]
[list([30, 20, 9, 12, 15, 19, 34, 5, 52, 51, 22])
list([12, 0, 0, 22, 0, 0, 0, 9, 0, 0, 34, 0, 0, 0, 0, 19, 5, 51, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 52, 0, 0, 0, 0, 0, 0, 0, 20, 15, 0, 0, 0, 0, 0, 0, 0])
1]]
Run Code Online (Sandbox Code Playgroud)
不过,Keras 一直告诉我生成器无效:
TypeError: 'tuple' object is not an iterator
我究竟做错了什么?
正如错误所述,您传递的是元组而不是生成器对象。fit_generator()需要一个生成器对象。在内部,它会调用next()生成器对象来获取一批数据。
如果我这样做,next()在一个元组上,我会得到同样的错误:
>>> next((1,2))
Traceback (most recent call last):
File "<input>", line 1, in <module>
next((1,2))
TypeError: 'tuple' object is not an iterator
>>> sample_generator = ((1,2) for i in range(3))
>>> x,y = next(sample_generator)
>>> x,y
(1, 2)
Run Code Online (Sandbox Code Playgroud)
| 归档时间: |
|
| 查看次数: |
5061 次 |
| 最近记录: |