小编ale*_*xis的帖子

如何在 Keras 中的两个 LSTM 层之间添加注意层

我正在尝试在编码器 LSTM(多对多)和解码器 LSTM(多对一)之间添加一个注意层。

但是我的代码似乎只为一个解码器 LSTM 输入制作了注意力层。

如何将注意力层应用于解码器 LSTM 的所有输入?(注意力层的输出 = (None,1440,984) )

这是我的模型注意力层的总结。

__________________________________________________________________________________________________
Layer (type)                    Output Shape         Param #     Connected to
==================================================================================================
input_1 (InputLayer)            (None, 1440, 5)      0
__________________________________________________________________________________________________
bidirectional_1 (Bidirectional) (None, 1440, 984)    1960128     input_1[0][0]
__________________________________________________________________________________________________
dense_1 (Dense)                 (None, 1440, 1)      985         bidirectional_1[0][0]
__________________________________________________________________________________________________
flatten_1 (Flatten)             (None, 1440)         0           dense_1[0][0]
__________________________________________________________________________________________________
activation_1 (Activation)       (None, 1440)         0           flatten_1[0][0]
__________________________________________________________________________________________________
repeat_vector_1 (RepeatVector)  (None, 984, 1440)    0           activation_1[0][0]
__________________________________________________________________________________________________
permute_1 (Permute)             (None, 1440, 984)    0           repeat_vector_1[0][0]
__________________________________________________________________________________________________
multiply_1 (Multiply)           (None, 1440, …
Run Code Online (Sandbox Code Playgroud)

lstm keras tensorflow encoder-decoder

6
推荐指数
1
解决办法
715
查看次数

标签 统计

encoder-decoder ×1

keras ×1

lstm ×1

tensorflow ×1