我正在尝试在编码器 LSTM(多对多)和解码器 LSTM(多对一)之间添加一个注意层。
但是我的代码似乎只为一个解码器 LSTM 输入制作了注意力层。
如何将注意力层应用于解码器 LSTM 的所有输入?(注意力层的输出 = (None,1440,984) )
这是我的模型注意力层的总结。
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 1440, 5) 0
__________________________________________________________________________________________________
bidirectional_1 (Bidirectional) (None, 1440, 984) 1960128 input_1[0][0]
__________________________________________________________________________________________________
dense_1 (Dense) (None, 1440, 1) 985 bidirectional_1[0][0]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 1440) 0 dense_1[0][0]
__________________________________________________________________________________________________
activation_1 (Activation) (None, 1440) 0 flatten_1[0][0]
__________________________________________________________________________________________________
repeat_vector_1 (RepeatVector) (None, 984, 1440) 0 activation_1[0][0]
__________________________________________________________________________________________________
permute_1 (Permute) (None, 1440, 984) 0 repeat_vector_1[0][0]
__________________________________________________________________________________________________
multiply_1 (Multiply) (None, 1440, …Run Code Online (Sandbox Code Playgroud)