我正在尝试在 google colab 中运行一个文件(一个可执行文件)我安装了驱动器并且一切正常但是每当我尝试使用以下命令运行它时:
! 'gdrive/My Drive/path/myfile'
我得到了单元格的输出:
/bin/bash: 'gdrive/My Drive/path/myfile : Permission denied
任何想法如何克服权限?
python permissions bash file-permissions google-colaboratory
我正在训练一个序列到序列(seq2seq)模型,并且我有不同的值来训练input_sequence_length.
对于值10和15,我得到了可以接受的结果,但是当我尝试使用 进行训练时20,我遇到了内存错误,因此我将训练切换为批量训练,但模型过度拟合并且验证损失爆炸,即使使用累积的梯度,我也得到了相同的行为,所以我正在寻找提示并导致更准确的更新方法。
这是我的训练函数(仅包含批处理部分):
if batch_size is not None:
k=len(list(np.arange(0,(X_train_tensor_1.size()[0]//batch_size-1), batch_size )))
for epoch in range(num_epochs):
optimizer.zero_grad()
epoch_loss=0
for i in list(np.arange(0,(X_train_tensor_1.size()[0]//batch_size-1), batch_size )): # by using equidistant batch till the last one it becomes much faster than using the X.size()[0] directly
sequence = X_train_tensor[i:i+batch_size,:,:].reshape(-1, sequence_length, input_size).to(device)
labels = y_train_tensor[i:i+batch_size,:,:].reshape(-1, sequence_length, output_size).to(device)
# Forward pass
outputs = model(sequence)
loss = criterion(outputs, labels)
epoch_loss+=loss.item()
# Backward and optimize
loss.backward() …Run Code Online (Sandbox Code Playgroud) python machine-learning training-data neural-network pytorch