如何将文件从https链接保存到Google云端存储

Question

我想直接在Google云端存储上保存一个大文件(大约50 GB).我试过gsutil cp https://archive.org/download/archiveteam-twitter-stream-2015-08/archiveteam-twitter-stream-2015-08.tar gs://my/folder,但那不起作用(InvalidUrlError: Unrecognized scheme "https").

有没有办法做到这一点,而不必先将文件下载到我的本地存储？

谢谢!

Answer 1

您可以使用curl获取URL并将其传递给gsutil.例如:

curl -L https://archive.org/download/archiveteam-twitter-stream-2015-08/archiveteam-twitter-stream-2015-08.tar | gsutil cp - gs://your/folder/archiveteam-twitter-stream-2015-08.tar