从python subprocess.call调用rsync

Question

我正在尝试从python脚本中的子进程执行ssh上的rsync,以将图像从一个服务器复制到另一个服务器.我有一个函数定义为:

def rsyncBookContent(bookIds, serverEnv):
    bookPaths = ""
    if len(bookIds) > 1:
        bookPaths = "{" + ",".join(("book_"+str(x)) for x in bookIds) + "}"
    else:
        bookPaths = "book_" + str(bookIds[0])

    for host in serverEnv['content.hosts']:
        args = ["rsync", "-avz", "--include='*/'", "--include='*.jpg'", "--exclude='*'", "-e", "ssh", options.bookDestDir + "/" + bookPaths, "jill@" + host + ":/home/jill/web/public/static/"]
        print "executing " + ' '.join(args)
        subprocess.call(args)

我最终要做的是让Python执行这个(它来自bash shell):

rsync -avz --include='*/' --include='*.jpg' --exclude='*' -e ssh /shared/books/{book_482,book_347} jill@10.12.27.20:/home/jill/web/public/static/

确实,我的印刷声明输出:

executing rsync -avz --include='*/' --include='*.jpg' --exclude='*' -e ssh /shared/books/{book_482,book_347} jill@10.12.27.20:/home/jill/web/public/static/

但是当从这个python脚本中执行时,有两个问题:

1. 如果len(bookIds)> 1,/ shared/books /下的子目录列表会被bash或rsync错误地解释.错误消息是:
   • rsync:link_stat"/ shared/books/{book_482,book_347}"失败:没有这样的文件或目录(2))
2. 如果len(bookIds)== 1,源目录下的所有文件都是rsynced(不仅仅是*.jpg,我的意图)

看起来好像subprocess.call函数需要转义一些字符或什么,不是吗？

Answer 1

找出我的问题.我的问题是由于我误解了subprocess.call函数的执行方式以及bash在花括号内扩展列表的结果.

当我在bash shell中发出带有大括号子目录的rsync命令时,bash实际上将它扩展为多个参数,这些参数被传递给rsync(/ shared/books/book_1 shared/books/book_2等).将带有大括号"/ shared/books/{book_1,book_2}"的相同字符串传递给subprocess.call函数时,扩展没有发生,因为它没有经过bash,所以我对rsync的论证确实是"/ shared/books/{book_1,book_2}".

类似地,文件模式('*','*.jpg'等)周围的单引号在bash命令行上起作用(只有单引号内的值传递给rsync),但在subprocess.call中,单引号作为文件模式("'*.jpg'")传递给rsync.

新的(工作)代码如下所示:

def rsyncBookContent(bookIds, serverEnv):
    bookPaths = []
    for b in bookIds:
        bookPaths.append(options.bookDestDir + "/book_" + str(b))
    args = []
    for host in serverEnv['content.hosts']:
        # copy all *.jpg files via ssh
        args = ["rsync", "-avz", "--include", "*/", "--include", "*.jpg", "--exclude", "*", "-e", "ssh"]
        args.extend(bookPaths)
        args.append("jill@" + host + ":/home/jill/web/public/static/"])
        print "executing " + ' '.join(args)
        subprocess.call(args)