pee*_*eer 5 python firefox selenium selenium-webdriver aws-lambda-layers
我有一个可用的 docker 容器,想在 Firefox 上迁移到 selenium 3.141 的 lambda 层。工作容器的 Dockerfile 是:
FROM python:3.7-slim
RUN /usr/local/bin/python -m pip install --upgrade pip
RUN pip install selenium==3.141.0
RUN apt-get update
RUN apt-get -y install wget bzip2 firefox-esr #68.12.0esr
WORKDIR /tmp
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.26.0/geckodriver-v0.26.0-linux64.tar.gz
RUN tar -zxf geckodriver-v0.26.0-linux64.tar.gz -C /usr/local/bin/
Run Code Online (Sandbox Code Playgroud)
当我在此容器中执行以下操作时,Firefox会创建一个对象。
from selenium.webdriver import Firefox
from selenium.webdriver.firefox.options import Options
opts = Options()
opts.headless = True
Firefox(options=opts, service_log_path='/home/geckodriver.log')
Run Code Online (Sandbox Code Playgroud)
对于 lambda 层,我使用amazonlinux图像进行本地测试。在 aws 上,我提供的一个 zip 文件将被提取到/opt,所以我想把所有东西都放进去/opt,看看它是否工作。
我的 dockerfile 是
FROM amazonlinux
WORKDIR /
RUN yum update -y
# Install Python 3.7
RUN yum install python3 zip unzip wget tar bzip2 bzip2-libs gzip -y
RUN pip3.7 install --upgrade pip
RUN pip3.7 install selenium==3.141.0 #-t /opt/python/lib/python3.7/site-packages
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.26.0/geckodriver-v0.26.0-linux64.tar.gz
RUN tar -zxf geckodriver-v0.26.0-linux64.tar.gz -C /opt
RUN wget https://ftp.mozilla.org/pub/firefox/releases/68.9.0esr/linux-x86_64/de/firefox-68.9.0esr.tar.bz2
RUN tar -xvjf firefox-68.9.0esr.tar.bz2 -C /opt
Run Code Online (Sandbox Code Playgroud)
但是当我运行它时
sudo docker build -t selenium:fftest -f Dockerfile.ff .
sudo docker run --rm -it -v $(pwd):/data selenium:fftest
Run Code Online (Sandbox Code Playgroud)
并执行
from selenium.webdriver.firefox.options import Options
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary
from selenium.webdriver import Firefox
opts = Options()
opts.headless = True
firefox_dir = '/opt/'
gecko_dir = '/opt/'
binary = FirefoxBinary( firefox_dir + 'firefox/firefox')
Firefox(options=opts, executable_path= gecko_dir + 'geckodriver', firefox_binary=binary)
Run Code Online (Sandbox Code Playgroud)
我得到
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/firefox/webdriver.py", line 174, in __init__
keep_alive=True)
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__
self.start_session(capabilities, browser_profile)
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session
response = self.execute(Command.NEW_SESSION, parameters)
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/usr/local/lib/python3.7/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: invalid argument: can't kill an exited process
Run Code Online (Sandbox Code Playgroud)
这个答案/sf/answers/3677495811/建议版本不兼容,但根据表格我对 selenium 3.141、Geckodriver 22 和 Firefox 68 没问题。
链接的答案进一步建议以非 root 用户身份运行。我终于设法做到了:
FROM amazonlinux
RUN yum update -y
RUN yum install python3 wget tar bzip2 bzip2-libs gzip -y
Run yum install shadow-utils -y
RUN useradd -ms /bin/bash jd
RUN echo "jd:password" | chpasswd
RUN usermod -aG root jd
USER jd
WORKDIR /home/jd
RUN pip3.7 install --user --upgrade pip
RUN pip3.7 install --user selenium==3.141.0
COPY downloads/geckodriver-v0.26.0-linux64.tar.gz /tmp/
COPY downloads/firefox-68.9.0esr.tar.bz2 /tmp/
USER root
RUN tar -zxf /tmp/geckodriver-v0.26.0-linux64.tar.gz -C /opt
RUN tar -xvjf /tmp/firefox-68.9.0esr.tar.bz2 -C /opt
RUN chown -R jd:jd /opt/firefox
USER jd
Run Code Online (Sandbox Code Playgroud)
中的所有内容/opt都jd作为所有者和组,但错误消息是相同的。
当我将 geckodriver 和 firefox 都提取到/usr/local/bin我无法实例化时,只会Firefox(options=opts)得到相同的can't kill an exited process错误。
$ /opt/firefox/firefox --version
XPCOMGlueLoad error for file /opt/firefox/libmozgtk.so:
libgtk-3.so.0: cannot open shared object file: No such file or directory
Couldn't load XPCOM.
Run Code Online (Sandbox Code Playgroud)
我认为丢失的目标文件是根本原因。但我不知道从哪里得到它以及把它放在哪里(我只能把它放进去/opt)。
Afteryum install gtk3-devel libdbus-glib-1.so.2缺少 file /opt/firefox/libxul.so。
| 归档时间: |
|
| 查看次数: |
1239 次 |
| 最近记录: |