使用 xfvb headless 运行 Puppeteer : false

JSw*_*rdy 5 node.js puppeteer

我正在无头 Ubuntu 16.04 AWS EC2 实例中运行 Puppeteer,并希望通过 xfvb 使用虚拟显示器来运行它。每当我尝试运行它时,我都会继续收到错误:

/home/ubuntu/node_modules/xvfb/index.js:84
throw new Error('Could not start Xvfb.');    
Error: Could not start Xvfb.
at Xvfb.startSync (/home/ubuntu/node_modules/xvfb/index.js:84:17)
at Object.<anonymous> (/home/ubuntu/puppeteer-works.js:39:6)
at Module._compile (internal/modules/cjs/loader.js:689:30)
at Object.Module._extensions..js (internal/modules/cjs/loader.js:700:10)
at Module.load (internal/modules/cjs/loader.js:599:32)
at tryModuleLoad (internal/modules/cjs/loader.js:538:12)
at Function.Module._load (internal/modules/cjs/loader.js:530:3)
at Function.Module.runMain (internal/modules/cjs/loader.js:742:12)
at startup (internal/bootstrap/node.js:266:19)
at bootstrapNodeJSCore (internal/bootstrap/node.js:596:3)
Run Code Online (Sandbox Code Playgroud)

我的代码如下:

const puppeteer = require('puppeteer');
const fs = require("fs");
const Xvfb = require('xvfb');
var xvfb = new Xvfb();

var text = fs.readFileSync("proxy.txt").toString('utf-8');
const textByLine = text.split(" ");


const preparePageForTests = async (page) => {
  const userAgent = 'Mozilla/5.0 (X11; Linux x86_64)' +
  'AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.39 
Safari/537.36';
  await page.setUserAgent(userAgent);
  await page.evaluateOnNewDocument(() => {
  Object.defineProperty(navigator, 'webdriver', {
    get: () => false,
  });
});
await page.evaluateOnNewDocument(() => {
  window.chrome = {
    runtime: {},
  };
});
await page.evaluateOnNewDocument(() => {
  const originalQuery = window.navigator.permissions.query;
  return window.navigator.permissions.query = (parameters) => (
    parameters.name === 'notifications' ?
      Promise.resolve({ state: Notification.permission }) :
      originalQuery(parameters)
  );  
});
await page.evaluateOnNewDocument(() => {
  Object.defineProperty(navigator, 'plugins', {
    get: () => [1, 2, 3, 4, 5],
  });  
});
}

xvfb.startSync();

(async () => {
  const browser = await puppeteer.launch({
    args: ['--no-sandbox', '--proxy-server='+textByLine[0]],
    headless: true, });
  const page = await browser.newPage();
  page.authenticate({
      username: textByLine[1],
      password: textByLine[2]
  });
  await preparePageForTests(page);

  const testUrl ="https://publicindex.sccourts.org/abbeville/publicindex/";
  await page.goto(testUrl);
  const html = await page.content();
  await page.screenshot({path: 'result.png'});
  await browser.close()
  console.log(html)

})();
xvfb.stopSync();
Run Code Online (Sandbox Code Playgroud)

感谢您的帮助,我对 Node.js 还很陌生,因此对于任何格式错误我提前表示歉意。由于主要是代码,我不被允许发布此内容,因此我添加了这句话。

Kaz*_*ami 12

您似乎正在尝试使用 Xvfb 节点模块。虽然其他答案肯定有效,但这里有一个在 Nodejs 中完全有效的代码片段

const puppeteer = require('puppeteer')
const Xvfb = require('xvfb');

(async () => {
    var xvfb = new Xvfb({
        silent: true,
        xvfb_args: ["-screen", "0", '1280x720x24', "-ac"],
    });
    xvfb.start((err)=>{if (err) console.error(err)})
    const browser = await puppeteer.launch({
        headless: false,
        defaultViewport: null, //otherwise it defaults to 800x600
        args: ['--no-sandbox', '--start-fullscreen', '--display='+xvfb._display]
        });
    const page = await browser.newPage();
    await page.goto(`https://wikipedia.org`,{waitUntil: 'networkidle2'});
    await page.screenshot({path: 'result.png'});
    await browser.close()
    xvfb.stop();
})()
Run Code Online (Sandbox Code Playgroud)

这在处理 xvfb.start() 中的错误(以及可能的竞争条件)方面并不完美,但它应该可以帮助您入门,并且它对我来说非常一致。

编辑:记得先安装 Xvfb:(sudo apt-get install xvfb谢谢,@iamfrank)


Ame*_*oui 5

看来 xfvb 没有正确安装

您应该为 ubuntu 操作系统安装 xvfb(X windows 虚拟帧缓冲区)软件包

$ sudo apt-get update

$ sudo apt-get install xvfb
Run Code Online (Sandbox Code Playgroud)

在后台运行 Xvfb 并指定显示编号(在我的示例中为 10)

$ Xvfb :10 -ac &
Run Code Online (Sandbox Code Playgroud)

将 DISPLAY 变量设置为您选择的数字

$ export DISPLAY=:10
Run Code Online (Sandbox Code Playgroud)