小编kar*_*olo的帖子

CasperJS循环或遍历多个网页?

我有一个CasperJS脚本,可以从一个网页上删除评级和日期.现在我想从同一网站下的多个页面中抓取相同的数据.如何在给定此代码的情况下遍历不同的子页面:

var ratings = [];
var dates = [];
var casper = require('casper').create({

    pageSettings: {
        loadImages:  false,         
        loadPlugins: false          
    },
    logLevel: "debug",             
    verbose: true                   
});

var fs = require('fs');

function getRatings() {
    var ratings = document.querySelectorAll('#BVRRRatingOverall_Review_Display > div.BVRRRatingNormalImage > img');
    return Array.prototype.map.call(ratings, function(e) {
        return e.getAttribute('title');
    });
}

function getDate() {
    var dates = document.querySelectorAll('#BVSubmissionPopupContainer > div.BVRRReviewDisplayStyle5Header > div.BVRRReviewDateContainer > span.BVRRValue.BVRRReviewDate');

    return Array.prototype.map.call(dates, function(e) {

        return e.innerHTML;

    });
}

casper.start('http://www.t-mobile.com/cell-phones/samsung-galaxy-s-5.html?bvrrp=9060/reviews/product/1/598aea53-16d0-4c12-b53a-105157092c52.htm', function(){

    this.echo('hi');
});

casper.then(function() {

    ratings = this.evaluate(getRatings);
    dates = …
Run Code Online (Sandbox Code Playgroud)

javascript foreach loops web-scraping casperjs

14
推荐指数
2
解决办法
1万
查看次数

标签 统计

casperjs ×1

foreach ×1

javascript ×1

loops ×1

web-scraping ×1