我正在尝试按照本指南设置Apache Nutch来抓取URL .作为一个较老的指南(该指南适用于1.x,我使用的是2.3),我对结构做了必要的修改.但是,当我尝试运行爬网时,我收到此错误:
root@IndiStage:~# /usr/local/nutch/framework/apache-nutch-2.3/src/bin/crawl urls FirstCrawl 2
No SOLRURL specified. Skipping indexing.
Injecting seed URLs
/usr/local/nutch/framework/apache-nutch-2.3/src/bin/nutch inject urls -crawlId FirstCrawl
Error: Could not find or load main class org.apache.nutch.crawl.InjectorJob
Error running:
/usr/local/nutch/framework/apache-nutch-2.3/src/bin/nutch inject urls -crawlId FirstCrawl
Failed with exit value 1.
root@IndiStage:~#
Run Code Online (Sandbox Code Playgroud)
作为Ubuntu(14.04)的新手,我发现很难管理目录结构和路径.
InjectorJob 在... /usr/local/nutch/framework/apache-nutch-2.3/src/java/org/apache/nutch/crawl
JAVA_HOME 被设置为 /usr/lib/jvm/java-7-openjdk-amd64
小智 3
确保您已经编译了 Nutch 源代码。然后,从 ${APACHE_NUTCH_HOME}/runtime/local(或 ${APACHE_NUTCH_HOME}/runtime/deploy/bin)运行爬网命令。
希望这可以帮助,
黎国都