Sor*_*ush 1 installation web-crawler nutch windows-7
我想在我的 Windows 7 x64 上运行 Nutch。我有来自apache.spinellicreations.com/nutch/ 的Nutch 版本 1.5.1 和 2 。
我使用了wiki.apache.org/nutch/NutchTutorial 上的教程。但是我在第二步搞砸了,我无法验证安装。其他步骤很难理解...
安装和使用nutch的步骤是什么?
按照步骤
nutch在 Windows 中安装:
1) download and install cygwin from : https://www.cygwin.com/
2) download nutch from : http://nutch.apache.org/downloads.html
3) paste nutch downloaded and extracted folder into C:\cygwin64\home\
4) rename to apache-nutch
5) open cygwin terminal and type given commands
- $ cd C:
- $ cd cygwin64
- $ cd home
- $ cd apache-nutch
- $ cd src/bin
- $ ./nutch
Run Code Online (Sandbox Code Playgroud)
你会得到给定的输出:
Usage: nutch COMMAND
where COMMAND is one of:
inject inject new urls into the database
hostinject creates or updates an existing host table from a text file
generate generate new batches to fetch from crawl db
fetch fetch URLs marked during generate
parse parse URLs marked during fetch
updatedb update web table after parsing
updatehostdb update host table after parsing
readdb read/dump records from page database
readhostdb display entries from the hostDB
index run the plugin-based indexer on parsed batches
elasticindex run the elasticsearch indexer - DEPRECATED use the index command instead
solrindex run the solr indexer on parsed batches - DEPRECATED use the index command instead
solrdedup remove duplicates from solr
solrclean remove HTTP 301 and 404 documents from solr - DEPRECATED use the clean command instead
clean remove HTTP 301 and 404 documents and duplicates from indexing backends configured via plugins
parsechecker check the parser for a given url
indexchecker check the indexing filters for a given url
plugin load a plugin and run one of its classes main()
nutchserver run a (local) Nutch server on a user defined port
webapp run a local Nutch web application
junit runs the given JUnit test
or
CLASSNAME run the class named CLASSNAME
Most commands print help when invoked w/o parameters.
Run Code Online (Sandbox Code Playgroud)
| 归档时间: |
|
| 查看次数: |
5968 次 |
| 最近记录: |