步骤2：mysql建库，建表：

步骤3：从 https://svn.apache.org/repos/asf/nutch/tags/release-2.1  拉下代码，在本地创建java project。本人因为试验过很多次，所以在此取项目名称为test。

步骤4：加src文件

步骤5：加入lib包：

切换到Libaries选项卡，“Add Library"->"IvyDE Managed Dependencies"->"Next",选择“Project”，选择ivy\ivy.xml文件。点 Ok。eclipse会自动下载依赖的jar包。

步骤6：在"Order and Export"选项卡，将 conf    top

<property>

<name>http.agent.name</name>

<value>Your Nutch Spider</value>

</property>

<property>

<name>http.accept.language</name>

<value>ja-jp, en-us,en-gb,en;q=0.7,*;q=0.3</value>

<description>Value of the “Accept-Language” request header field.

This allows selecting non-English language as default one to retrieve.

It is a useful setting for search engines build for certain national group.

</description>

</property>

<property>

<name>parser.character.encoding.default</name>

<value>utf-8</value>

<description>The character encoding to fall back to when no other information

is available</description>

</property>

<property>

  <name>plugin.includes</name>

 <value>protocol-httpclient|protocol-http|urlfilter-regex|parse-(html|tika)|index-(basic|anchor)|urlnormalizer-(pass|regex|basic)|scoring-opic</value>

 <description>Regular expression naming plugin directory names to

  include.  Any plugin not matching this expression is excluded.

  In any case you need at least include the nutch-extensionpoints plugin. By

  default Nutch includes crawling just HTML and plain text via HTTP,

  and basic indexing and search plugins. In order to use HTTPS please enable 

  protocol-httpclient, but be aware of possible intermittent problems with the 

  underlying commons-httpclient library.

  </description>

</property>

<property>

<name>storage.data.store.class</name>

<value>org.apache.gora.sql.store.SqlStore</value>

<description>The Gora DataStore class for storing and retrieving data.

Currently the following stores are available: ….

</description>

</property>

<property>

  <name>plugin.folders</name>

  <value>./src/plugin</value>

  <description>Directories where nutch plugins are located.  Each

  element may be a relative or absolute path.  If absolute, it is used

  as is.  If relative, it is searched for on the classpath.</description>

</property> 

在根目录下的build.xml中找到如下代码

1. <target name="resolve-default" depends="clean-lib, init" description="--> resolve and retrieve dependencies with ivy">
2. <ivy:resolve file="${ivy.file}" conf="default" log="download-only" />
3. <ivy:retrieve pattern="${build.lib.dir}/[artifact]-[revision].[ext]" symlink="false" log="quiet" />
4. <antcall target="copy-libs" />
5. </target>

将pattern="${build.lib.dir}/[artifact]-[revision].[ext]"替换为pattern="${build.lib.dir}/[artifact]-[type]-[revision].[ext]"

步骤8：配置抓取url

步骤9：运行org.apache.nutch.crawl.Crawler

参考资料：