Apache 日志 分析/研究 by Emerald 绿色学院 - Green Institute

一、

站点访问日志

C:/Program Files/Apache Group/Apache2/logs/access.log 文件

01.
crawl-66-249-66-166.googlebot.com - - [15/Feb/2005:08:32:41 +0800] "GET /uploads/thumbs/1045.jpg HTTP/1.1" 403 286

上面的信息很明显了,是一个 Google bot.

不过这个日志文件记录了图片的访问信息,因为这个是我以前的LOG,
可以在Apache 中配置不记录对图片的请求写入日志文件中,
修改 CustomLog logs/access_log common 为下面的内容:
##############################################################
SetEnvIf Request_URI /.gif image-request
SetEnvIf Request_URI /.jpg image-request
SetEnvIf Request_URI /.png image-request
SetEnvIf Request_URI /.jpeg image-request

CustomLog logs/access_log common env=!image-request

# 避免对图片的请求出现在访问日志中
##############################################################

02.
shawl - E [15/Feb/2005:00:13:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=32&refer=&page=http://gi.2288.org:88/ HTTP/1.1" 200 -

计算机名为 Shawl ，登入服务器站点的用户名为 E ,接着是把用户信息写入一个统计程序。

03.
220.198.201.83 - - [16/Feb/2005:13:59:02 +0800] "GET /modules/wfdownloads/down22-139.htm HTTP/1.1" 200 47724

IP -- 访问时间 - 请求方式为 GET ，访问页面 /modules/wfdownloads/down22-139.htm ，协议为 HTTP/1.1

04.
crawl-66-249-64-13.googlebot.com - - [16/Feb/2005:14:12:30 +0800] "GET /robots.txt HTTP/1.0" 403 274

Googlebot 在读取 robots.txt的信息，以确定访问内容和访问权限。

05.
lj1145.inktomisearch.com - - [16/Feb/2005:14:16:33 +0800] "GET /robots.txt HTTP/1.0" 403 273

一个水货 bot 在访问站点。

lj1342.inktomisearch.com - - [16/Feb/2005:14:16:39 +0800] "GET /modules/myalbum/photo.php?lid=901&cid=34 HTTP/1.0" 200 46331

访问的页面。

06.
一位普通访客的访问信息：

218.15.245.42 - - [16/Feb/2005:14:20:50 +0800] "GET /modules/myalbum/photo1533-30.htm HTTP/1.1" 200 46327
218.15.245.42 - - [16/Feb/2005:14:20:47 +0800] "GET /modules/myalbum/photo1812-23.htm HTTP/1.1" 200 46530
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /xoops.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /images/logo.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/images/arrow-8.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /themes/Emerald-G/images/160.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /modules/myalbum/images/folder16.gif HTTP/1.1" 200 341
218.15.245.42 - - [16/Feb/2005:14:21:02 +0800] "GET /modules/myalbum/images/folder_open.gif HTTP/1.1" 200 233
218.15.245.42 - - [16/Feb/2005:14:21:04 +0800] "GET /xoops.css HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:03 +0800] "GET /uploads/photos/1812.jpg HTTP/1.1" 200 103135
218.15.245.42 - - [16/Feb/2005:14:21:05 +0800] "GET /images/icons/pm_small.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /images/s_poweredby.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:04 +0800] "GET /modules/myalbum/images/newred.gif HTTP/1.1" 200 376
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=32&refer=http%3A//gi.2288.org%3A88/&page=http://gi.2288.org:88/modules/myalbum/photo1812-23.htm HTTP/1.1" 200 -
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /themes/Emerald-G/images/arrow-l.gif HTTP/1.1" 304 -
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /modules/myalbum/<{$xoops_imageurl}>logo.gif HTTP/1.1" 403 312
218.15.245.42 - - [16/Feb/2005:14:21:06 +0800] "GET /uploads/thumbs/190.jpg HTTP/1.1" 200 9053

07.
Spider 在扒窃中:

60.176.195.255 - - [17/Feb/2005:23:15:42 +0800] "GET / HTTP/1.1" 200 73837
60.176.195.255 - - [17/Feb/2005:23:15:45 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 200 19894
60.176.195.255 - - [17/Feb/2005:23:15:47 +0800] "GET /include/xoops.js HTTP/1.1" 200 17698
60.176.195.255 - - [17/Feb/2005:23:15:50 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/ HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:16:50 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:16:50 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:16:50 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:16:48 +0800] "GET / HTTP/1.1" 200 73837
60.176.195.255 - - [17/Feb/2005:23:16:51 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/ HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:17:10 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:08 +0800] "GET /modules/news/article_472.htm HTTP/1.1" 200 43996
60.176.195.255 - - [17/Feb/2005:23:17:13 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:13 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:14 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/modules/news/article_472.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:17:14 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:12 +0800] "GET /modules/news/article_230.htm HTTP/1.1" 200 46519
60.176.195.255 - - [17/Feb/2005:23:17:15 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:15 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:15 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=&page=http://gi.2288.org:88/modules/news/article_230.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:17:38 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:36 +0800] "GET /modules/news/article_223.htm HTTP/1.1" 200 45204
60.176.195.255 - - [17/Feb/2005:23:17:40 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:40 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:17:41 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88&page=http://gi.2288.org:88/modules/news/article_223.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:18:05 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:18:05 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:18:05 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:18:03 +0800] "GET /modules/news/article_468.htm HTTP/1.1" 200 44773
60.176.195.255 - - [17/Feb/2005:23:18:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/news/article_223.htm&page=http://gi.2288.org:88/modules/news/article_468.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:20:03 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:20:03 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:20:04 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:20:01 +0800] "GET /modules/AMS/article_67.htm HTTP/1.1" 200 45349
60.176.195.255 - - [17/Feb/2005:23:20:06 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/news/article_468.htm&page=http://gi.2288.org:88/modules/AMS/article_67.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:21:18 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:21:18 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:21:18 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:21:16 +0800] "GET /modules/AMS/article_65.htm HTTP/1.1" 200 52030
60.176.195.255 - - [17/Feb/2005:23:21:19 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/AMS/article_67.htm&page=http://gi.2288.org:88/modules/AMS/article_65.htm HTTP/1.1" 200 -
60.176.195.255 - - [17/Feb/2005:23:24:27 +0800] "GET /xoops.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:24:27 +0800] "GET /themes/Emerald-G/style.css HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:24:28 +0800] "GET /include/xoops.js HTTP/1.1" 304 -
60.176.195.255 - - [17/Feb/2005:23:24:26 +0800] "GET /modules/news/article_457.htm HTTP/1.1" 200 44337
60.176.195.255 - - [17/Feb/2005:23:24:28 +0800] "GET /modules/istats/include/counter.php?sw=1024&sc=16&refer=http%3A//gi.2288.org%3A88/modules/AMS/article_65.htm&page=http://gi.2288.org:88/modules/news/article_457.htm HTTP/1.1" 200 -

二、

站点错误日志

*:/Apache/dummy-gi.2288.org.88-error_log

01. 恶意用户

[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 218.15.88.109] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0, referer: http://gi.2288.org:88/
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 221.225.97.15] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0, referer: http://www.blogcn.com/user15/btbtd/index.html
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0
[client 202.108.1.2] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0

IP 为 202.108.1.2 的用户在试图更改一些设置。

02.

搜索引擎在收录页面，

[Fri Feb 04 21:15:30 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/images/logo.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/uploads/thumbs/148.jpg, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-l.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/rate0.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/reviews.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/images/s_poweredby.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-8.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:15:31 2005] [error] [client 220.141.205.83] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/downloads.gif, referer: http://216.239.63.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server&hl=zh-TW&inlang=zh-TW
[Fri Feb 04 21:26:25 2005] [error] [client 68.142.251.165] client denied by server configuration: I:/gi-2288/robots.txt

应该是 Google台湾, 但遭到拒绝访问图片，和访问文本文件。

03.

[Fri Feb 04 21:54:50 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/news/wordpress
[Fri Feb 04 21:54:54 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/news/wordpress

那家伙又来了，但输入的目录是错误目录，地址不存在。

04.

一个正常用户的访问，客户端应该没有启用 Cookies

[Fri Feb 04 21:55:55 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/logo.gif
[Fri Feb 04 21:55:56 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:56 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:57 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:58 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:59 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:55:59 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:00 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:01 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:01 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:02 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:03 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:03 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:04 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:05 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:05 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:06 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:07 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/xmline/csdn-xml.gif
[Fri Feb 04 21:56:07 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/modules/xmline/images/xmline.png
[Fri Feb 04 21:56:08 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:09 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:10 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/uploads/thumbs/1278.jpg
[Fri Feb 04 21:56:10 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:11 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:12 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:12 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:13 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:14 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif
[Fri Feb 04 21:56:14 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:15 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:16 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:19 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif
[Fri Feb 04 21:56:20 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/images/s_poweredby.gif
[Fri Feb 04 21:56:20 2005] [error] [client 211.161.27.24] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif

所以被拒绝访问图片（服务器拒绝图片外部链接）。

05.

[Fri Feb 04 22:03:56 2005] [error] [client 66.196.90.161] client denied by server configuration: I:/gi-2288/robots.txt
[Fri Feb 04 22:10:17 2005] [error] [client 66.196.91.51] File does not exist: I:/gi-2288/modules/myalbum/wordpress
[Fri Feb 04 22:11:21 2005] [error] [client 66.196.91.58] File does not exist: I:/gi-2288/modules/AMS/wordpress
[Fri Feb 04 22:18:16 2005] [error] [client 66.196.90.227] File does not exist: I:/gi-2288/modules/news/wordpress
[Fri Feb 04 22:41:40 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/myalbum/wordpress
[Fri Feb 04 22:42:03 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/myalbum/wordpress
[Fri Feb 04 22:42:25 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/xphpbbi/wordpress
[Fri Feb 04 22:42:52 2005] [error] [client 202.108.1.2] File does not exist: I:/gi-2288/modules/xphpbbi/wordpress

看来问题不小，错误目录。。。

06.

文件不存在，坏链接，事实上页面存在，但是这是一个框架页。

[Sat Feb 05 00:16:27 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:28 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:29 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:29 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:29 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:30 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html
[Sat Feb 05 00:16:31 2005] [error] [client 68.145.197.171] File does not exist: J:/Document/Xoops-For-Dummies-html/Upperframe_images, referer: http://gi.2288.org:88/document/Xoops-For-Dummies-html/Upperframe.html

这就是为什么框架页搜索引擎收录不理想的原因了。

07.

Google 俄罗斯在扒窃页面。

[Sat Feb 05 05:01:41 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/images/logo.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:42 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/downloads.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:43 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/160.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:44 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/reviews.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:45 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/modules/wfdownloads/images/icon/rate0.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:45 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-8.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:45 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/uploads/thumbs/148.jpg, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:46 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/images/icons/pm_small.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:48 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/images/s_poweredby.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru
[Sat Feb 05 05:01:50 2005] [error] [client 193.251.135.88] client denied by server configuration: I:/gi-2288/themes/Emerald-G/images/arrow-l.gif, referer: http://66.102.9.104/search?q=cache:FAoQ52eD9FcJ:gi.2288.org:88/modules/wfdownloads/down10-102.htm+Kaspersky+server+5.0+key&hl=ru

同样地被拒绝访问图片。

[Sat Feb 05 05:04:54 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip
[Sat Feb 05 05:05:03 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:13 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:19 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:22 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:25 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html
[Sat Feb 05 05:05:31 2005] [error] [client 195.19.252.183] client denied by server configuration: I:/gi-2288/uploads/Patch/kav_5.0.33.zip, referer: http://gi.2288.org/uploads/patch/index.html

试图下载 .zip文件，但被拒绝。

[client 195.19.252.183] PHP Warning: Unknown: A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0

被禁止访问了。

08.

bot 访问进程

[Sat Feb 05 05:11:58 2005] [error] [client 66.196.90.161] client denied by server configuration: I:/gi-2288/robots.txt

试图获取 robots.txt文件，但被拒绝。（我都不知道这样是好还是不好，不过还好没什么重要目录，比较重要在Apache加个密码就行）

[Sat Feb 05 06:01:49 2005] [error] [client 66.196.91.36] File does not exist: I:/gi-2288/modules/cdbase

Googlebot 在核对以前的内容。这个目录不存在，这就意味着在不久会被删除链接。

[Sat Feb 05 06:12:10 2005] [error] [client 66.196.90.161] client denied by server configuration: I:/gi-2288/robots.txt

又被拒绝访问 robots.txt。

[Sat Feb 05 06:22:48 2005] [error] [client 66.196.90.241] File does not exist: I:/gi-2288/modules/wordbook/wordpress
[Sat Feb 05 06:24:06 2005] [error] [client 66.196.90.207] File does not exist: I:/gi-2288/modules/newbb/wordpress
[Sat Feb 05 06:26:53 2005] [error] [client 66.196.91.20] File does not exist: I:/gi-2288/modules/cdbase
[Sat Feb 05 06:34:05 2005] [error] [client 66.196.91.19] File does not exist: I:/gi-2288/modules/cdbase

错误目录。

三、其它

01. 如何知道站点什么时候被 Spider扒窃?

这个其实很简单(Apache), 只要为站点建立日志文件就可以知道 搜索引擎是什么时候收录站点的了.
ErrorLog "G:/Apache/dummy-gi.2288.org.88-error_log"

不过我的作法可能有点另类,
因为我把 .txt文件全部都限制了,意思是:只有在本地链接中链过去的 .txt文件才允许被访问,
所以 Spider访问的时候会在站点日志中看到出错提示.

[Tue Feb 15 12:13:44 2005] [error] [client 66.249.64.77] client denied by server configuration: I:/zh-2288-66/robots.txt
这是虚拟主机中的第一个 robots.txt错误提示,也就是这个时候搜索引擎收录了该站点.

限制外部链接的内容:

SetEnvIfNoCase Referer "^http://gi.2288.org:88/" local_ref=1
<FilesMatch ".(gif|jpg|png|jpeg|zip|rar|exe|swf|txt)">
Order Allow,Deny
Allow from env=local_ref
</FilesMatch>

/****************************************************************/
*
* author : Emerald<btbtd@yahoo.com.cn>
*
* homepage : http://gi.2288.org:88/
*
* Seo-Gi : http://seo.2288.org:99
*
* sitename : 绿色学院 - Green Institute
*
* date : 2005-01-24
*
/****************************************************************/

Apache 日志 分析/研究 by Emerald 绿色学院 - Green Institute相关推荐

  1. win32 awstats 安装记 by Emerald 绿色学院 - Green Institute

    win32 awstats 安装记 by Emerald 绿色学院 - Green Institute 一. awstats 简介 二. 下载 awstats 三. 安装 awstats 四. 下载和 ...

  2. 正则表达式简介 -- 整理 by Emerald 绿色学院 - Green Institute

    目录: ------------------------------------------------------------------------------------ 1.正则表达式 2.早 ...

  3. CSDN Themes Design BY Emerald 绿色学院 - Green Institute

    :( 前段时间用 marvin3-brown.css 用得好好的, 不过管理员好像把模板的 Class 给改了, 只好重新选一个设计一下..... 希望这次可以用久一点. 样子选 blue: 效果预览 ...

  4. Hélène Rollès (伊梦莲) 六张专辑收藏 by Emerald 绿色学院 - Green Institute

    Hélène Rollès 法兰西歌手 Hélène Rollès (伊梦莲), 一个唱风悠闲的人, 偶喜欢, 偶就喜欢那些唱起歌来像在你耳朵边说悄悄话的音乐. 那首 我的名字叫伊梦莲 应该很多人熟悉 ...

  5. Color Scheme (Xoops Forum) By Emerald　绿色学院 - Green Institute

    Newbb Color Scheme /****************************************************************/ * <meta htt ...

  6. apache日志分析简介

    对apache的日志分析做下简单的介绍,主要参考apache官网的Log Files,手册参照 http://httpd.apache.org/docs/2.2/logs.html 一.日志分析 如果 ...

  7. Linux下Apache日志分析工具--AWStats安装使用

    source:http://blog.sina.com.cn/s/blog_5ce0e67e0100baf5.html http://doc.linuxpk.com/28437.html 1.事先安装 ...

  8. Windows IIS 日志分析研究（Log Parser Log Parser Lizard Log Parser Studio） update...

    Windows主要有以下三类日志记录系统事件:应用程序日志.系统日志和安全日志. 存放目录:X:\Windows\System32\winevt\Logs\ System.evtx  系统日志 App ...

  9. apache日志分析

    在apachelog中找出访问次数最多的10个IP awk '{print $1}' /usr/local/apache2/logs/access_log |sort|uniq -c|head -n  ...

最新文章

  1. java 注解scheduler_使用Scheduler
  2. 写Java程序要体现面向对象
  3. 强人工智能还有多远？先用10到20年突破这5个数学问题
  4. python抽象类的实现_python 抽象类、抽象方法的实现
  5. c# 如何在webbrowser控件执行一段JS代码
  6. arm linux 中断优先级,ARM中断处理过程
  7. matlab编程 英文翻译,MATLAB编程,MATLAB programming,音标,读音,翻译,英文例句,英语词典...
  8. 在Hive查询中如何显示列名
  9. Hadoop学习笔记目录
  10. 对计算机组装和维护课的总结,计算机组装与维护教师工作总结
  11. Pwn2Own 2021奥斯汀黑客大赛公布类别、目标及奖金
  12. hdu 1209 clocks wrong answer 我的错误代码（没审好题唉，角度一样后，还要按小时排序。...
  13. Matlab中的各种运算符的用法
  14. XNA Game Studio 2.0安装问题，崩溃了
  15. Linux配置jdk环境变量（详细版）
  16. phpspider 的简单使用
  17. 什么软件测试情侣头像,情侣头像另一半查找器
  18. 【历史上的今天】6 月 3 日：微软推出必应搜索引擎；Larry Roberts 启动阿帕网；Visual Basic 之父出生
  19. 图像处理+机器学习相关资源整合
  20. python爬考研_Python爬取考研必备单词

热门文章

  1. 字母c在计算机硬盘,字母c
  2. 使用 qiankun 集成应用时，出现的部分错误及解决方案
  3. 除了PMP，项目经理还有哪些证书值得考？
  4. 基于SECS协议开发的简明教程(5)
  5. 答学生问：研究生的论文工作需要创新吗？
  6. 运算符 狂神说Java随堂笔记
  7. 【15分】C. 最胖的加菲（类与对象+数组）
  8. 重装系统后运行“鲁大师（Z武器）”的漏洞修复功能下载的补丁安装失败
  9. 视频直播源码在ThinkPHP设置时区功能中的实现方式
  10. 基于大数据风控方向的大数据计算平台需求整理