最近正在研究web robots（web爬虫），发现了这个网站，难得多的资料，拿出来和大伙共享 :- )
http://www.robotstxt.org/wc/robots.html
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.exoweb.net/pipermail/python-chinese/attachments/20060209/e4442b0c/attachment.htm

On 2/9/06, Steve Chu <devforum at gmail.com> wrote:
> 最近正在研究web robots（web爬虫），发现了这个网站，难得多的资料，拿出来和大伙共享 :- )
> http://www.robotstxt.org/wc/robots.html
>
谢谢分享, 但是请注意这里是python maillist

--
simple is good
http://datastrategy.org/number5

Bruce可能误会了，我是想拿python实现web robots，而顺便查到的资料，所以在python的mail list里发也应该接受的了的。

On 2/9/06, Bruce Wang <number5 at gmail.com> wrote:
>
> On 2/9/06, Steve Chu <devforum at gmail.com> wrote:
> > 最近正在研究web robots（web爬虫），发现了这个网站，难得多的资料，拿出来和大伙共享 :- )
> > http://www.robotstxt.org/wc/robots.html
> >
> 谢谢分享, 但是请注意这里是python maillist
>
> --
> simple is good
> http://datastrategy.org/number5
>
> _______________________________________________
> python-chinese
> Post: send python-chinese at lists.python.cn
> Subscribe: send subscribe to python-chinese-request at lists.python.cn
> Unsubscribe: send unsubscribe to  python-chinese-request at lists.python.cn
> Detail Info: http://python.cn/mailman/listinfo/python-chinese
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.exoweb.net/pipermail/python-chinese/attachments/20060209/44a7b4ae/attachment.htm