分享草榴社区和sex8的robots文件

今天很无聊,分享下草*榴 社区和s e x 8的robots.txt文件吧,两者都是基于phpwind程序搭建的,相信使用这个建站程序的人会比较感兴趣。

先来草榴的:

#
# robots.txt for PHPWIND BOARD
# Version 5.x
#

User-agent: *
Disallow: /admin/
Disallow: /require/
Disallow: /hack/
Disallow: /attachment/
Disallow: /images/
Disallow: /data/
Disallow: /ipdata/
Disallow: /template/
sex8
再来s e x 8的:
# # robots.txt for PHPWind 
# Version 7.5 # 
User-agent: * 
Disallow: /admin/ 
Disallow: /api/ 
Disallow: /apps/ 
Disallow: /attachment/ 
Disallow: /data/ 
Disallow: /hack/ 
Disallow: /images/ 
Disallow: /ipdata/ 
Disallow: /js/ 
Disallow: /lang/ 
Disallow: /lib/ 
Disallow: /mode/ 
Disallow: /require/ 
Disallow: /template/ 
Disallow: /active.php 
Disallow: /admin.php 
Disallow: /adminWfvkW.php 
Disallow: /ajax.php 
Disallow: /ck.php 
Disallow: /forumcp.php 
Disallow: /job.php 
Disallow: /member.php 
Disallow: /message.php 
Disallow: /post.php 
Disallow: /profile.php 
Disallow: /pw_ajax.php 
Disallow: /pw_api.php 
Disallow: /pw_app.php 
Disallow: /survey.php 
Sitemap: http://sex8.cc/sitemap_index.xml
看得出来,后者比前者更用心一点,把最基本的sitemap地址都附上了,这是SEO的标准做法。

7 thoughts on “分享草榴社区和sex8的robots文件

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Posts

Begin typing your search term above and press enter to search. Press ESC to cancel.