# file: robots.txt,v 1.0 2008/03/12 created by Tsing Kong # www.bizseas.com # 按照robots.txt的标准写法,规定一些不允许爬虫爬的页面或目录。 # robots.txt 的写法参照 # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- User-agent: * Disallow: /admin/ Disallow: /aspnet_client/ Disallow: /China11111/ Disallow: /data/ Disallow: /electronic11111/ Disallow: /jade11111/ Disallow: /logo/ Disallow: /WebEdit/ Disallow: /include/ Disallow: /admin.asp Disallow: /clothing/123456/ Disallow: /clothing/admin/ Disallow: /clothing/cert/ Disallow: /clothing/data/ Disallow: /clothing/include/ Disallow: /clothing/webEdit/ Disallow: /clothing/admin.asp Disallow: /watch/123456/ Disallow: /watch/admin/ Disallow: /watch/cert/ Disallow: /watch/data/ Disallow: /watch/include/ Disallow: /watch/webEdit/ Disallow: /watch/admin.asp Disallow: /Hangbag/123456/ Disallow: /Hangbag/admin/ Disallow: /Hangbag/cert/ Disallow: /Hangbag/data/ Disallow: /Hangbag/include/ Disallow: /Hangbag/webEdit/ Disallow: /Hangbag/admin.asp Disallow: /sunglasses/123456/ Disallow: /sunglasses/admin/ Disallow: /sunglasses/cert/ Disallow: /sunglasses/data/ Disallow: /sunglasses/include/ Disallow: /sunglasses/webEdit/ Disallow: /sunglasses/admin.asp Disallow: /shoes/123456/ Disallow: /shoes/admin/ Disallow: /shoes/cert/ Disallow: /shoes/data/ Disallow: /shoes/include/ Disallow: /shoes/webEdit/ Disallow: /shoes/admin.asp Disallow: /pants/123456/ Disallow: /pants/admin/ Disallow: /pants/cert/ Disallow: /pants/data/ Disallow: /pants/include/ Disallow: /pants/webEdit/ Disallow: /pants/admin.asp Disallow: /others/123456/ Disallow: /others/admin/ Disallow: /others/cert/ Disallow: /others/data/ Disallow: /others/include/ Disallow: /others/webEdit/ Disallow: /others/admin.asp Disallow: /Jewelryoffering/123456/ Disallow: /Jewelryoffering/admin/ Disallow: /Jewelryoffering/cert/ Disallow: /Jewelryoffering/data/ Disallow: /Jewelryoffering/include/ Disallow: /Jewelryoffering/webEdit/ Disallow: /Jewelryoffering/admin.asp Disallow: /Oilpaintings/123456/ Disallow: /Oilpaintings/admin/ Disallow: /Oilpaintings/cert/ Disallow: /Oilpaintings/data/ Disallow: /Oilpaintings/include/ Disallow: /Oilpaintings/webEdit/ Disallow: /Oilpaintings/admin.asp