LINUX.ORG.RU

Re: Msnbot такой msnbot

Moscow is the capital of Russia

Somewho ★★ ()

Re: Msnbot такой msnbot

зы
а чо у тя msnбот не зобанен?

Somewho ★★ ()

Re: Msnbot такой msnbot

бань всех роботов к чертям, кроме яндекса и гугла.

opensuse ()

Re: Msnbot такой msnbot

Мне аватарка ответившего нравится, вполне подходит.

praseodim ★★★ ()
Ответ на: Re: Msnbot такой msnbot от gods-little-toy

Re: Msnbot такой msnbot

создают лишний трафик и срут в логи апача

пример с моей файлопомойки:

> 216.129.119.12 - - [27/Aug/2009:21:51:16 +0400] "GET /2009/03/05/zents-attar-oil-concentrate-petal/feed/ HTTP/1.0" 403 335 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 67.218.116.162 - - [27/Aug/2009:21:51:18 +0400] "GET /2009/02/01/similisan-pink-eye-relief-10-ml-liquid/ HTTP/1.0" 403 335 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.40 - - [27/Aug/2009:21:51:32 +0400] "GET /2008/04/06/the-art-of-shaving-pre-shave-oil-lavender/ HTTP/1.0" 403 339 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.42 - - [27/Aug/2009:21:51:42 +0400] "GET /2007/12/page/2/ HTTP/1.0" 403 298 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 67.218.116.164 - - [27/Aug/2009:21:51:44 +0400] "GET /2006/11/09/jansport-power-supply-tcx9-in-blackwhite-skulls-n-roses-sm-3v6/ HTTP/1.0" 403 359 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 67.218.116.130 - - [27/Aug/2009:21:51:45 +0400] "GET /2007/07/27/ahava-smoothing-moisturizer-day-normal-to-dry/ HTTP/1.0" 403 341 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.14 - - [27/Aug/2009:21:51:59 +0400] "GET /2009/01/14/baseball-louisville-7-l-screen-with-pillowcase-net-baseball-screens -baseball-nets/ HTTP/1.0" 403 381 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.43 - - [27/Aug/2009:21:52:01 +0400] "GET /2008/12/10/karin-herzog-foot-oil/ HTTP/1.0" 403 318 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 67.218.116.165 - - [27/Aug/2009:21:52:07 +0400] "GET /2008/09/21/Samsonite-24-in-Expandable-Spinner-Upright-Suiter-403xxx125-in-Oran ge/ HTTP/1.0" 403 365 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.10 - - [27/Aug/2009:21:52:18 +0400] "GET /2008/07/26/anthony-logistics-sun-stick-spf-15/ HTTP/1.0" 403 330 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.11 - - [27/Aug/2009:21:52:21 +0400] "GET /2007/11/22/clear-products-clear-shingles/ HTTP/1.0" 403 324 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.44 - - [27/Aug/2009:21:52:39 +0400] "GET /2008/11/09/lollia-believe-little-lux-eau-de-parfum/ HTTP/1.0" 403 337 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 216.129.119.12 - - [27/Aug/2009:21:52:45 +0400] "GET /2008/12/30/molton-brown-wonder-lips-booster/ HTTP/1.0" 403 329 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"

> 67.218.116.162 - - [27/Aug/2009:21:52:49 +0400] "GET /2009/02/13/baseball-adidas-mens-nba-houston-rockets-team-logo-knit-hat-nba-cap s-headwear/feed/ HTTP/1.0" 403 385 "-" "Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)"


естественно, никаких "/2009/03/05/zents-attar-oil-concentrate-petal/feed/" у меня нет :)

opensuse ()
Вы не можете добавлять комментарии в эту тему. Тема перемещена в архив.