迷惑bot「MJ12bot」のアクセスを規制する

なんか重いなと思ってアクセスログみたら迷惑botで有名？な「MJ12bot」ってのがたくさんアクセスしてきていました。

69.30.198.242 - - [13/Jan/2016:12:19:35 +0900] "GET /feed?c=83919 HTTP/1.0" 301 0 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:19:41 +0900] "GET /feed/?c=83919 HTTP/1.0" 200 36618 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:20:03 +0900] "GET /feed?c=83940 HTTP/1.0" 499 0 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:20:23 +0900] "GET /feed?c=83946 HTTP/1.0" 301 0 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:20:30 +0900] "GET /feed/?c=83946 HTTP/1.0" 200 36618 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:20:34 +0900] "GET /feed?c=83949 HTTP/1.0" 301 0 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:20:45 +0900] "GET /feed/?c=83949 HTTP/1.0" 200 36618 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:20:59 +0900] "GET /feed?c=83953 HTTP/1.0" 301 0 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:21:21 +0900] "GET /feed/?c=83953 HTTP/1.0" 200 22403 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"
69.30.198.242 - - [13/Jan/2016:12:21:26 +0900] "GET /feed?c=83956 HTTP/1.0" 301 0 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)" "-"

今回は、こいつのアクセスの規制方法を書きます。

robot.txtで「MJ12bot」を規制

vi robot.txt
User-agent: MJ12bot
Disallow: /