User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130 Disallow: / User-agent: KAIST AITrc Crawler Disallow: / User-agent: * Disallow: external.html User-agent: * Disallow: /external.html