To save some bandwidth.
Just to keep your bandwidth from getting hammered anna, I suggest you create a:the archived discussion . (the robots.txt file below is excellent for this…
Just to keep your bandwidth from getting hammered anna, I suggest you create a:the archived discussion . (the robots.txt file below is excellent for this purpose) User-agent: BoardReader Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: HTTrack Disallow: / User-agent: HTTrack 3 Disallow: / User-agent: NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / ) Disallow: / User-agent: NPBot Disallow: / User-agent: Plucker Disallow: / User-agent: Slurp Disallow: / User-agent: WebCapture 2 Disallow: / User-agent: WebCapture 3 Disallow: / User-agent: WebCopier Disallow: / User-agent: WebCopier v3.6 Disallow: / User-agent: Webinator-indexer Disallow: / User-agent: WebReaper Disallow: / User-agent: WebReaper ] Disallow: / User-agent: WebReaper ] Disallow: / User-agent: WebStripper Disallow: / User-agent: Wget Disallow: / User-agent: * Disallow: /forum