Bill Jonas on Sat, 3 Feb 2001 14:38:27 -0500 (EST)


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: Beginner's problem, maybe with grep()


On Sat, Feb 03, 2001 at 12:59:55PM -0500, Susie J wrote:
> Thanks in advance for your help. This is really driving me crazy.

Do you know about the Web Robots Database?
(http://info.webcrawler.com/mak/projects/robots/active.html)  That might
be a better solution for you, because I might choose to view your
robots.txt if I'm curious or nosy.  ;)  And then you'd have "Mozilla/4.72
[en] (X11; U; Linux 2.2.18 i686)" (or thereabouts, depending on which
machine I'm using) listed as a user agent...

-- 
Bill Jonas                | "In contrast to the What You See Is What You
bill@billjonas.com        |  Get (WYSIWYG) philosophy, UNIX is the You
http://www.billjonas.com/ |  Asked For It, You Got It operating system."
http://www.debian.org/    |  --Scott Lee, as quoted by Lamb and Robbins
**Majordomo list services provided by PANIX <URL:http://www.panix.com>**
**To Unsubscribe, send "unsubscribe phl" to majordomo@lists.pm.org**