|
[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]
|
Re: Beginner's problem, maybe with grep()
|
On Sat, Feb 03, 2001 at 12:59:55PM -0500, Susie J wrote:
> Thanks in advance for your help. This is really driving me crazy.
Do you know about the Web Robots Database?
(http://info.webcrawler.com/mak/projects/robots/active.html) That might
be a better solution for you, because I might choose to view your
robots.txt if I'm curious or nosy. ;) And then you'd have "Mozilla/4.72
[en] (X11; U; Linux 2.2.18 i686)" (or thereabouts, depending on which
machine I'm using) listed as a user agent...
--
Bill Jonas | "In contrast to the What You See Is What You
bill@billjonas.com | Get (WYSIWYG) philosophy, UNIX is the You
http://www.billjonas.com/ | Asked For It, You Got It operating system."
http://www.debian.org/ | --Scott Lee, as quoted by Lamb and Robbins
**Majordomo list services provided by PANIX <URL:http://www.panix.com>**
**To Unsubscribe, send "unsubscribe phl" to majordomo@lists.pm.org**
|
|