Walt Mankowski on 24 Aug 2018 12:29:13 -0700 |
[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]
Re: [PLUG] shell scripting help |
The linux subsystem on Windows 10 gives you a shell prompt and most of your favorite command line tools. On Fri, Aug 24, 2018 at 02:19:38PM -0400, Will wrote: > Install git, use git bash if a VM is not possible. I think Rich Freeman > said something in the past about Gentoo Prefix and cygwin being pretty nice > if you want something more light weight than a VM with all your bash tools > and toys. > > -Will C > > On Fri, Aug 24, 2018, 13:58 Michael Lazin <microlaser@gmail.com> wrote: > > > Thanks JP! I remember meeting you at a few plug meetings. I actually > > live very close to where plug central meets but still work in the distant > > suburbs so it's hard to make it to meetings. I am going to be at FOSSCON > > but I'm not sure what time. > > > > On Fri, Aug 24, 2018 at 1:50 PM, JP Vossen <jp@jpsdomain.org> wrote: > > > >> Ouch, sorry to hear about the Windows part. :-) I'm forced to use a > >> Windows laptop at $WORK and loath it, I do all my real work on a Mint VM > >> thought running it on top of Windows is like building a house on sand (I > >> snapshot it a lot). > >> > >> I know you got your script working, but all those greps are inefficient > >> because each `|` is another sub-shell. The following is untested since I > >> don't have your data, and I merged all the `grep -v` to *before* the sort > >> which might break something though I don't see how it could. I also broke > >> the long lines before some MUA or MTA does it for me. Don't use before > >> testing well! Of course. > >> > >> Prompted: > >> ---- > >> #!/bin/bash - > >> # Add date and comment here > >> > >> read -p "What is the filename you want to grep? " file_name > >> egrep '\b[A-Z]+| [0-9:]+ \b' "$file_name" \ > >> | egrep -v 'anaged|No|Na|Ser|Ty|Contact' | sort -u > >> ---- > >> > >> From command line: > >> ---- > >> #!/bin/bash - > >> # Add date and comment here > >> > >> # Usage:: <script name> <file name> > >> egrep '\b[A-Z]+| [0-9:]+ \b' "$1" \ > >> | egrep -v 'anaged|No|Na|Ser|Ty|Contact' | sort -u > >> ---- > >> > >> Various rambling: > >> > >> Always add at least a comment and ideally a day, describing your > >> *intent*. You will thank yourself 6 months from now. > >> > >> You can use `read -p` to get rid of the `echo`. > >> > >> Try `help read` since `man read` will probably give you the Bash man > >> page, which is good reading but not really helpful in a case like this. > >> `help` gives help on bash built-ins like `read`, `set`, `test` (really > >> useful) and lots more. > >> > >> As pointed out elsewhere, giving it the file name on the command line is > >> more Unix-y, so there's a versions does that. Actually, using it as a > >> "filter" would be even more Unix-y, but one thing at a time. :-) > >> > >> There is also obviously zero sanity or error checking, though in this > >> case that's not a big deal. > >> > >> You don't need ';' statement terminators. They don't hurt, but they are > >> unnecessary noise. > >> > >> The trailing "-" in the shebang line `#!/bin/bash -` protects against an > >> ancient kernel vulnerability. I'm not even 100% sure it still matters, but > >> it can't hurt and it's arguably a good habit. > >> > >> Semi-related, I like doing "top N" lists like: > >> <stuff> | sort | uniq -c | sort -rn | head -n10 > >> > >> > >> There are tools (getclip.exe and putclip.exe) that let you read/write the > >> windows clipboard from the command line. I've never tried those in WSL, > >> but they used to be GREAT with the UnxUtils to grab a column of, say, IPAs > >> from a spreadsheet and: > >> getclip | sort | uniq -c | sort -rn | head -n10 | putclip > >> > >> See my very old and not really relevant to WSL pages at: > >> * https://www.jpsdomain.org/windows/win-tools.html > >> * https://www.jpsdomain.org/windows/winshell.html > >> > >> > >> On 08/24/2018 12:42 PM, Michael Lazin wrote: > >> > >>> Thank you all, it's working now. I actually am not in the role of being > >>> a Linux user right now. Maybe that is why interactive scripts appeal to me > >>> lol. I did forensics on Debian web servers for 10 years and lost my job > >>> and ended up finding a job as a Windows sysadmin rather quickly and took it > >>> because it beats no job. I installed the linux subsystem for Windows > >>> because I do love bash and have found it useful for getting some mundane > >>> tasks done. I am also learning powershell, I know it stands against > >>> everything in this group, but I keep telling myself knowing two OS's will > >>> eventually work to my advantage. Thanks. > >>> > >>> On Fri, Aug 24, 2018 at 12:28 PM, prushik <prushik@gmail.com <mailto: > >>> prushik@gmail.com>> wrote: > >>> > >>> Very few Linux users enjoy interactive scripts, but whatever floats > >>> your boat. > >>> Your script has a few issues, but the biggest is that you seem to be > >>> confusing bash and php. $ is not a variable indicator in bash, its > >>> an expansion operator. This means that your read $i line gets > >>> expanded to read "", since i is unset at the beginning of the script. > >>> > >>> Also remove done from the end of the script since you have no > >>> corresponding do. > >>> > >>> > >>> > >>> Sent from my device. > >>> ---- Original message ---- > >>> From: Anthony Martin <anthony.j.martin142@gmail.com > >>> <mailto:anthony.j.martin142@gmail.com>> > >>> Sent: 08/24/2018 12:12:24 > >>> To: Philadelphia Linux User's Group Discussion List > >>> <plug@lists.phillylinux.org <mailto:plug@lists.phillylinux.org>> > >>> Subject: Re: [PLUG] shell scripting help > >>> > >>> Have you tried setting it so you give the file name as an argument > >>> when you run the script? ./Script FILENAME > >>> > >>> Anthony Martin > >>> > >>> Linux System Administrator > >>> > >>> > >>> > >>> On Fri, Aug 24, 2018 at 12:04 PM Michael Lazin <microlaser@gmail.com > >>> <mailto:microlaser@gmail.com>> wrote: > >>> > >>> I am trying to write a shell script to automate the formatting > >>> of a text file in a certain way that is useful to me. the > >>> complicated egrep while not ideal does the job when run alone, > >>> where $i is the name of the file I want to grep, but when I try > >>> put it together in an easy to run script it doesn't do > >>> anything. Can someone please point me in the right direction? > >>> Thank you. > >>> > >>> #!/bin/bash > >>> echo "What is the filename you want to grep?"; > >>> read $i; > >>> OUTPUT="$(egrep '\b[A-Z]+| [0-9:]+ \b' $i | grep -v anaged | > >>> grep -v No| sort -u | grep -v Na | grep -v Ser | grep -v Ty | > >>> grep -v Contact)"; > >>> echo "${OUTPUT}"; > >>> done > >>> > >> > >> > >> Later, > >> JP > >> -- ------------------------------------------------------------------- > >> JP Vossen, CISSP | http://www.jpsdomain.org/ | http://bashcookbook.com/ > >> > >> > >> ___________________________________________________________________________ > >> Philadelphia Linux Users Group -- > >> http://www.phillylinux.org > >> Announcements - > >> http://lists.phillylinux.org/mailman/listinfo/plug-announce > >> General Discussion -- > >> http://lists.phillylinux.org/mailman/listinfo/plug > >> > > > > > > > > -- > > Michael Lazin > > > > to gar auto estin noein te kai ennai > > ___________________________________________________________________________ > > Philadelphia Linux Users Group -- > > http://www.phillylinux.org > > Announcements - > > http://lists.phillylinux.org/mailman/listinfo/plug-announce > > General Discussion -- > > http://lists.phillylinux.org/mailman/listinfo/plug > > > ___________________________________________________________________________ > Philadelphia Linux Users Group -- http://www.phillylinux.org > Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce > General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug
Attachment:
signature.asc
Description: PGP signature
___________________________________________________________________________ Philadelphia Linux Users Group -- http://www.phillylinux.org Announcements - http://lists.phillylinux.org/mailman/listinfo/plug-announce General Discussion -- http://lists.phillylinux.org/mailman/listinfo/plug