Shell Programming and Scripting

In part of my script I use awk to pull out the urls.

awk '{print $8}' then I take them and send them to grep.`

Some of them are straight .com/ or .org or whatever (address bar entries), while others are locations of images, js, etc.

I'm trying to only pull any line that ends with .com/ .org/ .net/ and regexs are truly not my strong suit.

Grep 'ing this is not working:
(.com/|.org/|.net/)$

Any takers?

You need egrep to do that.

Code:

 egrep "\.(com|org|net)/?$"

You need to use extended-regex, and you should escape dot, the dot in your regex will match any character since it is not escaped.

Code:

grep -E '(\.com/|\.org/|\.net/)$'

Try:

Code:

awk '/\.com/  || /\.org/ || /\.net/ {print $8}'

If this isn't what you're looking for, post some lines of the log file and the desired output.

ugh. I tried, but because I'm a new user I'm not allowed to post links. The log file get's awk'ed out like this:

xttp://google.com/
xttp://www.google.com/
xttp://www.google.com/images/srpr/nav_logo66.png
xttp://www.google.com/extern_js/f/CgJlbhICdXMrMEBk.js
xttp://www.google.com/extern_chrome/d5ae566c3d2b6958.js
xttp://www.google.com/gen_204?
xttp://clients1.google.com/generate_204
xttp://www.google.com/csi?
xttp://ssl.gstatic.com/gb/js/sem_bc5...51d64763093.js

and I just want the lines that end with .com

I suggest you use Perl to parse access logs, it's more powerful and easier to handle complicated cases with it.
I often use a single Regex in Perl to extract all the desired fields from the log file.

Have you tried this?

Code:

awk '/\.com/  || /\.org/ || /\.net/ {print $8}' logfile