The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > Top Forums > UNIX for Advanced & Expert Users
Google UNIX.COM


UNIX for Advanced & Expert Users Advanced UNIX and Linux questions go here. Expert-to-Expert.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
regular expressions whatever Shell Programming and Scripting 4 05-20-2007 01:30 PM
Help with regular expressions arushunter Shell Programming and Scripting 13 12-23-2006 08:31 PM
regular expressions jack1981 Shell Programming and Scripting 4 07-12-2006 12:10 PM
regular expressions in c++ szzz High Level Programming 2 10-06-2003 07:33 AM
Regular Expressions AresMedia Shell Programming and Scripting 1 08-22-2002 12:55 PM

Reply
 
Submit Tools LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 05-15-2008
Registered User
 

Join Date: Sep 2006
Posts: 40
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Reddit! Stumble this Post!Spurl this Post!
Regular Expressions

Hi,
below is a piece of code written by my predecessor at work.
I'm kind of a newbie and am trying to figure out all the regular expressions in this piece of code.
It is really a tough time for me to figure out all the regular expressions.

Please shed some light on the regular expressions in this code

ssh_list() {
typeset userAtHost="$1"
typeset dir="${2-.}"
typeset wild="${3-*}"

info "SSH list: $userAtHost $src $dst"

if [ "$REGION" != prod ] ;then
userAtHost=$LOGNAME@localhost
fi

# Save, disable, and restore the verbose flag - any
# verbose output would look like errors.
typeset verbose="$(set -o |sed -n 's/^verbose *//p')"
set +v
typeset msgs="$(sftp $userAtHost 2>&1 <<EOF
cd $dir
ls
EOF)"
if [ "$verbose" = on ] ;then
set -v
fi

# Strip the "Connecting to host..." line, prompts, blank lines
# and login banners. What's left should only be error messages.
typeset errs="$(echo "$msgs" |
sed -e '/^Connecting to .*\.\.\.$/d' \
-e 's/sftp > //g' \
-e '/^[ ]*$/d' \
-e '/^#/d' \
-e '/^[-dDlbcps][-rwxsStTlL]\{9\}+\{0,1\} /d')"

if [ "$errs" != "" ] ;then
error "$errs"
return 1
fi

echo "$msgs" |
while read line
do
case "$line" in -*\ $wild)
echo ${line##* }
;;esac
done

return 0
}

I'd like some explanation of these lines.... gurus please shed some light.

Thank you for your time.
Ram
Reply With Quote
Forum Sponsor
  #2 (permalink)  
Old 05-16-2008
era era is online now
Herder of Useless Cats
 

Join Date: Mar 2008
Location: /there/is/only/bin/sh
Posts: 2,253
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Reddit! Stumble this Post!Spurl this Post!
Quote:
Originally Posted by ramky79 View Post
# Save, disable, and restore the verbose flag - any
# verbose output would look like errors.
typeset verbose="$(set -o |sed -n 's/^verbose *//p')"
set +v
This one even has a comment to explain what it does. It disables verbose debugging (disables set -v if set), remembering the previous state of the flag in the verbose variable.

Quote:
# Strip the "Connecting to host..." line, prompts, blank lines
# and login banners. What's left should only be error messages.
typeset errs="$(echo "$msgs" |
sed -e '/^Connecting to .*\.\.\.$/d' \
-e 's/sftp > //g' \
-e '/^[ ]*$/d' \
-e '/^#/d' \
-e '/^[-dDlbcps][-rwxsStTlL]\{9\}+\{0,1\} /d')"
Again, the comments are probably better than any detailed attempt at going through the individual regular expressions. Any "Connecting to ..." line is removed. Any sftp> prompt is removed. Any empty line is removed. Any line beginning with a hash sign is removed. The last one looks vaguely like it's intended to remove directory listing output.

Quote:
echo "$msgs" |
while read line
do
case "$line" in -*\ $wild)
echo ${line##* }
;;esac
done
This prints any line from $msgs which matches a dash, followed by anything, followed by a space, followed by the value of the variable $wild, with everything up to the last space trimmed away. (None of this involves any regular expressions, strictly speaking; both the case statement and the ${var##subst} interpolation work with glob patterns.)

$wild is defined up at the beginning of the function as either positional argument $3 or (if that is empty) an asterisk, which matches anything in glob wildcard notation.
Reply With Quote
  #3 (permalink)  
Old 05-19-2008
Registered User
 

Join Date: Jun 2006
Posts: 148
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Reddit! Stumble this Post!Spurl this Post!
Mastering Regular Expressions

Get yourself a copy of Mastering Regular Expressions by Jeffrey Friedl. You'll benefit quite a bit from it.

Shawn
Reply With Quote
  #4 (permalink)  
Old 05-21-2008
Registered User
 

Join Date: Sep 2006
Posts: 40
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Reddit! Stumble this Post!Spurl this Post!
Thank you era and Shawn

The script however works fine on sunSSH
It does not work on an OPEN SSH, I tries to tweak in a little more with the regular expressions... but it still does not help.
Any idea how to overcome this problem.
when I execute the same script on OPEN SSH box here is the error I get.
If I logon interactively from the OPEN SSH box and execute the commands one by one, they work. when they are placed in a script the script doesnot work.any help is appreciated.

INFO: SSH list: user@host outgoing x001_ameint_*.zip
ERROR: #^M
ERROR: #==============================================^M
ERROR: #Bowne Marketing & Business Communications^M
ERROR: #SFTP Server (PCN)^M
ERROR: #==============================================^M
ERROR: #^M
ERROR: ^M
ERROR: sftp> sftp> drwx------ 0 0 0 0 May 21 15:25 .
ERROR: drwx------ 0 0 0 0 Mar 17 11:58 ..
ERROR: drwx------ 0 0 0 0 May 21 15:59 archive
ERROR: -rw------- 0 0 0 4152 May 9 11:44 x001_REPORTS_ameint_AIGODN00857.zip
ERROR: -rw------- 0 0 0 42138973 May 19 14:16 x001_ameint_BP010F0010_00002_003.zip.done
ERROR: -rw------- 0 0 0 377449320 Apr 14 14:20 x001_ameint_BP010F0010_00264_001.zip.done
ERROR: -rw------- 0 0 0 637950 May 21 13:40 x001_ameint_abc.zip
ERROR: -rw------- 0 0 0 408 May 21 13:49 x001_ameint_def.zip
ERROR: -rw------- 0 0 0 408 May 21 13:53 x001_ameint_xyz.zip
ERROR: sftp> Invalid command.^M
ERROR: sftp>

here are my tweaked regular expressions:
ssh_list() {
typeset userAtHost="$1"
typeset dir="${2-.}"
typeset wild="${3-*}"

info "SSH list: $userAtHost $dir $wild"

# Save, disable, and restore the verbose flag - any
# verbose output would look like errors.
typeset verbose="$(set -o |sed -n 's/^verbose *//p')"
set +v
typeset msgs="$(sftp $userAtHost 2>&1 <<EOF
cd $dir
ls -l
EOF)"

echo $msgs > TEXT.dat

if [ "$verbose" = on ] ;then
set -v
fi

# Strip the "Connecting to host..." line, prompts, blank lines
# and login banners. What's left should only be error messages.
typeset errs="$(echo "$msgs" |
sed -e '/^Connecting to .*\.\.\.$/d' \
# -e '/^ERROR: unable to initialize mechanism library [/usr/lib/gss/gl/mech_krb5.so]/d' \
-e '/ERROR: //g' \
-e 's/^$//g' \
-e 's/sftp> //g' \
-e '/^[ ]*$/d' \
-e '/^#/d' \
-e '/^[-dDlbcps][-rwxsStTlL]\{9\}+\{0,1\} /d')"

if [ "$errs" != "" ] ;then
error "$errs"
return 1
fi

echo "$msgs" |
while read line
do
case "$line" in -*\ $wild)
echo ${line##* }
;;esac
done

return 0
}


ssh_sendrecv() {
typeset op="$1"
typeset userAtHost="$2"
typeset src="$3"
typeset dst="$4"

info "SSH transfer: $op $userAtHost $src $dst"

#if [ "$REGION" != prod ] ;then
#userAtHost=$LOGNAME@localhost
#fi


# Save, disable, and restore the verbose flag - any
# verbose output would look like errors.
typeset verbose="$(set -o |sed -n 's/^verbose *//p')"
set +v
typeset msgs="$(sftp $userAtHost 2>&1 <<EOF
$op $src $dst
EOF)"
if [ "$verbose" = on ] ;then
set -v
fi

# Strip the "Connecting to host..." line, prompts, blank lines
# and login banners. What's left should only be error messages.
typeset errs="$(echo "$msgs" |
sed -e '/^Connecting to .*\.\.\.$/d' \
-e 's/^$//g' \
-e 's/sftp> //g' \
-e '/^[ ]*$/d' \
-e '/^#/d')"

if [ "$errs" != "" ] ;then
error "$errs"
return 1
fi

return 0
}
Reply With Quote
Google UNIX.COM
Reply

Thread Tools
Display Modes


The 50 most popular UNIX and Linux searches.
Google Search Cloud for The UNIX and Linux Forums
421 service not available, remote server has closed connection ^m automate ftp autosys awk trim bash eval bash exec bash for loop command copy/move folder in unix couldn't set locale correctly curses.h cut command in unix export command in unix find grep find mtime find null character in a unix file grep multiple lines grep or grep recursive hp-ux ifconfig inaddr_any inappropriate ioctl for device lynx javascript mailx attachment mget mtime ping port remove first character from string in k shell replace space by comma , perl script scp recursive segmentation fault(coredump) sftp script snoop unix stale nfs file handle syn_sent tar exclude tar extract to folder test: argument expected unix unix .profile unix forum unix forums unix internals unix interview questions unix mtime unix simulator unix.com vi substitute vi+substitute+end+of+line+character while loop within while loop shell script


All times are GMT -7. The time now is 04:14 AM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited.
The UNIX and Linux Forums Content Copyright ©1993-2008 The CEP Blog All Rights Reserved -Ad Management by RedTyger Visit The Global Fact Book

Content Relevant URLs by vBSEO 3.2.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101