Help with awk/shell script


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with awk/shell script
# 1  
Old 07-21-2007
Help with awk/shell script

I would like to write a shell script which will read a list of filenames(with absolute paths) from a file and then determine the just filename component (without the absolute path and the file extension) and the file extension (if any)

The example list of filenames are as below :

/home/mark.williams/a.java
/usr/local/bin/perl
/usr/local/bin/gtar
/usr/local/packages/abcd.efgh.ijkl.mnop.xml

So the filenames may or may not have extensions and also, the filenames might have special characters like ".", "_" embedded in them.

Any help will be really appreciated!
# 2  
Old 07-21-2007
Quote:
Originally Posted by inditopgun
I would like to write a shell script ....
so where is your shell script?
here's mine:
Code:
awk 'BEGIN{FS="/"}{print $NF}' file

# 3  
Old 07-22-2007
Here is my script

for cfilename in `cat filelist.txt | sort -u`
do
file_extension=`echo $cfilename | awk -F\/ '{print $NF}' | awk -F. '{print $NF}'`
export file_extension
filename=$(basename $cfilename | awk -F. -v OFS=. '{$NF=""; sub("[.]$", ""); print}')
export filename
filename_w_ext=$filename.$file_extension
export filename_w_ext
done

But the problem this script craps out when it encounters files with NO extensions e.g. /usr/local/bin/perl
So I have to make it little more robust to handle these scenarios where filenames having no extensions can also exist.

I guess, your script just returns the last field (NF) of the record, which unfortunately doesn't solve my problem. But thanks for responding to my post.
# 4  
Old 07-22-2007
For filenames with no embedded new lines:
Code:
$ cat infile
/home/mark.williams/a.java
/usr/local/bin/perl
/usr/local/bin/gtar
/usr/local/packages/abcd.efgh.ijkl.mnop.xml

$ while read;do f="${REPLY##*/}";echo "${f%.*}";done<infile
a
perl
gtar
abcd.efgh.ijkl.mnop

With zsh:

Code:
while read;do print "$REPLY:t:r";done<infile

If your filenames have no embedded spaces or other pathological characters:

With zsh:

Code:
set -- $(<infile)
print -l "$@:t:r"


And if your extension is .tar.gz?
# 5  
Old 07-23-2007
Thanks for your reply!

Your solution works fine to get the filename componet (without the extension) and so does mine.

My problem is getting the file extension (especially returning null when there is no extenson per se e.g. /usr/local/bin/perl) That's the part which I am struggling with.

Also, if the file is /tmp/abcde.tar.gz, I would like to return "gz" as the extenion.
# 6  
Old 07-23-2007
Quote:
Originally Posted by inditopgun
[...]
My problem is getting the file extension (especially returning null when there is no extenson per se e.g. /usr/local/bin/perl) That's the part which I am struggling with.
[...]
Could you post the expected output?
# 7  
Old 07-23-2007
Code:
while read mLine
do
  mNameAndExt=`basename $mLine`
  mName=`echo $mNameAndExt | sed 's;\(.*\)\..*;\1;'`
  if [ ${#mNameAndExt} -eq ${#mName} ]; then
    mExt=''
  else
    mExt=`echo $mNameAndExt | sed 's/.*\.//'`
  fi
done < input_file


Last edited by Shell_Life; 07-23-2007 at 03:39 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to call and sort awk script and output

I'm trying to create a shell script that takes a awk script that I wrote and a filename as an argument. I was able to get that done but I'm having trouble figuring out how to keep the header of the output at the top but sort the rest of the rows alphabetically. This is what I have now but it is... (1 Reply)
Discussion started by: Eric7giants
1 Replies

2. UNIX for Dummies Questions & Answers

Passing shell script parameter value to awk command in side the script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff |... (1 Reply)
Discussion started by: Sarita Behera
1 Replies

3. Shell Programming and Scripting

Unable to pass shell script variable to awk command in same shell script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk... (2 Replies)
Discussion started by: Ashunayak
2 Replies

4. Post Here to Contact Site Administrators and Moderators

Unable to pass shell script parameter value to awk command in side the same script

Variable I have in my shell script diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk -F'~' ''$2 == "$id"' {print $0}' > $new I could see value of $id is not passing to the awk... (0 Replies)
Discussion started by: Ashunayak
0 Replies

5. Shell Programming and Scripting

Calling shell script within awk script throws error

I am getting the following error while passing parameter to a shell script called within awk script. Any idea what's causing this issue and how to ix it ? Thanks sh: -c: line 0: syntax error near unexpected token `newline' sh: -c: line 0: `./billdatecalc.sh ... (10 Replies)
Discussion started by: Sudhakar333
10 Replies

6. Shell Programming and Scripting

Call shell script function from awk script

hi everyone i am trying to do this bash> cat abc.sh deepak() { echo Deepak } deepak bash>./abc.sh Deepak so it is giving me write simply i created a func and it worked now i modified it like this way bash> cat abc.sh (2 Replies)
Discussion started by: aishsimplesweet
2 Replies

7. Shell Programming and Scripting

want to pass parameters to awk script from shell script

Hello, I have this awk script that I want to execute by passing parameters through a shell script. I'm a little confused. This awk script removes duplicates from an input file. Ok, so I have a .sh file called rem_dups.sh #!/usr/bin/sh... (4 Replies)
Discussion started by: script_op2a
4 Replies

8. Shell Programming and Scripting

create a shell script that calls another script and and an awk script

Hi guys I have a shell script that executes sql statemets and sends the output to a file.the script takes in parameters executes sql and sends the result to an output file. #!/bin/sh echo " $2 $3 $4 $5 $6 $7 isql -w400 -U$2 -S$5 -P$3 << xxx use $4 go print"**Changes to the table... (0 Replies)
Discussion started by: magikminox
0 Replies

9. UNIX for Advanced & Expert Users

AWK instead of Shell script

I've a list file, which has some file names. ex: list file "list_file" will have data_file1.txt data_file2.txt data_file3.txt : : data_filen.txt Above files will have the below layout: Header1 Header2 *TM* Data record 1 Datarecord 2 Datarecord n *TM* (19 Replies)
Discussion started by: Lokesha
19 Replies

10. Shell Programming and Scripting

using shell script or awk......

suppose my one file has >1|lol|hai i am cdfd dafvshbejndjnudbnjdbyebjcb bdhbdjndjndmdkmdkldhddjndj dbdhbndjndjmdklm sjskndknsknsknks sbsjksnknsknknklsl >2|lol|hai ia m cdfd123 jbsjbjbjbjbjbjbjbjbjbj jkbkkkkkkkkkkkkk khkkkkkkkkkkkkk scbjbjbakbqlblabkla >3lol|hai ia m cdfd3435... (2 Replies)
Discussion started by: cdfd123
2 Replies
Login or Register to Ask a Question