Shell Programming and Scripting

Is it possible to send a variable to a sed or cut command? I have a test script as below:

counter=1
while read line
do
# Test the file
printf "$line" > temp$counter
pref=$(cut c1-2000 $temp$counter | sed 's/[^a-zA-Z0-9+_:-]//g' | sed 's|.*PutTime\(.*)Origin.*|\1|')
printf" let counter=counter+1
done < temp01

What I would like is to avoid writing the $line to a file and the passing it to the pref=....... line. What I would like to do is say assign the contents of the $line to a variable, say, record and then use record in the cut/sed command. I can change the first sed with cut i.e. cut after sed instead of doing it first.

Code:

counter=1
while read line
do
# Test the file 
pref=$(echo $line | cut c1-2000 | sed 's/[^a-zA-Z0-9+_:-]//g' | sed 's|.*PutTime\(.*)Origin.*|\1|')
printf" let counter=counter+1
done < temp01

Just put pref=$(printf "$line" | cut ...)

However, be advised that this sounds like the tail wagging the dog. Reading a line at a time in a while loop and feeding it through a complex pipeline of shell commands with echo is rarely a good solution, and often a sign that you should approach the problem with a few lines of awk or sed which you run directly on the input file.

When I enter the *echo $line* | cut ...... I get a messages displayed saying *echo: command not found.

Any ideas?



I cant use print command because it doesn't like some characters within the data.

Era, How could I use awk or sed directly on the input file?

Any examples would be welcome

I don't see any *echo, did you mistype it?

Code:

awk '{ f=substr($0, 1, 2000); gsub (/[^a-zA-Z0-9+_:-]/, "", f);
    gsub (/^.*PutTime/, "", f); gsub (/Origin.*$/, "", f); print f }' temp01

This is rather unattractive but should hopefully give you an idea of how to proceed. In particular, the repeated gsubs and the substring extraction could probably be optimized if we knew more about the input data format.