Shell Programming and Scripting

I have been working on a script all day and am having very little success. Essentially, I am reading a file and trying to format the data in the file. I am currently trying to put the data into three separate files, so that I can paste them back together into a single output file.

Trying to use the for and while loops are both giving me problems. The while loop only creates 1 file and leaves the other two blank. The for loop keeps giving me an error and yet it still presents my data to stdout, but not the output files. Here are the two methods I am trying to use.

exec < workunits-status.txt
while read line; do
cut -c 1-12 | sed "s/ //g" >> tempfile1.txt
cut -c 13-35 | sed "s/ //g" >> tempfile2.txt
cut -c 36 >> tempfile3.txt
done
paste tempfile1.txt tempfile2.txt tempfile3.txt >> workunits.txt


for i in `cat workunits-status.txt`
do
cut -c 1-12 $i | sed "s/ //g" >> tempfile1.txt
cut -c 13-35i $i | sed "s/ //g" >> tempfile2.txt
cut -c 36 $i >> tempfile3.txt
done


The while loop gives me tempfile1.txt with data, but not in the order of the workunits-status.txt file and does not create the other two files.

The for loop gives me the error below, yet it is showing the data that I am going after.

cut: cannot open : 1458
cut: bad list for c option
cut: cannot open : 1458
cut: cannot open : CustomActivity1
cut: bad list for c option
cut: cannot open : CustomActivity1
cut: cannot open : 3
cut: bad list for c option
cut: cannot open : 3
cut: cannot open : 1459
cut: bad list for c option
cut: cannot open : 1459
cut: cannot open : CustomActivity1
cut: bad list for c option
cut: cannot open : CustomActivity1
cut: cannot open : 3
cut: bad list for c option
cut: cannot open : 3

Can someone please help and explain why both of these are not working? Your help would be greatly appreciated. Please assume that all files are in the current working directory of the script. Also, only shell scripting. I am not experienced in Perl, expect, tcl or other languages. The use of sed and awk are ok.

My input file has three fields that I cannot format using the application utility that creates it. I have to format it afterwards. I need to break the three fields apart so that I can output it to a report that has three columns. The data fields should align under each column.

I initially tried to use the following syntax, but could not get it to work either:

exec < workunits-status.txt
while read line; do
if [[ $F1 -lt 100 ]];
then
awk -v F1="$FIELD1" F2="$FIELD2" F3="$FIELD3" '{print $F1 " " $F2 " " $F3}' >> workunits.txt
elif [[ $F1 -gt 99 && $F1 -lt 1000 ]];
then
awk F1="$FIELD1" F2="$FIELD2" F3="$FIELD3" '{print $F1 " " $F2 " " $F3}' >> workunits.txt
else
awk F1="$FIELD1" F2="$FIELD2" F3="$FIELD3" '{print $F1 " " $F2 " " $F3}' >> workunits.txt
fi
done

Where FIELD1, FIELD2, and FIELD3 are variables declared at the beginning of the script using the cut command as seen earlier in the two loop examples. And FIELD1 will be a numeric value ranging from 1 - 9999.

Hi,
There are some strange things going on in Your code; why do You want to exec the txt-file? In the first while loop the cut statement has no argument, in You first for loop the i is set to every word (not line) in the txt-file. And so on...

Could You give us a few lines from the text file that You want to process and an example of desired output?

/Lakris

Try this:

Code:

while read line; do
    echo "$line" | cut -c 1-12 | sed "s/ //g" >> tempfile1.txt
    echo "$line" | cut -c 13-35 | sed "s/ //g" >> tempfile2.txt
    echo "$line" | cut -c 36 >> tempfile3.txt
done <  workunits-status.txt
paste tempfile1.txt tempfile2.txt tempfile3.txt >> workunits.txt

The problem was that the first cut was reading the same standard input source as the while loop and consuming all of the input, leaving nothing for the remaining commands to read. Since you need to use the input line for all 3 cut commands you just need to use the contents stored in the line variable and send it to each individual cut.

Lakris, the exec < workunits-status.txt doesn't execute the text file, it assigns it as the default source of standard input.

A simpler awk solution would be something like:

Code:

awk '{print substr($0,1,12), substr($0,13,22), substr($0,36)}' workunits-status.txt > workunits.txt

Thanks for the feedback. Still not doing quite what I need. Here is a sample of the input. The first column has 12 characters with leading spaces. The last column is character #36.

Code:

           4 pftestAssert02b       3
          14 pftestCustom01b       3
          28 pftestAssert02b       3
          38 pftestCustom01b       3
         107 pftestAssert02b       3
         117 pftestCustom01b       3
         129 pftestAssert02b       3
         139 pftestCustom01b       3
        1043 VMOHMQTASK            3
        1044 VMOHMQTASK            3
        1045 VMOHMQTASK            3
        1073 email_test            3

Here is the expected output:

Code:

WorkUnits:             Process-Name:              Status:
4                      pftestAssert02b            3
14                     pftestCustom01b            3
28                     pftestAssert02b            3
38                     pftestCustom01b            3
107                    pftestAssert02b            3
117                    pftestCustom01b            3
129                    pftestAssert02b            3
139                    pftestCustom01b            3
1043                   VMOHMQTASK                 3
1044                   VMOHMQTASK                 3
1045                   VMOHMQTASK                 3
1073                   email_test                 3

The suggested awk script is getting me closer, however that is why I was using the while loop, so that when the workunit was less than 100, it would put in the two extra spaces needed in the output. When the number was between 100 -199, it would put in the extra space. The awk needs to remove leading spaces as well, which is what my sed after the cut was trying to accomplish.

Once again, any help would be greatly appreciated.

Sorry. The expected output has the columns lined up. The forum seems to have taken out the spaces.

This has been edited now with the [code] tags in this posting. The output should look correct.

Working now, for the most part. I have the columns aligning up as I would like. The only other thing I would like to do is trim the leading spaces out of the first field. I am using the awk script as suggested before. The only thing I added was to put spaces between the three fields. This essentially lines them up into separate columns as I need.

Now I just want to trim off the leading spaces of the first field so that the numbers show up at the beginning of the column and not at the end.

Edit your previous post and use [code]..[ /code] tags when you post data or code.