Shell Programming and Scripting

Although this will work well with come versions of awk, the standards say that the behavior of awk is unspecified if the value of RS contains more than one character. On OS X (and several other systems), the above code will just use "S" as the record separator and ignore the "OH".

Hello guys,

Thanks for your valueble help. I did some investigation and tried all of your suggested solutions. So I finally solved my problem. Here is the solution that I used.

Code:

N='0'
ls *.[Tt][Xx][Tt] | while read line
do
cat $line > file$N
csplit -f $line file$N '/^SOH/' '{*}'
N=$((N+1))
done

Thanks again.

The following should do exactly the same thing and user fewer system resources:

Code:

N='0'
for line in *.[Tt][Xx][Tt]
do
cat $line > file$N
csplit -f $line file$N '/^SOH/' '{*}'
N=$((N+1))
done

In cases where *.[Tt][Xx][Tt] expands to a long list of files, the for loop should still work correctly even though the ls command could fail due to ARG_MAX limitations.

Hi Don Cragun,

Yes, your right. In this environment, all text files that we want to split are located in separate directory. And their names include date like 201410201653.INP, so I have changed list command to below.

Code:

cd /path/to/directory/
*
ls 20*.INP | while read line

Also output files of csplit named incorrectly. Example, 201410201653.INP01, ***02, **03 etc. So I'm going to rename them in script like 201410201653_01.INP

Also, I have added '-n 3' option to csplit command. Because csplit max output limit reached at 99 files.

Code:

csplit -f $line -n 3 file$N '/^SOH/' '{*}'

---------- Post updated at 05:16 PM ---------- Previous update was at 05:00 PM ----------