Hi Methyle,

Thank you for your concern and help man. I agree the script must be a disaster for sure.
The Specifications are :

1) Will copy the data to a subfolder and rename them as .CSV files. Which now successfully being achieved by the following code:

Code:

#!/bin/bash
# copying MCE Repricing ASPRODUCTSUMMARY

cd /u02/sppdw/dw/infa_shared/SrcFiles/POPS;
for files in $(ls *.MCESOLUTION);do $(cp -v $files 'UNPROCESSED/ASPRODUCTSUMMARY/'${files%.MCESOLUTION}.CSV); done;
exit 0;

2) Delete all the lines from each file which are not having "ASPRODUCTSUMMARY" word in the file in the subdirectory files were copied(that's why the original files provided were copied so that we don't destroy the entire data but have our own version of file copied and deleting all unwanted lines). This is also being successfully achieved by the following code:

Code:

#!/bin/bash
# MCE Repricing ASPRODUCTSUMMARY ONLY DATA

cd /u02/sppdw/dw/infa_shared/SrcFiles/POPS/UNPROCESSED/ASPRODUCTSUMMARY;
####ls -1 /u02/sppdw/dw/infa_shared/SrcFiles/POPS/UNPROCESSED/ASPRODUCTSUMMARY > ListofMCECSVFilesASPRODUCTSUMMARY.txt
FOLDERDIR='/u02/sppdw/dw/infa_shared/SrcFiles/POPS/UNPROCESSED/ASPRODUCTSUMMARY';
cd $FOLDERDIR;

for i in $(ls -l | grep '^-' | awk '{print $9}')
do  
$(grep -i "^..............ASPRODUCTSUMMARY"< "$i" > newfile);
$(mv -v "newfile" "$i"); done;
exit 0;

3) In each file modified with the lines required. Want append each line of each file with CASEID and STUDYTYPE which are extracted from the filename itself. For example if the filename is 1400009823_RTBM_20120614_1715_0_0_0_002.CSV so the caseid ='1400009823' and studytype='RTBM'. So this should repeat for each file and append in front of each line. This is the challenge () right now.
The code for this which is giving syntax error : When running while loop for individual file one by one it runs perfectly fine, but gives syntax error when trying to run for multiply files using "for loop".

Code:

#!/bin/bash
# MCE Repricing ASPRODUCTSUMMARY Append Casid n studytype in each line

cd /u02/sppdw/dw/infa_shared/SrcFiles/POPS/UNPROCESSED/ASPRODUCTSUMMARY;
####ls -1 /u02/sppdw/dw/infa_shared/SrcFiles/POPS/UNPROCESSED/ASPRODUCTSUMMARY > ListofMCECSVFilesASPRODUCTSUMMARY.txt
FOLDERDIR='/u02/sppdw/dw/infa_shared/SrcFiles/POPS/UNPROCESSED/ASPRODUCTSUMMARY';
cd $FOLDERDIR;

for i in '$(ls -l)'
do
caseid=$(echo "$i" | cut -c1-10)
studytype=$(echo "$i" | cut -c12-15)
prefix="$caseid,$studytype,"
while read -r line
do echo "${prefix}$line" ;done< "$i" > "temp.CSV"; $(mv -v "temp.CSV" "$i");
done;
exit 0;

I did try putting

Code:

for i in "$(ls -l)"

on line 10 in single quote, double quote. ; before do, nothing helps resolving the syntax error.
Thank you