I need a little help as I am a complete novice at scripting in unix. However, i am posed with an issue... i have two csv files in the following format@

FILE1.CSV:
HEADER
HEADER
Header
, , HEADER
001X ,,200
002X ,,300
003X ,,300
004X ,,300


FILE2.CSV:
HEADER
HEADER
Header
, , HEADER
001X ,,300
003X ,,500
005X ,,600
006X ,,100


I need the above to files to merged into on final file as below:

FINAL_MERGED.CSV:
HEADER
HEADER
Header
, , HEADER
001X ,,300
002X ,,300
003X ,,500
004X ,,300
005X ,,600
006X ,,100


I have tried using the join command but that only lets me to join the two files but as you can see from the above i need the ability to be able to overwrite values from file 1 whith those in file 2.

Any assistance would be greatly appreciated.
Thanks

anybody outhere with a clue???

Could you clarify the logic?
Why you want 005X to be 100 and not 600?

Sorry my mistake that was due to a typo. I have edited and amended above as required.

The logic behing it is that the first csv (FILE1.CSV) file is produced but may have incorrect figures associated with it. Once the information is readily available the second csv (FILE2.CSV) is produced with the correct figures and any missing codes.

Once this has been done file 1 and file 2 need to be merged to have the correct figures from file 2 and also to include any missing codes that are on file 2 but not file 1.

I need to do this in Unix, my initial thoughts were to use the join command but not sure if this is possible but may be some use of lookup could be done... again i am a programming and unix newbie so would appreciate any assistance.

Thanks

Use nawk or /usr/xpg4/bn/awk on Solaris.
You may need to modify the code, if the format of your input doesn't match exactly the samples you posted.

Thanks for your help, however i am unable to get teh code above to work.
I have had some assistance with the above from anothe forumite who gave me the following code:

#!/bin/ksh
cat file1.csv file2.csv >> temp
grep X temp | cut -d"," -f1 | sort -u > final2
while read line
do
line1=`grep $line file2.csv`
if [ $? -eq 0 ]
then
echo $line1 >> final_out
else
line2=`grep $line file1.csv`
echo $line2 >> final_out
fi
done < final2


If anyone could explain in detail as to what is happening in the loop that would be great... i have tested the above and it works like a dream but i want to learn rather than just use code. I am a complet novice so would like a description in a basic level which will help me understand for future.

Thanks to everyone who has helped so far

Hi .. as written I tried to implement the logic.....I could successfully do the concatenation....but my file "final_2" is blank.....