I am posting everything. I used awk to filter specific fields which i wanted from my bill data file and then write a new file with comma seperated values after the '=' sign, . I am able to do with this bash script but when i write a file using >> filename in script it give '\' as shown at the end. On the other hand if i dont use >> filename and display on screen it shows exactly as i wish. If there is any other way to do it plz help me.
----------------------
my script:
----------
#!/bin/bash
for file in $(ls -ld bill*);
do
{
if [[ "$file" == bill* ]]; then
{
gawk -F, '$21~/ELAPS/ && $21!~/ELAPSED-TIME=0/ { for (i=1;i<NF;i++) dataarr[ $1, ",", $2, ",", $5, ",", $6, ",", $9, ",", $10, ",", $13, ",", $14, ",", $15, ",", $16, ",", $18, ",", $19, ",", $21, ",", $23, ",", $24, ",", $25, ",", $26, ",", $33 ]++ }
END {
for ( words in dataarr )
print words
}
' $file | sed -e 's/[^,]*=//g' >> /usr/local/speech/billing/archive/$file

gawk -F, '$18~/ELAPS/ && $18!~/ELAPSED-TIME=0/ { for (i=1;i<NF;i++) dataarr[ $1, ",", $2, ",", "0", $4, ",", $6, ",", $7, ",", $10, ",", $11, ",", $12, ",", $13, ",", $15, ",", $16, ",", $18, ",", $20, ",", $21, ",", $22, ",", $23, ",", $30 ]++ }
END {
for ( words in dataarr )
print words
}
' $file | sed -e 's/[^,]*=//g' >> /usr/local/speech/billing/archive/$file
}
fi
};
done
-----------------------------------------------------------------------------------------------------------------------------------------------------
Datafile :
---------

Tue Apr 29 00:00:01 2003, HOST=172.20.100.10, DST-NUMBER-IN=3454#923442872628, DST-NUMBER-OUT=3454#923442872628, DST-NUMBER-BILL=3454#923442872628, SRC-IP=xxx.xxx.xxx.xxx:48371, DST-IP=172.20.100.104:1720, SRC-USER=xxx.xxx.xxx.xxx, SRC-NAME=SpeefFlow-Orig, DST-NAME=Term-Telnr-001, DIALPEER-NAME=Term-Telnr-SpeedFlow, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7274, ELAPSED-TIME=0, SETUP-TIME=00:00:01.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=136, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=187, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=0229aed80664731d34380380b9fe5fad, CONFID=8154b51e36cc231f3c0380b9fe5fac75, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:01 2003, HOST=172.20.100.10, DST-NUMBER-IN=3454#923442872628, DST-NUMBER-OUT=3454#923442872628, DST-NUMBER-BILL=3454#923442872628, SRC-IP=xxx.xxx.xxx.xxx:48371, DST-IP=172.20.100.104:1720, SRC-USER=xxx.xxx.xxx.xxx, SRC-NAME=SpeefFlow-Orig, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7274, ELAPSED-TIME=0, SETUP-TIME=00:00:01.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=139, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=187, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=0229aed80664731d34380380b9fe5fad, CONFID=8154b51e36cc231f3c0380b9fe5fac75, PROXY-MODE=0, ROUTE-RETRIES=2, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A, LAST-CHECKED-DIALPEER=Term-Telnr-SpeedFlow
Tue Apr 29 00:00:01 2003, HOST=172.20.100.10, DST-NUMBER-IN=3454#923007653292, DST-NUMBER-OUT=3454#923007653292, DST-NUMBER-BILL=3454#923007653292, SRC-IP=xxx.xxx.xxx.xxx:33655, DST-IP=172.20.100.101:1720, SRC-USER=xxx.xxx.xxx.xxx, SRC-NAME=SpeefFlow-Orig, DST-NAME=Term-Mobi-001, DIALPEER-NAME=Term-Mobi-SpeedFlow, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7275, ELAPSED-TIME=0, SETUP-TIME=00:00:01.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=136, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=187, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=0229aed806560a1b34360380b9fe5fad, CONFID=bc637ff8297c361f218293d0c9ceeffd, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:02 2003, HOST=172.20.100.10, SRC-NUMBER-IN=43443839, DST-NUMBER-IN=3454#923445823854, SRC-NUMBER-OUT=43443839, DST-NUMBER-OUT=3454#923445823854, SRC-NUMBER-BILL=43443839, DST-NUMBER-BILL=3454#923445823854, SRC-IP=xxx.xxx.xxx.xxx:58962, DST-IP=172.20.100.104:1720, SRC-RTP-IP=xxx.xxx.xxx.xxx:18684, SRC-USER=xxx.xxx.xxx.xxx, SRC-NAME=SpeefFlow-Orig, DST-NAME=Term-Telnr-001, DIALPEER-NAME=Term-Telnr-SpeedFlow, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, OUTGOING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7264, ELAPSED-TIME=0, SETUP-TIME=23:59:57.000 +0500 Mon Apr 28 2003, CONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:01.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=1, DISCONNECT-CODE-Q931=16, SRC-BYTES-IN=353, DST-BYTES-IN=122, SRC-BYTES-OUT=0, DST-BYTES-OUT=353, QOS=0, SRC-CODEC=g7231 g729 , CALLID=0229aed7ffd1cd1f33e80380b9fe5fad, CONFID=001e43aee121151f292a1bb891f6f765, LAR-FAULT-REASON=2, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=4, SOURCE-FASTSTART=1, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:02 2003, HOST=172.20.100.10, DST-NUMBER-IN=123#923465739668, DST-NUMBER-OUT=123#923465739668, DST-NUMBER-BILL=123#923465739668, SRC-IP=192.168.0.170:62723, DST-IP=172.20.100.104:1720, SRC-USER=192.168.0.170, SRC-NAME=SSSS-Tel, DST-NAME=Term-Telnr-001, DIALPEER-NAME=Term-Telnr-SSSS-Tel, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7277, ELAPSED-TIME=0, SETUP-TIME=00:00:02.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=136, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=188, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=311984842ecd11d6bd3391ea99790924, CONFID=3118e85c2ecd11d6bd3191ea99790924, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:02 2003, HOST=172.20.100.10, DST-NUMBER-IN=123#923465739668, DST-NUMBER-OUT=123#923465739668, DST-NUMBER-BILL=123#923465739668, SRC-IP=192.168.0.170:62723, DST-IP=172.20.100.104:1720, SRC-USER=192.168.0.170, SRC-NAME=SSSS-Tel, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7277, ELAPSED-TIME=0, SETUP-TIME=00:00:02.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=139, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=188, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=311984842ecd11d6bd3391ea99790924, CONFID=3118e85c2ecd11d6bd3191ea99790924, PROXY-MODE=0, ROUTE-RETRIES=2, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A, LAST-CHECKED-DIALPEER=Term-Telnr-SSSS-Tel
Tue Apr 29 00:00:02 2003, HOST=172.20.100.10, SRC-NUMBER-IN=17184217697, DST-NUMBER-IN=3454#923445051657, SRC-NUMBER-OUT=17184217697, DST-NUMBER-OUT=3454#923445051657, SRC-NUMBER-BILL=17184217697, DST-NUMBER-BILL=3454#923445051657, SRC-IP=xxx.xxx.xxx.xxx:55742, DST-IP=172.20.100.104:1720, SRC-USER=xxx.xxx.xxx.xxx, SRC-NAME=SpeefFlow-Orig, DST-NAME=Term-Telnr-001, DIALPEER-NAME=Term-Telnr-SpeedFlow, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7280, ELAPSED-TIME=0, SETUP-TIME=00:00:02.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=136, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=209, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=0229aed808cb711034580380b9fe5fad, CONFID=af996c3535cc231f3c0380b9fe5fac75, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:02 2003, HOST=172.20.100.10, SRC-NUMBER-IN=17184217697, DST-NUMBER-IN=3454#923445051657, SRC-NUMBER-OUT=17184217697, DST-NUMBER-OUT=3454#923445051657, SRC-NUMBER-BILL=17184217697, DST-NUMBER-BILL=3454#923445051657, SRC-IP=xxx.xxx.xxx.xxx:55742, DST-IP=172.20.100.104:1720, SRC-USER=xxx.xxx.xxx.xxx, SRC-NAME=SpeefFlow-Orig, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7280, ELAPSED-TIME=0, SETUP-TIME=00:00:02.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=139, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=209, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=0229aed808cb711034580380b9fe5fad, CONFID=af996c3535cc231f3c0380b9fe5fac75, PROXY-MODE=0, ROUTE-RETRIES=2, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A, LAST-CHECKED-DIALPEER=Term-Telnr-SpeedFlow
Tue Apr 29 00:00:03 2003, HOST=172.20.100.10, DST-NUMBER-IN=123#92214505240, DST-NUMBER-OUT=123#92214505240, DST-NUMBER-BILL=123#92214505240, SRC-IP=192.168.0.170:12913, DST-IP=172.20.100.107:1720, SRC-USER=192.168.0.170, SRC-NAME=SSSS-Tel, DST-NAME=Term-Khi-001, DIALPEER-NAME=Term-Khi-SSSS-Tel, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7281, ELAPSED-TIME=0, SETUP-TIME=00:00:03.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:03.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:03.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=136, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=187, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=31af0da32ecd11d6bd4291ea99790924, CONFID=31ae717b2ecd11d6bd4091ea99790924, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:03 2003, HOST=172.20.100.10, DST-NUMBER-IN=123#92214505240, DST-NUMBER-OUT=123#92214505240, DST-NUMBER-BILL=123#92214505240, SRC-IP=192.168.0.170:12913, DST-IP=172.20.100.107:1720, SRC-USER=192.168.0.170, SRC-NAME=SSSS-Tel, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7281, ELAPSED-TIME=0, SETUP-TIME=00:00:03.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:03.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:03.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=139, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=187, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=31af0da32ecd11d6bd4291ea99790924, CONFID=31ae717b2ecd11d6bd4091ea99790924, PROXY-MODE=0, ROUTE-RETRIES=2, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A, LAST-CHECKED-DIALPEER=Term-Khi-SSSS-Tel
Tue Apr 29 00:00:03 2003, HOST=172.20.100.10, DST-NUMBER-IN=123#923465258538, DST-NUMBER-OUT=123#923465258538, DST-NUMBER-BILL=123#923465258538, SRC-IP=192.168.0.170:13338, DST-IP=172.20.100.104:1720, SRC-RTP-IP=192.168.0.170:17774, DST-RTP-IP=172.20.100.104:10700, SRC-USER=192.168.0.170, SRC-NAME=SSSS-Tel, DST-NAME=Term-Telnr-001, DIALPEER-NAME=Term-Telnr-SSSS-Tel, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, OUTGOING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7229, ELAPSED-TIME=0, SETUP-TIME=23:59:45.000 +0500 Mon Apr 28 2003, CONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:02.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=1, DISCONNECT-CODE-Q931=16, SRC-BYTES-IN=240, DST-BYTES-IN=414, SRC-BYTES-OUT=414, DST-BYTES-OUT=234, QOS=0, SRC-CODEC=g729 , DST-CODEC=g729 , CALLID=271f31862ecd11d6bccd91ea99790924, CONFID=271e955e2ecd11d6bccb91ea99790924, LAR-FAULT-REASON=2, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=17, SOURCE-FASTSTART=1, DESTINATION-FASTSTART=1, SOURCE-TUNNELLING=1, DESTINATION-TUNNELLING=1, PDD-TIME=5, PDD-REASON=ALERT
Tue Apr 29 00:00:03 2003, HOST=172.20.100.10, SRC-NUMBER-IN=01186423627837, DST-NUMBER-IN=123#92214529540, SRC-NUMBER-OUT=01186423627837, DST-NUMBER-OUT=123#92214529540, SRC-NUMBER-BILL=01186423627837, DST-NUMBER-BILL=123#92214529540, SRC-IP=192.168.0.170:16340, DST-IP=172.20.100.107:1720, SRC-USER=192.168.0.170, SRC-NAME=SSSS-Tel, DST-NAME=Term-Khi-001, DIALPEER-NAME=Term-Khi-SSSS-Tel, INITIAL-INCOMING-LOCAL-ADDRESS=172.20.100.10, SELECTED-INCOMING-LOCAL-ADDRESS=172.20.100.10, RECORD-ID=1051552854-7283, ELAPSED-TIME=0, SETUP-TIME=00:00:03.000 +0500 Tue Apr 29 2003, CONNECT-TIME=00:00:03.000 +0500 Tue Apr 29 2003, DISCONNECT-TIME=00:00:03.000 +0500 Tue Apr 29 2003, DISCONNECT-CODE-LOCAL=136, DISCONNECT-CODE-Q931=34, SRC-BYTES-IN=206, DST-BYTES-IN=0, SRC-BYTES-OUT=0, DST-BYTES-OUT=0, QOS=0, CALLID=320e43b22ecd11d6bd4c91ea99790924, CONFID=320da6f22ecd11d6bd4a91ea99790924, PROXY-MODE=0, ROUTE-RETRIES=1, SCD-TIME=0, SOURCE-TUNNELLING=1, PDD-TIME=0, PDD-REASON=N/A
Tue Apr 29 00:00:03 2003, HOST=172.20.100.10, SRC-NUMBER-IN=01186423627837, DST-NUMBER-IN=123#92214529540, SRC-NUMBER-OUT=01186423627837, DST-NUMBER-OUT=123#92214529540, SRC-NUMBER-BILL=01186423627837, DST-NUMBER-BILL=123#92214529540, SRC-IP=192.168.0.170:16340, DST-IP=172.20.100.107:1720, SRC-USER
---------------------------------------------------------------------

output in archive file
--------------------
Mon Apr 28 20:34:59 2003\,172.20.100.10\,447818895341\,3454#923084586379\,xxx.xxx.xxx.xxx:50989\,172.20.100.102:1720\,xx x.xxx.xxx.xxx\,SpeefFlow-Orig\,Term-Mobi-002\,Term-Mobi-SpeedFlow\,172.20.100.10\,172.20.100.10\,12\,20:34:47.000 +0500 Mon Apr 28 2003\,20:34:59.000 +0500 Mon Apr 28 2003\,1\,16\,g729

output on screen monitor.
------------------------
Mon Apr 28 20:34:59 2003,172.20.100.10,447818895341,3454#923084586379,xxx.xxx.xxx.xxx:50989,172.20.100.102:1720,xxx.xxx. xxx.xxx,SpeefFlow-Orig,Term-Mobi-002,Term-Mobi-SpeedFlow,172.20.100.10,172.20.100.10,12,20:34:47.000 +0500 Mon Apr 28 2003,20:34:59.000 +0500 Mon Apr 28 2003,1,16,g729

-----------------------

one more thing what i tried. i copied the output file created after running this script to windows pc for examinig and i found

its showing a square box instead of \ . I think its a blank or white space.