|
|
|
google unix.com
|
|||||||
| Forums | Register | Forum Rules | Links | Albums | FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
| Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here. |
More UNIX and Linux Forum Topics You Might Find Helpful
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| To extract everything between two delimiters | dowsed4u8 | SUN Solaris | 1 | 01-16-2008 02:49 PM |
| parse multiple lines? should be a easy answer... | DeuceLee | UNIX for Dummies Questions & Answers | 4 | 01-04-2008 04:54 PM |
| Delimiters missing | Indalecio | Shell Programming and Scripting | 2 | 02-23-2007 04:28 AM |
| Cut based on Two Delimiters at one go | pbsrinivas | Shell Programming and Scripting | 4 | 01-18-2007 04:45 AM |
| awk - treat multiple delimiters as one | peter.herlihy | Shell Programming and Scripting | 6 | 08-30-2002 01:12 PM |
 |
Powered by 
|
|
|
LinkBack | Thread Tools | Search this Thread | Rate Thread | Display Modes |
|
|
05-16-2008
|
||||
|
||||
|
parse of lines with different delimiters
Hi,
I am having huge file with the following lines. 2007:10:01:00:00:49:GMT: subject=BMRA.BM.T_ABTH7.FPN, message={SD=2007:10:01:00:00:00:GMT,SP=5,NP=2,TS=2007:10:01:01:00:00:GMT,VP=0.0,TS=2007:10:01:01:30: 00:GMT,VP=0.0} 2007:10:01:00:00:49:GMT: subject=BMRA.BM.T_ABTH7G.FPN, message={SD=2007:10:01:00:00:00:GMT,SP=5,NP=2,TS=2007:10:01:01:00:00:GMT,VP=0.0,TS=2007:10:01:01:30: 00:GMT,VP=0.0} I need to parse them into the following format. 2007-10-01,T_ABTH7,2007-10-0100:00:00,5,0.0 2007-10-01,T_ABTH7G,2007-10-0100:00:00,5,0.0 Is there a way to parse the entire file without reading a single line of file and formating the output. Thanks in advance. |
|
05-16-2008
|
||||
|
||||
|
there are so many occurences of 2 and 0.0 in the input lines.
Highlight the portions of input line that u want to report Thanks Penchal |
|
05-16-2008
|
||||
|
||||
|
Hi Penchal,
I want to parse the highlighted values. 2007:10:01:00:00:49:GMT: subject=BMRA.BM.T_ABTH7.FPN, message={SD=2007:10:01:00:00:00:GMT,SP=5,NP=2,TS=2007:10:01:01:00:00:GMT,VP=0.0,TS=2007:10:01:01:30: 00:GMT,VP=0.0} First output column (2007-10-01): SD=2007:10:01:00:00:00 Second column (T_ABTH7): subject=BMRA.BM.T_ABTH7.FPN Third Column (2007-10-0100:00:00): TS=2007:10:01:01:00:00 Fourth Column (5): SP=5 Fifth Column(0.0) : VP=0.0 Output for a single line : 2007-10-01,T_ABTH7,2007-10-0100:00:00,5,0.0 Please let me know if this clear. |
|
05-16-2008
|
|||||
|
|||||
|
One way is to use the pattern matching and substitution capabilities of ksh93 or bash
Code:
#!/usr/bin/ksh93
IFS=','
while read c1 c2 c3 c4 c5 c6 rest
do
tmp1=${c2##*SD=}
tmp1=${tmp1%%:00:00:00:GMT}
tmp2=${c1##*=BMRA.BM.}
tmp3=${c5##TS=}
tmp3=${tmp3%%:GMT}
tmp3A=${tmp3:0:10}
printf "%s,%s,%s%s,%s,%s\n" ${tmp1//:/-} ${tmp2%%.FPN} ${tmp3A//:/-} ${tmp3:11} ${c3##SP=} ${c6##VP=}
done < file
Code:
2007-10-01,T_ABTH7,2007-10-0101:00:00,5,0.0 2007-10-01,T_ABTH7G,2007-10-0101:00:00,5,0.0 |
|
05-16-2008
|
||||
|
||||
|
Solution with gawk:
Code:
#!/usr/bin/awk -f
BEGIN {FS=","; OFS=","}
{
print \
gensub(/^.+([0-9][0-9][0-9][0-9]:[0-9][0-9]:[0-9][0-9]).+$/, "\\1", 1, $2),
gensub(/^.+subject=BMRA.BM.(.+).FPN/, "\\1", 1, $1),
gensub(/^TS=(.+):GMT/, "\\1", 1, $5),
gensub(/^SP=(.+)/, "\\1", 1, $3),
gensub(/^VP=(.+)/, "\\1", 1, $6)
}
|
|
05-16-2008
|
|||||
|
|||||
|
[QUOTE=nathasha;302195904
tmp3A=${tmp3:0:10}: bad substitution[/QUOTE] Then you either are not using a recent version of ksh93 (later than 1999) or your data structure has changed from what you provided as a sample. |
|
| Bookmarks |
| Thread Tools | Search this Thread |
| Display Modes | Rate This Thread |
|
|
Hybrid Mode
