|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
parsing logfiles (performance issue)
Post 302192053 by subin_bala on Tuesday 6th of May 2008 01:35:34 AM
05-06-2008
Hi ,
Thanks for the help.. I changed the code like this and performancevice its looking ok.
awk ' {
if($0 > " ")
{
MSISDN=substr($0,1,10);
HOUR=substr($0,11,16);
ID_SA_SOURCE=substr($0,17,16);
ID_SA_DEST=substr($0,35,16);
ID_VIR_PORTAL=substr($0,53,16);
NW_BEARER=substr($0,71,4 );
TERMINAL_TYPE=substr($0,75,1);
TRADE_MODEL=substr($0,76,30);
print $HOUR";"$MSIDSN";"$ID_SA_SOURCE";"$ID_SA_DEST";"$ID_VIR_PORTAL";"$NW_BEARER";"$TERMINAL_TYPE";"$TRAD E_MODEL >> "OFR.txt"
}
}' logger_fe.log.199804261105
Now the print statement is not functioning as i want .... (i need to write the print statement in a single line with semicolumn seperated)
eg:
20080426000012;0678111627;;3001339;60180;GPRS;4;SonyEricsson_W600i
20080426000012;0637729992;;3025451;0;GPRS;1;MOTOROLA-W375
20080426000012;0670704419;;3001339;60180;GPRS;2;Motorola_V3i
20080426000013;0671228789;;3001339;60180;GPRS;4;SonyEricssonW300i
BUt the output is writing in incorrect format like this
;0677562376000013 3001339 60180UMTS4SonyEricsson_W850i;0677562376000013 3001339
60180UMTS4SonyEricsson_W850i;;;0677562376000013 3001339 60180UMTS4SonyEricsson_W850i;;0677562376000013
3001339 60180UMTS4SonyEricsson_W850i
;0608166896000009 3204235 3207492 GPRS4LG_KU380;;;0608166896000009 3204235 3207492
GPRS4LG_KU380;0608166896000009 3204235 3207492 GPRS4LG_KU380;GPRS4LG_KU380;0608166896000009 3204235
3207492 GPRS4LG_KU380
;0670473398000009 3001339 60180UMTS4SonyEricsson_k610i;0670473398000009 3001339
60180UMTS4SonyEricsson_k610i;;;0670473398000009 3001339 60180UMTS4SonyEricsson_k610i;;0670473398000009
THe lines are coming in same line and not properly seperated with semicolumns... Can you please look in to this again
Thanks in advance
Subin
Thanks for the help.. I changed the code like this and performancevice its looking ok.
awk ' {
if($0 > " ")
{
MSISDN=substr($0,1,10);
HOUR=substr($0,11,16);
ID_SA_SOURCE=substr($0,17,16);
ID_SA_DEST=substr($0,35,16);
ID_VIR_PORTAL=substr($0,53,16);
NW_BEARER=substr($0,71,4 );
TERMINAL_TYPE=substr($0,75,1);
TRADE_MODEL=substr($0,76,30);
print $HOUR";"$MSIDSN";"$ID_SA_SOURCE";"$ID_SA_DEST";"$ID_VIR_PORTAL";"$NW_BEARER";"$TERMINAL_TYPE";"$TRAD E_MODEL >> "OFR.txt"
}
}' logger_fe.log.199804261105
Now the print statement is not functioning as i want .... (i need to write the print statement in a single line with semicolumn seperated)
eg:
20080426000012;0678111627;;3001339;60180;GPRS;4;SonyEricsson_W600i
20080426000012;0637729992;;3025451;0;GPRS;1;MOTOROLA-W375
20080426000012;0670704419;;3001339;60180;GPRS;2;Motorola_V3i
20080426000013;0671228789;;3001339;60180;GPRS;4;SonyEricssonW300i
BUt the output is writing in incorrect format like this
;0677562376000013 3001339 60180UMTS4SonyEricsson_W850i;0677562376000013 3001339
60180UMTS4SonyEricsson_W850i;;;0677562376000013 3001339 60180UMTS4SonyEricsson_W850i;;0677562376000013
3001339 60180UMTS4SonyEricsson_W850i
;0608166896000009 3204235 3207492 GPRS4LG_KU380;;;0608166896000009 3204235 3207492
GPRS4LG_KU380;0608166896000009 3204235 3207492 GPRS4LG_KU380;GPRS4LG_KU380;0608166896000009 3204235
3207492 GPRS4LG_KU380
;0670473398000009 3001339 60180UMTS4SonyEricsson_k610i;0670473398000009 3001339
60180UMTS4SonyEricsson_k610i;;;0670473398000009 3001339 60180UMTS4SonyEricsson_k610i;;0670473398000009
THe lines are coming in same line and not properly seperated with semicolumns... Can you please look in to this again
Thanks in advance
Subin
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
Hi,
on a linux server I have the following :
vmstat 2 10
procs memory swap io system cpu
r b w swpd free buff cache si so bi bo in cs us sy id
0 4 0 675236 39836 206060 1617660 3 3 3 6 8 7 1 1 ... (1 Reply)
Discussion started by: big123456
1 Replies
2. Shell Programming and Scripting
I want to read a file.
is it good to use File I/O or shell script??
which one is the best option? (1 Reply)
Discussion started by: vishwaraj
1 Replies
3. Shell Programming and Scripting
Hi,
I have a lot of logfiles like fooYYYYMM.log (foo200301.log, foo200810.log) with lines like
YYYY-MM-DD TIMESTAMP,text1,text2,text3...
but I need (for postprocessing) the form fooYYYYMMDD.log (so foo200402.log becomes foo20040201.log, foo20040202.log...)
with unmodified content of lines.
... (1 Reply)
Discussion started by: clzupp
1 Replies
4. UNIX for Advanced & Expert Users
In my C program i am using very large file(approx 400MB) to read parts of it frequently. But due to large file the performance of the program goes down very badly. It shows very high I/O usage and I/O wait time.
My question is, What are the ways to optimize or tune I/O on linux or how i can get... (10 Replies)
Discussion started by: mavens
10 Replies
5. Shell Programming and Scripting
Hello,
I am an absolute newbie and whatever I've written in the shell script (below) has all been built with generous help from googling the net and this forum. Please forgive any schoolboy mistakes.
Now to the qn, my input file looks like this -
2009:04:03 08:21:41:513,INFO... (7 Replies)
Discussion started by: sowmitr
7 Replies
6. Solaris
Hi Gurus,
I am beginner in solaris and want to know what are the things we need to check for performance monitoring on our solairs OS.
for DISK,CPU and MEMORY.
Also how we do ipforwarding in slaris
Many thanks for your help
Pradeep P (4 Replies)
Discussion started by: ppandey21
4 Replies
7. Shell Programming and Scripting
Hi All,
I have the following script which I use in Nagios to check the health of the applications, the problem with it is that the curl part ($TOTAL) does not return anything after running for 2-3 hrs, even though from command line the script runs fine but not from Nagios.
There are 17... (1 Reply)
Discussion started by: jacki
1 Replies
8. AIX
Hi,
We have 2 lpars on p6 blade. One of the lpar is having 3 core cpu with 5gb memory running sybase as database. An EOD process takes 25 min. to complete.
Now we have an lpar on P7 server with entitled cpu capacity of 2 with 16 Gb memory and sybase as database. The EOD process which takes... (17 Replies)
Discussion started by: vjm
17 Replies
9. AIX
Hi
We have an AIX5.3 server with application which is written in C. We are facing server (lpar) hangs intermediately. If we open new telnet window prompts for user and takes hell of a time to authenticate, not only that if we run ps -aef then also it takes lot of time. surprisingly there is no... (2 Replies)
Discussion started by: powerAIX
2 Replies
10. Shell Programming and Scripting
I have 1.6 GB (and growing) of files with needed data between the 11th and 34th line (inclusive) of the second column of comma delimited files. There is also a lot of stray white space in the file that needs to be trimmed. They have DOS-like end of lines.
I need to transpose the 11th through... (13 Replies)
Discussion started by: Michael Stora
13 Replies
LEARN ABOUT MOJAVE
libidl-2
libIDL-2.3(3) Introduction to Library Functions libIDL-2.3(3) NAME
libIDL-2 - IDL parsing library DESCRIPTION
The libIDL library provides an API for parsing CORBA Interface Definition Language (IDL) files and manipulating the resultant parse tree. libIDL is used by orbit-idl-2(1), the GNOME IDL compiler. No API documentation is currently supplied with the library. FILES
The following files are used by this application: /usr/lib/libIDL-2.so IDL parsing shared library ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-------------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-------------------------------+ |Availability |SUNWgnome-component-arch-devel | +-----------------------------+-------------------------------+ |Interface stability |External | +-----------------------------+-------------------------------+ SEE ALSO
orbit-idl-2(1), libORBit-2(3) NOTES
Written by Mark McLoughlin, Sun Microsystems Inc., 2003. SunOS 5.10 10 Jan 2003 libIDL-2.3(3)