06-25-2008
shell-script which extract data from log file
give me a shell-script which extract data from log file on a server by giving date and time as input (for both start time and end time) and it will give the logs generated during the given time as output.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello All,
I am starting with UNIX. Any help is highly appreciated.
How to extract data using UNIX shell script? And how do you export data using UNIX shell scripts into Microsoft Excel format?
Thank you. (3 Replies)
Discussion started by: desiondarun
3 Replies
2. Shell Programming and Scripting
Hi,
This is the xml file that i have.
- <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000">
<concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" />
- <loggers>
<instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies
3. Shell Programming and Scripting
Hello Scripting Gurus,
I need help with extracting data from the XML file using shell script.
The data is in a large XML and I need to extract the id values of all completedworkflows. Here is a sample of it. Input and output data is also in the attached text files.
<wfregistry>... (5 Replies)
Discussion started by: yajaykumar
5 Replies
4. Shell Programming and Scripting
shell script (4 Replies)
Discussion started by: frns5
4 Replies
5. Shell Programming and Scripting
If I have a log like :
Mon Jul 19 05:07:34 2010; TCP; eth3; 52 bytes; from abc to def
Mon Jul 19 05:07:35 2010; UDP; eth3; 46 bytes; from aaa to bbb
Mon Jul 19 05:07:35 2010; TCP; eth3; 52 bytes; from def to ghi
I will need an output like this :
Time abc to def... (1 Reply)
Discussion started by: hitha87
1 Replies
6. Shell Programming and Scripting
hi
i am trying to extract some specific data out of a text file using regular expressions with shell script
that is using a multiline grep .. and the tool i am using is pcregrep so that i can get compatibility with perl's regular expressions
for a sample data like this, i am trying to grab... (6 Replies)
Discussion started by: vemkiran
6 Replies
7. UNIX for Dummies Questions & Answers
Hi Guys,
I am new to shell script.I need your help to write a shell script.
I need to write a shell script to extract data from a .csv file where columns are ',' separated.
The file has 5 columns having values say column 1,column 2.....column 5 as below along with their valuesm.... (1 Reply)
Discussion started by: Vivekit82
1 Replies
8. UNIX for Dummies Questions & Answers
Hi Guys,
I am new to shell script.I need your help to write a shell script.
I need to write a shell script to extract data from a .csv file where columns are ',' separated.
The file has 7 columns having values say column 1,column 2.....column 7 as below along with their values.
Name, Address,... (7 Replies)
Discussion started by: Vivekit82
7 Replies
9. Shell Programming and Scripting
Hi everyone,
I have a csv file which has data with different heading and column names as below.
Static Data Ingested
,,,,,,,,,,,,Known Explained Rejections
Column_1,column_2,Column_3,Column_4,,Column_6,Column_7,,% Column_8,,Column_9 ,Column_10 ,... (14 Replies)
Discussion started by: Vivekit82
14 Replies
10. UNIX for Beginners Questions & Answers
I have this 5GB file, and i want to extract from the file particulars pattern.
this is my script:
//
count=`grep -wc "MSISDN" file_name`
k=1
>OUTPUT
>OUTPUT_Final
while
do
cat file_name | awk -F":" -v var="$k" '$1=="MSISDN" {m++}m==var{print; exit}' >> OUTPUT
cat file_name |awk -F":"... (33 Replies)
Discussion started by: gillesi
33 Replies
LEARN ABOUT DEBIAN
ncab2clf
ncab2clf(1) User Commands ncab2clf(1)
NAME
ncab2clf - convert binary log file to Common Log File format
SYNOPSIS
/usr/bin/ncab2clf [-Dhv] [-i input-file] [-o output-file] [-b size] [-n number] [-s datetime]
DESCRIPTION
The ncab2clf command is used to convert the log file generated by the Solaris Network Cache and Accelerator ("NCA") from binary format, to
Common Log File ("CLF") format. If no input-file is specified, ncab2clf uses stdin. If no output-file is specified, the output goes to std-
out.
OPTIONS
-b Specifies the binary-log-file blocking in kilobytes; the default is 64 Kbyte.
-D Specifies that direct I/O be disabled.
-h Prints usage message.
-i input-file Specifies the input file.
-n number Output number CLF records.
-o output-file Specifies the output file.
-s datetime Skip any records before the date and time specified in datetime. You can specify the date and time in CLF format or in the
format specified by the touch(1) utility. CLF format is the dominant format, so ncab2clf first analyzes datetime assuming
CLF.
-v Provides verbose output.
EXAMPLES
Example 1: Converting a Binary File to a Common Log File Format
The following example converts the binary file /var/nca/logs/nca.blf to a file /var/nca/logs/nca.clf, which is in Common Log File format.
example% ncab2clf -D -i /var/nca/logs/nca.blf -o /var/nca/logs/nca.clf
Example 2: Converting Multiple Log Files
The following script may be used to convert multiple log files. The directory designated by "*" must only contain log files.
!/bin/ksh
for filename in *
do
ncab2clf -D < $filename > $filename.clf
done
Example 3: Using -s and -n on a Raw Device
The following example shows how ncab2clf can be used on a raw device. If not using the -n option, the default is to convert all records
from the starting location to the end of the file. The date and time specified with -s, below, is in CLF format.
example% ncab2clf -s '10/Apr/2001:09:23:13' -n 100 < /dev/dsk/c2t1d0s6
EXIT STATUS
The following exit values are returned:
0 The file converted successfully
>0 An error occurred.
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWncau |
+-----------------------------+-----------------------------+
|Interface Stability |Evolving |
+-----------------------------+-----------------------------+
SEE ALSO
nca(1), ncakmod(1), nca.if(4), ncakmod.conf(4), ncalogd.conf(4), attributes(5)
System Administration Guide: IP Services
NOTES
The binary log files generated by NCA can become very large. When converting these large binary files, use the -b option to the ncab2clf
command to help performance.
Direct I/O is a benefit to the user if the data being written does not come in as large chunks. However, if the user wishes to convert the
log file in large chunks using the -b option, then direct I/O should be disabled by using the -D option.
SunOS 5.10 28 Sep 2001 ncab2clf(1)