01-28-2011
The fields in the Log files are all delimited by tabs. I have a total of 14 Log files in this folder. I need to combine them into one large file first. That file will have to be sorted and saved.
I thought if I could do a Cat command in Unix and then a Sort command in Unix this would solve the issue. I can find MANY examples of both commands, but when I try to replicate the examples, my ONE file is NOT being created/updated/saved ever.
I would think the Cat command would be set up similar to (logically) Cat.exe all files with the extension of .log (*.log) into ('|' or '>') one large text file (file.txt). Is there a problem with combining files of one extension into one file with a different extension?
Then of course logically I would think I could then use sort to sort the now populated large file (.txt file) in reverse order based on the 3rd field in this large file.
Finally I want to save this file, then move it to another location so it can be utilized in the future for aduits.
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I have 2 files with many lines.
File one example:
CN=VXX,CN=ug88888,OU=America,OU=State,OU=VXX,
File two example:
ul22222 Jon Smith
ug8888 Mildred Apple
I need a routine that will take the ug88888 portion of the first file and pull out the corresponding full line in file two. Then add the... (2 Replies)
Discussion started by: scriptarg
2 Replies
2. Shell Programming and Scripting
I need to write a perl script to execute external programs and grab the output and return code. Each program should be killed if it has not completed within X seconds.
Imagine that the script goes something like this :
@commands = &get_commands();
foreach $cmd (@commands) {
$pid =... (4 Replies)
Discussion started by: SandmanCL
4 Replies
3. Shell Programming and Scripting
Hi there,
Can someone let me know how to sort the 2 dimensional array below by column 1 then by column 2?
22 55
2222 2230
33 66
44 58
222 240
11 25
22 60
33 45
output:
11 25
22 55
22 60
33 45
33 66
44 58 (6 Replies)
Discussion started by: phoeberunner
6 Replies
4. Shell Programming and Scripting
Hi, all.
I need a shell script which gathers data from a remote XML file and then displays it according to my needs.. I need this for my job due to the fact that I need to keep track price changes of euro, usd, gold, etc.
The XML file I am talking about is located at this page: cnnturk dot... (4 Replies)
Discussion started by: canimsin
4 Replies
5. Shell Programming and Scripting
hi everyone,
i am a newbie in shell programming. and i want to simply go through a text file that contains 3 "columns", split by ';'
customerID ; link-to-contract ; save-as-filename
so an example would simply look like this
now i want to loop through every line, and save the file from... (3 Replies)
Discussion started by: Confidence
3 Replies
6. Shell Programming and Scripting
I want to sort like below
Suppose few lines in a file is like this
systemid:ABC messagedestination:batchxpr replytoqname: myca
systemid:BCD messagedestination:realtime replytoqname: myca
systemid:ABC messagedestination:realtime replytoqname: eac
systemid: BCD messagedestination:mqonline... (1 Reply)
Discussion started by: srkmish
1 Replies
7. Shell Programming and Scripting
Hi there,
I have tried using the "find" command to do this but to no avail as the "find -mtime" command I used descend to the directories from my current working directory.
Say in "directoryA" has multiple files and those files are created on a daily basis.
Under "directoryB", there are... (4 Replies)
Discussion started by: chewku
4 Replies
8. Shell Programming and Scripting
I have log files with following format -
YYYY/MM/DD HH:mm:ss.msec|field2|filed3| log message
Now the message itself can be multi line message containing new line character.
for e.g.
2013/02/05 15:33:12.234|abc|xyz| This is first single line message.
2013/02/05 15:33:12.786|abc|xyz| This... (6 Replies)
Discussion started by: gini32
6 Replies
9. UNIX for Dummies Questions & Answers
Hi all,
I wanted to save the values of a file that contains unique entries based on a specific column (column 4). my sample file looks like the following:
input file: 200006-07file.txt
145 35 10 3
147 35 12 4
146 36 11 3
145 34 12 5
143 31 15 4
146 30 14 5
desired output files:... (5 Replies)
Discussion started by: ida1215
5 Replies
10. Shell Programming and Scripting
Hi,
i need help with a file creation of an output program. I've got a program that with #find creates an output for each files in a directory.
If i give this command :
-o spec$(date -u +%Y%m%dt%H%M)
it creates just one file, overwriting all the others since it is the creation date .... (2 Replies)
Discussion started by: Board27
2 Replies
LEARN ABOUT X11R4
ncab2clf
ncab2clf(1) User Commands ncab2clf(1)
NAME
ncab2clf - convert binary log file to Common Log File format
SYNOPSIS
/usr/bin/ncab2clf [-Dhv] [-i input-file] [-o output-file] [-b size] [-n number] [-s datetime]
DESCRIPTION
The ncab2clf command is used to convert the log file generated by the Solaris Network Cache and Accelerator ("NCA") from binary format, to
Common Log File ("CLF") format. If no input-file is specified, ncab2clf uses stdin. If no output-file is specified, the output goes to std-
out.
OPTIONS
-b Specifies the binary-log-file blocking in kilobytes; the default is 64 Kbyte.
-D Specifies that direct I/O be disabled.
-h Prints usage message.
-i input-file Specifies the input file.
-n number Output number CLF records.
-o output-file Specifies the output file.
-s datetime Skip any records before the date and time specified in datetime. You can specify the date and time in CLF format or in the
format specified by the touch(1) utility. CLF format is the dominant format, so ncab2clf first analyzes datetime assuming
CLF.
-v Provides verbose output.
EXAMPLES
Example 1: Converting a Binary File to a Common Log File Format
The following example converts the binary file /var/nca/logs/nca.blf to a file /var/nca/logs/nca.clf, which is in Common Log File format.
example% ncab2clf -D -i /var/nca/logs/nca.blf -o /var/nca/logs/nca.clf
Example 2: Converting Multiple Log Files
The following script may be used to convert multiple log files. The directory designated by "*" must only contain log files.
!/bin/ksh
for filename in *
do
ncab2clf -D < $filename > $filename.clf
done
Example 3: Using -s and -n on a Raw Device
The following example shows how ncab2clf can be used on a raw device. If not using the -n option, the default is to convert all records
from the starting location to the end of the file. The date and time specified with -s, below, is in CLF format.
example% ncab2clf -s '10/Apr/2001:09:23:13' -n 100 < /dev/dsk/c2t1d0s6
EXIT STATUS
The following exit values are returned:
0 The file converted successfully
>0 An error occurred.
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWncau |
+-----------------------------+-----------------------------+
|Interface Stability |Evolving |
+-----------------------------+-----------------------------+
SEE ALSO
nca(1), ncakmod(1), nca.if(4), ncakmod.conf(4), ncalogd.conf(4), attributes(5)
System Administration Guide: IP Services
NOTES
The binary log files generated by NCA can become very large. When converting these large binary files, use the -b option to the ncab2clf
command to help performance.
Direct I/O is a benefit to the user if the data being written does not come in as large chunks. However, if the user wishes to convert the
log file in large chunks using the -b option, then direct I/O should be disabled by using the -D option.
SunOS 5.10 28 Sep 2001 ncab2clf(1)