|
|
Sponsored Content
Top Forums
UNIX for Dummies Questions & Answers
Compressing of log files
Post 302344973 by sgbhat on Tuesday 18th of August 2009 06:20:42 AM
08-18-2009
Compressing of log files
Hello All
My first post in the forum.
I've this huge log files of size 20GB-30 GB in my unix server. I want to analyse the log file for some error messages. But because of the enormity of the size of these files i'm not able to grep/search the pattern in the file [ It's taking too much time]. Also, tried to gzip the file and copy it to local machine but again it's becoming tedious.
So any expert advice on how can i go about approaching this issue. Your help is highly appreciated
My first post in the forum.
I've this huge log files of size 20GB-30 GB in my unix server. I want to analyse the log file for some error messages. But because of the enormity of the size of these files i'm not able to grep/search the pattern in the file [ It's taking too much time]. Also, tried to gzip the file and copy it to local machine but again it's becoming tedious.
So any expert advice on how can i go about approaching this issue. Your help is highly appreciated
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I have never used this command before. I need to use the "compress" command to compress all files located in the subdirectories under the following directories:
/home/ftp/inbound/Fordin
Please advise, I appreciate your help.
Thanks,
Syed (3 Replies)
Discussion started by: sh9492
3 Replies
2. UNIX for Dummies Questions & Answers
Hi, i have written a script in unix which produces two files(.csv file) at the end. Now i want to add these to files in a zip file and send the zip file across the network by FTP.
Problem is that i dunno how to make a single zip file containing the two files that have been created by the script.... (1 Reply)
Discussion started by: nimish
1 Replies
3. UNIX for Advanced & Expert Users
Hello,
I am having difficulty compressing the files using compress or GZIP utility on NAS share NFS mounted on my linux server. Any one have idea on how to do this ? I get the followign error but the trying to compress the files
STRP2> compress STR_OUTBOUND_CDM_LOG_LOB.PRT2008_26.txt... (1 Reply)
Discussion started by: kamathg
1 Replies
4. Shell Programming and Scripting
Hello All
Posted a similar thread in some other section too. Regrets if this section is not suitable for this post. Request all the members to be tolerant as i'm a newbie here :)
Coming to the topic : I've this huge log files of size 20GB-30 GB in my unix server. I want to analyse the log... (2 Replies)
Discussion started by: sgbhat
2 Replies
5. Shell Programming and Scripting
hi everyone ,
Can someone provide me a shell program to compress and decompress files using gzip , i dont know anything in shell programming , this code is a part of my project.
So can someone help with me the code ? (2 Replies)
Discussion started by: mig23
2 Replies
6. Shell Programming and Scripting
I want to create a script that will zip the previous log.
Example.
abc.log.2012.12.02
abc.log.2012.12.01.gzip
abc.log
If today is 2012.12.03 , my current log is abc.log and my previous date is 2012.12.02, i want abc.log.2012.12.02 to compress everytime I run the script.
I can... (5 Replies)
Discussion started by: kaibiganmi
5 Replies
7. Shell Programming and Scripting
I need help to do a script that will compress a file that's bigger than 5000 octets and won't overwrite the previous compress file.
lets say I have mylogfile.log and I would compress it I would become
mylogfile. 1. log and if I would compress again mylogfile.log it would be
mylogfile. 2.... (8 Replies)
Discussion started by: Froob
8 Replies
8. Shell Programming and Scripting
I'm doing a cleanup script for a directory using KSH. I'm keeping the file name prefixes in a text file. In a KSH, I want to read the prefix from the file, and match the pattern of the file and keep and compress(.Z) the latest 4 versions of the matched files in the directory. And I want to delete... (1 Reply)
Discussion started by: manchimahesh
1 Replies
9. Shell Programming and Scripting
Hi
I am writing a sample script (sample.ksh) to compress files in the source directory and move them to another directory.
The script takes a config file (files.config) as the paramter the contents of which are as given under:
/abc/src ${TSTENV}-xxx-yyy~1.log /abc/src/dest
/abc/src... (8 Replies)
Discussion started by: swasid
8 Replies
10. UNIX for Beginners Questions & Answers
Hello,
I have a syslog server at home and am currently experiencing an issue where my logs will rotate and compress however it will rotate and compress yesterdays file and the newly created log file for the current day. When it does this however it will also create another new file for today... (9 Replies)
Discussion started by: MyUserName7000
9 Replies
LEARN ABOUT SUSE
lzegrep
XZGREP(1) XZ Utils XZGREP(1) NAME
xzgrep - search compressed files for a regular expression SYNOPSIS
xzgrep [grep_options] [-e] pattern file... xzegrep ... xzfgrep ... lzgrep ... lzegrep ... lzfgrep ... DESCRIPTION
xzgrep invokes grep(1) on files which may be either uncompressed or compressed with xz(1), lzma(1), gzip(1), or bzip2(1). All options specified are passed directly to grep(1). If no file is specified, then the standard input is decompressed if necessary and fed to grep(1). When reading from standard input, gzip(1) and bzip2(1) compressed files are not supported. If xzgrep is invoked as xzegrep or xzfgrep then egrep(1) or fgrep(1) is used instead of grep(1). The same applies to names lzgrep, lze- grep, and lzfgrep, which are provided for backward compatibility with LZMA Utils. ENVIRONMENT
GREP If the GREP environment variable is set, xzgrep uses it instead of grep(1), egrep(1), or fgrep(1). SEE ALSO
grep(1), xz(1), gzip(1), bzip2(1), zgrep(1) Tukaani 2009-07-05 XZGREP(1)