Sponsored Content
Full Discussion: Large files
Top Forums UNIX for Dummies Questions & Answers Large files Post 68116 by zazzybob on Thursday 31st of March 2005 06:52:43 AM
Old 03-31-2005
There is no doubt a far quicker way of doing this (we're going through the file twice, so it'll take a while), but something like
Code:
#!/bin/ksh

matches=`grep -n "TIMESTAMP_HERE" logfile | cut -f1 -d:`
first_match=`echo "$matches" | awk 'NR==1{print $0}'`
last_match=`echo "$matches" | awk '{c=$0}END{print c}'`

sed -n "$((first_match - 50)),$((last_match + 50))p" logfile

Should do it - just redirect the output of this script to your temporary file

Tested on SunOS sunbox 5.9 Generic_112234-07 i86pc i386 i86pc, ksh

Cheers
ZB

Last edited by zazzybob; 03-31-2005 at 07:59 AM.. Reason: Removed debug code
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large files

Hi Unix gurus, We have a masterfile which is to be split into smallerfiles with names as masterfile00,masterfile01,masterfile03...etal I was able to split the file using the "Split" cmd but as masterfileaa,masterfileab.. Is it posiible to change the default suffix? or is there any other... (2 Replies)
Discussion started by: Rvbs
2 Replies

2. UNIX for Dummies Questions & Answers

large files?

How do we check 'large files' is enabled on a Unix box -- HP-UX B11.11 (2 Replies)
Discussion started by: ranj@chn
2 Replies

3. UNIX for Dummies Questions & Answers

gzipping large (2+ gb) files.

Is it possible? I am trying to do it with gzip 1.2.4 and it comes back saying the file type is too large. Any way to compress massive things? (2 Replies)
Discussion started by: LordJezo
2 Replies

4. UNIX for Dummies Questions & Answers

tarring large no. of files

dears, I have a folder containing huge no. of files, some of them are created on AUG 16, AUG 17 and AUG 18, for example. All I want to do is tarring all the files created on a certain date, say AUG 18, in one tar file, only in one command line. So, how to feed all the files created on a certain... (4 Replies)
Discussion started by: marwan
4 Replies

5. UNIX for Dummies Questions & Answers

Need to find large files

I have found the following code on this forum ls -lh | awk '{print $5,$9}' | sort -n Its purpose is to show a list of files in a dir sorted by file size. I need to make it recursive ls -lhR | awk '{print $5,$9}' | sort -n The problem is that there are lots of files on the... (3 Replies)
Discussion started by: jadionne
3 Replies

6. Shell Programming and Scripting

Compare 2 Large files

Hi, i want to compare 2 large files both around 300 mb. They are text files having only one column of numbers. I wish to get the unique values in file2. I tried using diff but it gave an error of memory exhausted. Both files are sorted and i am running on a 1gb ram core 2 duo 2ghz. Help!! Thanks... (4 Replies)
Discussion started by: bezudar
4 Replies

7. UNIX for Dummies Questions & Answers

Renaming Large Files

When I have a file for example with the wrong name I normally use the cp {filename} {new filename} comand so I will have the original as well as the correct named file. Just for backup purposes. Problem: I have a file that is 24gb with a case sensitive filename. The file was named with upper... (3 Replies)
Discussion started by: trek88
3 Replies

8. Shell Programming and Scripting

Divide large data files into smaller files

Hello everyone! I have 2 types of files in the following format: 1) *.fa >1234 ...some text... >2345 ...some text... >3456 ...some text... . . . . 2) *.info >1234 (7 Replies)
Discussion started by: ad23
7 Replies

9. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

10. UNIX for Advanced & Expert Users

Iconv on large files

Hi All, I am using iconv to convert huge files. the process is getting killed. I tried the option in below link https://www.unix.com/shell-programming-and-scripting/258825-iconv-large-files.html i.e iconv -f UCS-2 -t UTF-8 < inputfile.txt > outputfile.txt However, the process still gets... (4 Replies)
Discussion started by: tostay2003
4 Replies
cgi(5)								Programmer's Manual							    cgi(5)

NAME
cgi - Common Gateway Interface DESCRIPTION
The Common Gateway Interface is a way to create dynamic web pages. It defines rules for interaction between a program and the web server while the server talks to the client. There are some ways to use it. ENVIRONMENT
Normally the webserver sets several environment variables to give some information to the CGI program so it can determine various stuff. AUTH_TYPE This reflects the authentification method used to validate a user. CONTENT_LENGTH The length of the data in bytes passed to the CGI program through standard input. This is used by the POST method. CONTENT_TYPE The MIME type of the query data, such as "text/html", optional. DOCUMENT_ROOT This reflects the document root directory of the webserver. GATEWAY_INTERFACE Reflects the version of the Common Gateway Interface that the server is using HTTP_ACCEPT A comma separated list of MIME type that the client is willing to accept. HTTP_FROM The email address of the user issuing the information request. This is not supported by most browsers. HTTP_REFERER Reflects the URL from which this CGI program was accessed. HTTP_USER_AGENT The name, version and libraries of the browser making the request. This information can be used to determine if the browser is capable of graphics and is able to display frames and tables. PATH_INFO This shows extra information that was passed to the CGI program via command line. Normally it's empty or non-existent. PATH_TRANSLATED The translated path on the local filesystem. QUERY_STRING This variable refers to additional arguments that were appended to the CGI program - normally with the '?' sign. REMOTE_ADDR This refers to the host from which the information request was issued, as IP number. REMOTE_HOST This refers to the host from which the information request was issued. REMOTE_USER The authenticated name of the user. REQUEST_METHOD This refers to the method with which the information request was issued. Normally this is either GET or POST. SCRIPT_NAME The virtual name of the script being executed. SERVER_NAME The server's hostname or IP number. This may be used to determine the correct paths or resulting HTML code for CGI programs that are used on the same machine for several servers. SERVER_PROTOCOL This is the name and version of the information protocol the request came in with. Normally this is "HTTP/1.0" or "HTTP/1.1". SERVER_PORT This refers to the TCP/IP port on which the webserver is running. SERVER_SOFTWARE This reflects the name and revision of the webserver software. AUTHOR
This CGI library is written by Martin Schulze <joey@infodrom.org>. If you have additions or improvements please get in touch with him. SEE ALSO
cgiDebug(3), cgiHeader(3), cgiSetType(3), cgiSetHeader(3), cgiGetValue(3), cgiGetVariables(3). CGI Library 6 April 2008 cgi(5)
All times are GMT -4. The time now is 06:24 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy