03-17-2009
Deleting processed lines
I have a log file that I am processing. This contains messages from and to a server (requests and responses).
The responses to requests may not be in order i.e. we can have a response to a request after several requests are sent, and in some error cases there may not be any response message.
The log file is usually 2MB+ in size, so I am trying to see if there is a way I can find a request message and its response and after I find this delete it from the logfile and again start at the beginning of the logfile for the next request / response message.
Is there a way to delete the lines from the file OR can anyone suggest a better way to go about this?
10 More Discussions You Might Find Interesting
1. Programming
I am spooling a file from oracle and trying to delete the last line of the spooled file which I am unable to do.
Problem is that this file can have multiple records each time and I have no way of knowing how many because the amount can vary. I had an idea of using a while loop to read the... (1 Reply)
Discussion started by: supercbw
1 Replies
2. Shell Programming and Scripting
I am trying deleting lines from a text file using sed..
sed '/OBJECT="ABC/{N;N;N;d; }'
will do if i have to delete lines starting with Object and next 3 lines
but I was looking for a way to delet lines starting with OBJECT and all the lines till it reaches a blank lines ..or it reaches a... (8 Replies)
Discussion started by: ajnabi
8 Replies
3. Shell Programming and Scripting
Hi,
I have a file that gets automatically generated and it would look something like
sakjsd
adssad
{{word}}
sddsasd
dsdsasa
.
.
.
So basically what I want to do is just keep the stuff below the {{word}} marker. The marker includes the brackets. Is there any command to delete the... (3 Replies)
Discussion started by: eltinator
3 Replies
4. UNIX for Dummies Questions & Answers
Hi,
I've worked out that my server was getting clogged with the access_log.processed file.
I deleted it using the command
> /var/www/vhosts/domain.com/statistics/logs/access_log.processed
I also set that up as a crontab job for every Wednesday.
What I was wondering is the version using... (4 Replies)
Discussion started by: chickenhouse
4 Replies
5. Shell Programming and Scripting
hi all,
i have got a scenario in which i need to delete all the lines that ends with file names.
e.g.
input can be
cms/images/services_icons/callback.png
cms/cms/images/services_icons/sync.php
cms/cms/images/services_icons
and output should be
cms/cms/images/services_icons
... (13 Replies)
Discussion started by: kashifv
13 Replies
6. Shell Programming and Scripting
Hello, im using ex to manipulate some text. Im trying to delete all the lines except those on which a certain regex can be found.
the important part of the script:
ex temp << 'HERE'
g/regex/p
HERE
this command prints the lines I want to end up with, but it doesnt delete the others.... (2 Replies)
Discussion started by: drareeg
2 Replies
7. UNIX for Dummies Questions & Answers
I have a directory question where I ask the user which entry he wants to delete...
echo "Which entry?"
read entry
sed '/^'$entry'/d' file
This code does in fact delete that particular entry...
HOWEVER, when I go to inquire about that same entry, it still populates like it was never... (4 Replies)
Discussion started by: itech4814
4 Replies
8. Shell Programming and Scripting
/bin/sed -n ';4757335,$ p' | wc -l
/bin/sed -n ';4757335,$ p' | egrep "Failed" | egrep -c "PM late arrrival"
how can i combine the above two sed commands into one? i want to count the number of lines between the specified line number and the end of the file. AND and i want to count how many... (5 Replies)
Discussion started by: SkySmart
5 Replies
9. Shell Programming and Scripting
I have requirement in my every files starting lines have # needs to be not processing or exclude the that lines.
I have written a code like below, but now working as expected getting ERROR" line 60:
1 #!/bin/sh
2 echo ======= LogManageri start ==========
3
4 #This directory is... (1 Reply)
Discussion started by: Chenchireddy
1 Replies
10. Shell Programming and Scripting
I have a file like below
#Fields section bald
1234 2345 456 222
abcs dddd dddd ssss
mmmm mmm mmm
i need do not process a files stating with #
I was written code below
while read -r line
do
if
then
echo ${line} >>
elif
then
... (3 Replies)
Discussion started by: Chenchireddy
3 Replies
LEARN ABOUT DEBIAN
ns_connreturnforbidden
Ns_ConnReturnStatus(3aolserver) AOLserver Library Procedures Ns_ConnReturnStatus(3aolserver)
__________________________________________________________________________________________________________________________________________________
NAME
Ns_ConnReturnBadRequest, Ns_ConnReturnForbidden, Ns_ConnReturnInternalError, Ns_ConnReturnNoResponse, Ns_ConnReturnNotFound, Ns_ConnReturn-
NotImplemented, Ns_ConnReturnNotModified, Ns_ConnReturnOk, Ns_ConnReturnStatus, Ns_ConnReturnUnauthorized, Ns_RegisterRedirect - Routines
to return simple standard responses
SYNOPSIS
#include "ns.h"
int
Ns_ConnReturnBadRequest(conn, msg)
int
Ns_ConnReturnForbidden(conn)
int
Ns_ConnReturnInternalError(conn)
int
Ns_ConnReturnNoResponse(conn)
int
Ns_ConnReturnNotFound(conn)
int
Ns_ConnReturnNotImplemented(conn)
int
Ns_ConnReturnNotModified(conn)
int
Ns_ConnReturnOk(conn)
int
Ns_ConnReturnStatus(conn, status)
int
Ns_ConnReturnUnauthorized(conn)
void
Ns_RegisterRedirect(server, status, url)
ARGUMENTS
Ns_Conn conn (in) Pointer to open connection.
char *msg (in) String with additional message text.
int status (in) Integer HTTP status code.
char *url (in) String which specifies internal redirection url.
char *server(in) Virtual server.
_________________________________________________________________
DESCRIPTION
These routines are used to generate complete responses, including headers, approriate status codes, content types, and possibly short HTML
content messages for the most common HTTP error or status responses. They each coorespond to a particular HTTP status code, for example,
Ns_ConnReturnNotFound generates an HTTP 404 "Not Found" response. They all return NS_OK if the response was sent or NS_ERROR if an under-
lying routine failed.
The default behavior is to return an internal, server generated response possibly with a short English language message, for example "The
requested URL cannot be accessed by this server". This behavior can be modified by calling the Ns_RegisterRedirect to redirect responses
internally for the cooresponding HTTP status code to another URL on the server. The "redirects" server config section can be used to map
these redirects at startup
int Ns_ConnReturnBadRequest(conn, msg)
Returns an HTTP 400 response with the short HTML message "Invalid Request: The HTTP request presented by your browser is invalid."
The optional msg string, if present, is also included in the message body.
int Ns_ConnReturnForbidden(conn)
Returns an HTTP 403 response with the short HTML message "Forbidden: The requested URL cannot be accessed by this server."
int Ns_ConnReturnInternalError(conn)
Returns an HTTP 500 response with the short HTML message "Server Error: The requested URL cannot be accessed due to a system error
on this server."
int Ns_ConnReturnNoResponse(conn)
Equivalent to Ns_ConnReturnStatus(conn, 204).
int Ns_ConnReturnNotFound(conn)
Returns an HTTP 404 response with the short HTML message "Not Found: The requested URL was not found on this server."
int Ns_ConnReturnNotImplemented(conn)
Returns an HTTP 404 response with the short HTML message "Not Implemented: The requested URL or method is not implemented by this
server."
int Ns_ConnReturnNotModified(conn)
Equivalent to Ns_ConnReturnStatus(conn, 304).
int Ns_ConnReturnOk(conn)
Equivalent to Ns_ConnReturnStatus(conn, 200).
int Ns_ConnReturnStatus(conn, status)
Generates a response with the given HTTP status with no content.
int Ns_ConnReturnUnauthorized(conn)
Returns an HTTP 401 response with the short HTML message "Access Denied: The requested URL cannot be accessed because a valid user-
name and password are required." As "WWW-Authenticate: Basic realm=server realm" header is also included in the response.
void Ns_RegisterRedirect(server, status, url)
Redirect the above responses from the given server for the given status code from the simple internal messages described above to
the given internal url. The redirect is performed using Ns_ConnRedirect.
SEE ALSO
Ns_ConnFlush(3), Ns_ConnRedirect(3), Ns_ConnSetRequiredHeaders(3), Ns_ConnQueueHeaders(3), ns_return(n)
KEYWORDS
connnection, response
AOLserver 4.0 Ns_ConnReturnStatus(3aolserver)