Gawk --- produce the output in pattern space instead of END space
hi,
I'm trying to calculate IP addresses and their respective calls to our apache Server. The standard format of the input is
I'm using below given gawk code to do this ( that is accumulating all requests for all IPs in a given input file.
the problem:
input-file is actually around 47Gib in size and when I return the LINE array in END space of gawk, The process consumes all the available memory of the system and the system starts running out of memory for all other processes.
Question:
Can i return the LINE array in our pattern space rather than END space so that every IP matched is returned -- instead of adding it into array and then displaying the result.
------ Post updated at 02:16 PM ------
BTW, this code works fine for smaller file ( when I split the file into smaller chunks, which doesn't satisfy the requirement, as all the file must be scanned at once, so that I get all IPs list )
Hi....
I have a situation...I have a data file...that has space(an extra row with no data) at the end of file. I am trying to remove that spaces only if the file has a space at the end of file and if there is no space I don't want to do anything.
Can you please help me in this regards.
... (4 Replies)
Hi,
I have a txt file called a.txt which contain over 10,000 records and I would like to remove space before comma or after comma....like below:
The input (for example two record 00001,00002):
00001,client,card limited ,02292,N ,162:41 , 192, ... (6 Replies)
what can I use ??
In vi, I can use :set list <-- and see end of line $.. or use cat -A but I am wondering if there is command or program that allows me to see all the hidden characters( space, tab and etc)
Please help
thanks. (3 Replies)
cat file1|while read i
do
echo "$i"|wc
done
with this command the space in the end of the line not considered
how can solve that
for example:
read h
"hgyr "
echo "$h"|wc
4 (2 Replies)
Good afternoon! Im new at scripting and Im trying to write a script to
calculate total space, total used space and total free space in filesystem names matching a keyword (in this one we will use keyword virginia). Please dont be mean or harsh, like I said Im new and trying my best. Scripting... (4 Replies)
Hi
I guess this is very simple....
I want to add a space at the last line in a file.
The space has to be the last charachter on the last line, not at a new line.
Anyone ?? (7 Replies)
for eg:
i have i/p file as:
================
i
wnt
to
change end of line
=================
my require ouput is like:
i wnt to change end of line
==================== (7 Replies)
HI,
I need the help from the experts like I have created one file with text like:
Code:
a b c de f g hi j k l
So my question is that i have to write the script in which like in the first sentence it will take only one space after d and remove all the extra space in the end.I dont... (0 Replies)
I need to read in the string from input file and reform it by cut each segment and check the last segement lenght. If the last segment length is not as expected (see below segment file or table. It is predefined), then pad enough space.
Old string
FU22222222CA6666666666AKxvbFMddreeadBP999... (11 Replies)
Hi,
I have simply made a shell script to convert *.csv to *.xml file. Xml file is required for input to one tool. But i am getting space after last field. How can i remove it.
Shell script is as follows :-
if
then
echo ""
echo "Wrong syntax, Databse_update.sh... (6 Replies)
Discussion started by: stillrules
6 Replies
LEARN ABOUT DEBIAN
urls_txt
URLS.TXT(5) File Formats Manual URLS.TXT(5)NAME
urls.txt - URL database for regression testing
INTRODUCTION
The urls.txt file is installed by default in /etc/siege/urls.txt. When siege is invoked without a command line reference to a URL, then by
default it looks for urls in that file. The advantage of using the urls.txt file is two-fold: One, it frees you free retyping a url with
every invocation. And two, it allows you to conduct full site regression testing.
When the urls.txt file is used, siege reads all the urls in that file into memory and runs through the list in one of two ways, sequen-
tially or randomly. The default run is sequential from start to finish and back again until the --reps or the --time option has been satis-
fied. With the -i/--internet option selected, siege runs through the file randomly simulating the stress applied by a community of inter-
net users.
The -f/--file option allows you to select a file other then the default urls.txt file. You may also instruct siege to use a different file
with the "file" directive in .siegerc, i.e., "file = /usr/local/etc/urls.txt"
You may set and reference variables inside the urls.txt file. All variables must be declared BEFORE they are referenced. Variables are
declared with the "=" operator, VARIABLE = VALUE. They are then referenced inside $() or ${}, example: $(HOST), ${HOST}
HOST=joey.joedog.org
http://${HOST}/browse.jsp?size=5
http://${HOST}/admin.jsp?name=ralph
EXAMPLE FILE
This is an exmple urls.txt file. Lines beginning with a hash (#) are comments and ignored by siege.
#
# Example urls.txt file
# URLs database for siege
#
http://www.haha.com/index.html
http://www.haha.com/howto/index.html
http://www.haha.com/cgi-bin/howto/display.cgi?1013
www.haha.com/cgi-bin/fm.cgi?first=j.&last=fulmer
https://www.haha.com/index.shtml
https://www.whoohoo.com/my_whoohoo.jsp
# POST data requires a POST directive
www.haha.com/cgi-bin/foo.cgi POST first=bart&last=simpson
www.haha.com/hoho.jsp POST name=jeff&pass=secret
# POST the contents of a file using the
# line input character "<"
http://www.haha.com/my.jsp POST </home/jeff/data.txt
AUTHOR
Jeffrey Fulmer <jeff@joedog.org>, et al.
BUGS
Report bugs to jeff@joedog.org. Give a detailed description of the problem and report the version of siege that you are using.
COPYRIGHT
Copyright (C) 2007 Jeffrey Fulmer, et al.
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER-
CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
Inc., 675 Mass Ave, Cambridge, MA 02139, USA.
AVAILABILITY
The most recent released version of siege is available by anonymous FTP from ftp.joedog.org in the directory pub/siege.
SEE ALSO siege(1)siege.config(1)layingsiege(7)Siege v2.70 April-17-2012 URLS.TXT(5)