Sponsored Content
Top Forums Shell Programming and Scripting Extract information from Log file formatted Post 302503519 by rdcwayx on Thursday 10th of March 2011 08:27:16 PM
Old 03-10-2011
Code:
awk -F":" ' BEGIN{print "Group\tJobs\tWallClock\tCPU\tTotalMem\tMemory"}
{Jobs[$1]+=$3;WC[$1]+=$6;CPU[$1]+=$14;TM[$1]+=$37;Mem[$1]+=$38} 
END{for ( i in Jobs) printf "%s\t%d\t%d\t%d\t%d\t%d\n",i, Jobs[i],WC[i],CPU[i],TM[i],Mem[i]} ' $1

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to extract a piece of information from a huge file

Hello All, I need some assistance to extract a piece of information from a huge file. The file is like this one : database information ccccccccccccccccc ccccccccccccccccc ccccccccccccccccc ccccccccccccccccc os information cccccccccccccccccc cccccccccccccccccc... (2 Replies)
Discussion started by: Marcor
2 Replies

2. Shell Programming and Scripting

extract and format information from a file

Hi, Following is sample portion of the file; <JDBCConnectionPool DriverName="oracle.jdbc.OracleDriver" MaxCapacity="10" Name="MyApp_DevPool" PasswordEncrypted="{3DES}7tXFH69Xg1c=" Properties="user=MYAPP_ADMIN" ShrinkingEnabled="false" ... (12 Replies)
Discussion started by: sujoy101
12 Replies

3. Shell Programming and Scripting

Create shell script to extract unique information from one file to a new file.

Hi to all, I got this content/pattern from file http.log.20110808.gz mail1 httpd: Account Notice: close igchung@abc.com 2011/8/7 7:37:36 0:00:03 0 0 1 mail1 httpd: Account Information: login sastria9@abc.com proxy sid=gFp4DLm5HnU mail1 httpd: Account Notice: close sastria9@abc.com... (16 Replies)
Discussion started by: Mr_47
16 Replies

4. Shell Programming and Scripting

extract information from a log file (last days)

I'm still new to bash script , I have a log file and I want to extract the items within the last 5 days . and also within the last 10 hours the log file is like this : it has 14000 items started from march 2002 to january 2003 awk '{print $4}' < *.log |uniq -c|sort -g|tail -10 but... (14 Replies)
Discussion started by: matarsak
14 Replies

5. Shell Programming and Scripting

Extract various information from a log file

Hye ShamRock If you can help me with this difficult task for me then it will save my day Logs : ================================================================================================================== ... (4 Replies)
Discussion started by: SilvesterJ
4 Replies

6. Shell Programming and Scripting

How to extract information from a file?

Hi, i have a file like this: <Iteration> <Iteration_iter-num>3</Iteration_iter-num> <Iteration_query-ID>lcl|3_0</Iteration_query-ID> <Iteration_query-def>G383C4U01EQA0A length=197</Iteration_query-def> <Iteration_query-len>197</Iteration_query-len> ... (9 Replies)
Discussion started by: the_simpsons
9 Replies

7. Shell Programming and Scripting

Extract information from txt file

Hello! I need help :) I have a file like this: AA BC FG RF TT GH DD FF HH (a few number of rows and three columns) and I want to put the letters of each column in a variable step by step in order to give them as input in another script. So I would like to obtain: for the 1° loop:... (11 Replies)
Discussion started by: edekP
11 Replies

8. Shell Programming and Scripting

Extract information from file

Gents, If is possible please help. I have a big file (example attached) which contends exactly same value in column, but from column 2 to 6 these values are diff. I will like to compile for all records all columns like the example attached in .csv format (output.rar ).. The last column in the... (11 Replies)
Discussion started by: jiam912
11 Replies

9. Shell Programming and Scripting

Extract information from file

In a particular directory, there can be 1000 files like below. filename is job901.ksh #!/bin/ksh cront -x << EOJ submit file=$PRODPATH/scripts/genReport.sh maxdelay=30 &node=xnode01 tname=job901 &pfile1=/prod/mldata/data/test1.dat ... (17 Replies)
Discussion started by: vedanta
17 Replies

10. Shell Programming and Scripting

sed / awk / grep to extract information from log

Hi all, I have a query that runs that outputs data in the following format - 01/09/12 11:43:40,ADMIN,4,77,Application Group Load: Name(TESTED) LoadId(5137-1-0-1XX-15343-15343) File(/dir/dir/File.T03.CI2.RYR.2012009.11433350806.ARD) InputSize(5344) OutputSize(1359) Rows(2) Time(1.9960)... (8 Replies)
Discussion started by: jeffs42885
8 Replies
AND(8)							       Administrator's Tools							    AND(8)

NAME
and - auto nice daemon SYNOPSIS
and [-htvsxf] [-i interval] [-c /path/to/and.conf] [-d /path/to/and.priorities] VERSION
This manual page documents and version 1.2.2. DESCRIPTION
The auto nice daemon activates itself in certain intervals and renices and even kills jobs according to their priority and CPU usage. Renice levels and kill signals can be defined in terms of users, groups, and commands. Wildcards can be specified for any of these. In addition, commands can be specified using POSIX regular expressions. To allow for network-wide configuration and priority files, a mecha- nism for hostname-based evaluation is provided, again supporting regular expressions for specifying host names. Jobs owned by root are left alone. Jobs are never increased in their priority. Here are some real-world examples: A certain user is notorious for wasting CPU with next-to-irrelevant jobs. One line is sufficient to renice all of his jobs to about 19. This is a typical situation for a LART (Luser's Attitude Readjustment Tool) like and. A CPU server is dedicated to a certain group, but others may also use it when it's idle. Just define default nice levels of e.g. 18 and a lower nice level for the privileged group, say nice level 12. A certain web browser who shall remain unnamed tends to go berserk once in a while. You can configure and to kill -9 it after e.g. 20 CPU minutes. COMMAND-LINE OPTIONS -c /path/to/and.conf Specifies the configuration file. If this flag is omitted, /etc/and.conf is used instead. -d /path/to/and.priorities Specifies the priority database file. If this flag is omitted, /etc/and.priorities is used instead. -h Produces a short help text. -i interval Sets the interval between nice level checks. This flag overrides the interval specified in the configuration file, if any. The default interval of 60 seconds is used if neither -i nor an interval directive in the configuration file is given. -s Log to stdout. Without this switch, logging goes to syslog (normal operations) or ./debug.and (test mode). Useful for debugging config files. -t Run in test mode only, i.e. don't really renice or kill anything. In this mode, logging goes into ./debug.and instead of syslog. -v Increase verbosity. For maximum verbosity, this flag can be specified multiple times. Be warned that this will blow up your log files, so you should use it in test mode only. -x Run in full operational mode, i.e. really renice or kill things. This is the default. -f Foreground mode. Don't daemonize. SIGNALS
On kill -HUP the auto nice daemon will reload its configuration file and priority database. FILES
/etc/and.conf General configuration file. Stores default nice level, default interval, the "time zones" and the database lookup affinity. /etc/and.priorities The priority database (in plain text). Contains the (user, group, command, nicelevels) tuples. Both files have their own manual pages. ./debug.and Contains logging and status information for debugging purposes. Used in test mode only. SEE ALSO
and.conf(5), and.priorities(5), kill(1), regex(7), renice(8) INTERNET
http://and.sourceforge.net/ AUTHOR
The auto nice daemon and this manual page were written by Patrick Schemitz <schemitz@users.sourceforge.net> Unix 27 Mar 2005 AND(8)
All times are GMT -4. The time now is 10:28 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy