12-28-2008
Help with grepping and line number
I need help with extracting data from a large file ~900mb. Below is how the data looks like,
line number value
1001 1
0000
... ...
5001 5
0000
6001 6
0000
... ...
10001 10
0000
... ...
100001 100
0000
basically i need to grep lines starting from line 1001 and keep grepping line data for every 1000 after that. this is because after a certain number of lines ******** is displayed for the values which is problematic for my usual grepping scheme and hence my need to use the grep line number method. any help on the command for doing this would be much appreciated
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Ok heres the situation.
I'm grepping for all running processes with the name system. but there are also processes running with the name systema. How do I just search for processes running just under the "system" user
Thanks in advance (1 Reply)
Discussion started by: fusion99
1 Replies
2. Shell Programming and Scripting
Having problem in using the grep command to select all possible combinations a number in a file. Example: 123, I would like to grep the numbers 123,132,213,231,312 and 321. (2 Replies)
Discussion started by: wperry
2 Replies
3. Shell Programming and Scripting
I have a pattern::
xldn3176bap>arj SOCRATES_MAIN_LNX | grep " FA "
10/04/2007 21:01 10/04/2007 21:01 FA 1776752/1 1
I want the line above this line and the line below it too. Can anyone tell me how it can be done?
- iAm4Free (4 Replies)
Discussion started by: iAm4Free
4 Replies
4. Shell Programming and Scripting
I've got a file which I am reading line by line (using read line) into a variable.
I then want to do a grep on that line to check for something. I've tried a number of methods none of which seem to work.
I thought I had it with the code below but for some reason it doesn't like it and comes... (4 Replies)
Discussion started by: QueryMaster
4 Replies
5. Shell Programming and Scripting
Hi,
I have a huge file & I want to add a specific text in column. But I want to add this text from a specific line number to a specific line number & another text in to another range of line numbers.
To be more specific: lets say my file has 1000 lines & 4 Columns. I want to add text "Hello"... (2 Replies)
Discussion started by: Ezy
2 Replies
6. UNIX for Dummies Questions & Answers
How do you grep every nth line number from a file? (2 Replies)
Discussion started by: shabs1985
2 Replies
7. Shell Programming and Scripting
I've got this command that I've been using to find strings on the same line, say I'm doing a search for name:
find . -name "*" | xargs grep -i "Doe" | grep -i "John" > output.txt
This gives me every line in a file that has John and Doe in it. I'm looking to add a OR operator for the second... (5 Replies)
Discussion started by: Rally_Point
5 Replies
8. Shell Programming and Scripting
Hi,
I need a regular expression grepping all lines starting with '*' followed by a VARIOUS number of blanks and then followed by the string 'Runjob=1'.
I tried that code, but it doesn't work:
grep -i '*'+'Runjob=1' INPUT_FILE >>OUTPUT_FILE
Can someone help me?
Thanks (8 Replies)
Discussion started by: ABE2202
8 Replies
9. Shell Programming and Scripting
I want to grep out a part of a snort rule based on the SID given, but all i want as the output is the part in the quotes after the msg: An example line looks something like this:
alert tcp any any -> 127.0.0.1 any (msg:"Example Message"; classtype:Example; sid:123456;)
I would want it to... (7 Replies)
Discussion started by: riott
7 Replies
10. UNIX for Dummies Questions & Answers
Hello Everyone.
I am trying to display contains of a file from a specific line to a specific line(let say, from line number 3 to line number 5). For this I got the shell script as shown below:
if ; then
if ; then
tail +$1 $3 | head -n $2
else
... (5 Replies)
Discussion started by: grc
5 Replies
LEARN ABOUT DEBIAN
logtop
LOGTOP(1) General Commands Manual LOGTOP(1)
NAME
logtop - Realtime log line rate analyser
SYNOPSIS
logtop [OPTIONS]
DESCRIPTION
logtop is a System Administrator tool analyzing line rate on stdin.
It reads on stdin and print a constantly updated result
displaying, in columns:
Line number, count, frequency, and the actual line.
$ tail -f FILE | logtop
is the friendly version of:
$ watch 'tail FILE | sort | uniq -c | sort -gr'
OPTIONS
-s, --size=K
Only keep K lines in memory, instead of 10000.
-q, --quiet
Do not display a live view of the data, only display a top at exit.
-l, --line-by-line=K
Print result line by line, in a machine friendly format, K is the number of result to print per line.
Line by line format is : [%d %f %s ]*
%d : Number of occurences
%f : Frequency of apparition
%s : String (Control chars replaced by dots.
-i, --interval=K
Interval between graphical updates, in seconds. Defaults to 1.
-h, --help
Show summary of options.
-v, --version
Show version of program.
EXAMPLES
Here are some logtop usage examples.
tail -f cache.log | grep -o "HIT|MISS" | logtop
Realtime hit / miss ratio on some caching software log file.
tail -f access.log | cut -d' ' -f1 | logtop -s 10000
Realtime most querying IPs on your server, as long as log lines in access.log starts with the client IP.
tail -f access.log | cut -d' ' -f7 | logtop -s 10000
Realtime most requested web pages in a NCSA like log file.
cat auth.log | grep -v "CRON" | grep -o ": .*" | logtop -q -s 100000
Display a one-shot simple analyse of your auth.log.
SEE ALSO
watch(1)
AUTHOR
logtop was written by Julien Palard.
This manual page was written by Julien Palard <julien@palard.fr>, for the Debian project (and may be used by others).
April 16, 2011 LOGTOP(1)