11-03-2013
Thanks! I'm checking for format issues in the input files!
---------- Post updated at 08:22 PM ---------- Previous update was at 04:18 PM ----------
Still can't get it working
With 40 lines things run smoothly but with 45000 lines - invain.
---------- Post updated at 08:27 PM ---------- Previous update was at 08:22 PM ----------
Could there be a size limit with AWK? (file1 1.5 MB, file2 10 MB)
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello!
I am writing a program to run through two large lists of data (~300,000 rows), find where rows in one file match another, and combine them based on matching fields. Due to the large file sizes, I'm guessing AWK will be the most efficient way to do this. Overall, the input and output I'm... (5 Replies)
Discussion started by: Michelangelo
5 Replies
2. Shell Programming and Scripting
Hello,
I am newbie in awk. I have just started learning it.
1) I have input file which looks like:
{4812 4009 1602 2756 306} {4814 4010 1603 2757 309} {8116 9362 10779 }
{10779 10121 9193 10963 10908} {1602 2756 306 957 1025} {1603 2757 307}
and so on.....
2) In output:
a)... (10 Replies)
Discussion started by: kajolo
10 Replies
3. Shell Programming and Scripting
Dear All,
I would like to add values of a field, if the lines match in a certain field. Then I would like to divide the sum though the number of lines that have a matched field. This is the Input:
Input:
Test1 5
Test1 10
Test2 2
Test2 5
Test2 13
Test3 4
Output:
Test1 7.5
Test1 7.5... (6 Replies)
Discussion started by: DerSeb
6 Replies
4. Shell Programming and Scripting
Hoping for some assistance.
my source file consists of:
os, ip, username
win7, 123.56.78, john
win7, 123.56.78, paul
win7, 10.1.1.1, john
win7, 10.2.2.3, joe
I've been trying to run a script that will only return ip and username where the IP address is the same and the username is... (3 Replies)
Discussion started by: tekvaio
3 Replies
5. Shell Programming and Scripting
Hello,
I'm trying to get the TOP and BASE numbers printed out
File looks like this:
2300 CAR # 2300 is the TOP
2310 CAR
2335 CAR
2455 CAR # 2455 is the BASE
1000 MOTOR # 2455 will become this TOP
2000 MOTOR
3000 MOTOR
4000 MOTOR # 4000 is the BASE
2345 BIKE # 4000... (8 Replies)
Discussion started by: charlieglen
8 Replies
6. UNIX for Advanced & Expert Users
grep -v will exclude matching lines, but I want something that will print all lines but exclude a matching field. The pattern that I want excluded is '/mnt/svn'
If there is a better solution than awk I am happy to hear about it, but I would like to see this done in awk as well. I know I can... (11 Replies)
Discussion started by: glev2005
11 Replies
7. UNIX for Beginners Questions & Answers
Hi,
I have 2 tab-delimited input files as follows.
file1.tab:
green A apple
red B apple
file2.tab:
apple - A;Z
Objective:
Return $1 of file1 if,
. $1 of file2 matches $3 of file1 and,
. any single element (separated by ";") in $3 of file2 is present in $2 of file1
In order to... (3 Replies)
Discussion started by: beca123456
3 Replies
8. Shell Programming and Scripting
Trying to use awk to match the contents of each line in file1 with $5 in file2. Both files are tab-delimited and there may be a space or special character in the name being matched in file2, for example in file1 the name is BRCA1 but in file2 the name is BRCA 1 or in file1 name is BCR but in file2... (6 Replies)
Discussion started by: cmccabe
6 Replies
9. UNIX for Beginners Questions & Answers
I apologize in advance, but I continue to have trouble searching for matches between two files and then printing portions of each to output in awk and would very much appreciate some help.
I have data as follows:
File1
PS012,002 PRQ 0 1 1 17 1 0 -1 3 2 1 2 -1 ... (7 Replies)
Discussion started by: jvoot
7 Replies
10. UNIX for Beginners Questions & Answers
Hello all, I am having trouble with what should be an easy task, but seem to be missing something fundamental. I have two files, with File 1 consisting of a single field of many thousands of records. I also have File 2 with two fields and many thousands of records.
My goal is that when $1 of... (2 Replies)
Discussion started by: jvoot
2 Replies
LEARN ABOUT DEBIAN
root-tail
ROOTTAIL(1) General Commands Manual ROOTTAIL(1)
NAME
root-tail - print text directly to X11 root window
SYNOPSIS
root-tail [-g|--geometry GEOMETRY] [-fn|--font FONTSPEC] [--color color] [--reload SEC COMMAND] [--shade] [--outline] [--minspace]
[--noflicker] [-f|--fork] [--reverse] [--whole] [--partial] [--update] [--cont STRING] [--wordwrap] [--justify] [--noinitial] [--frame]
[-id ID] [-i|--interval SECONDS] [-V] file1[,color[,desc]] [file2[,color[,desc]]]
DESCRIPTION
Displays a given file anywhere on your X11 root window, i.e. it is kind of tail -f for multiple files using your desktop background as out-
put window.
All non-option arguments on the command line are files to be logged. A null desc (example: "/var/log/messages,red,") will prevent the
printing of a description and the []'s.
General Options
--color COLOR
Use COLOR as default.
--font | -fn FONTSPEC
Use font FONTSPEC. This can be either a fixed width font like -fn fixed or any font using -fn '-*-*-*-*-*-*-*-*-*-*-*-*-*-*' with
the appropriate fields filled out (see xfontsel). Specifying a different FONTSPEC before each filename will cause each file to be
displayed in a different font.
-f | --fork
Forks to the background.
--reverse
Display the files in reverse order, with the newest lines at the top.
--whole
Only display whole lines. If the last line of a file doesn't yet end with a newline character then wait until it does before dis-
playing it. This is the default if more than one file is being displayed.
--partial
This is the opposite of the --whole option (see above). It displays lines even if they don't yet have a newline at the end. This is
the default if only one file is being displayed.
--update
Update partial lines 'in place' if they are still on the screen when they are updated in their files. Using --update automatically
turns on --partial.
--cont STRING
When partial lines are broken into two lines in the display, prefix the 2nd line with STRING. Defaults to "|| ". Specify the
"--whole" argument to ensure partial lines are never displayed, or specify "--update" to attempt to "repair" broken lines in-place.
--cont-color COLOR
Use COLOR when displaying the continuation string (as optionally specified with the --cont option above).
--wordwrap
The default behaviour is to fit as much as possible onto each line of output, even if this means splitting a word between one line
and the next. The --wordwrap argument splits lines at spaces if possible.
--justify
After wrapping long lines, attempt to justify the text to produce a smooth right-hand margin. Implies --wordwrap.
--reload SEC COMMAND
Re-display the file(s) and run COMMAND every SEC seconds. The default is to never re-display the file(s).
--shade
Add black shading to the font.
--outline
Add a black outline to the font (making redraws quite a bit slower).
--minspace
Use minimum linespace even when using shading or outlining. This might result in leftover pixels (dependign on font and logfile con-
tent).
--noflicker
Use slower but flicker-free update.
--noinitial
Don't display the end of the file(s) initially.
-id ID Use the given window ID for output instead of the root window.
-i | --interval SECONDS
Use the specified sleeping interval between checks instead of the default 2.4 seconds. Fractional values are OK.
-V Print version information.
--frame
Draw a frame around the selected area. This is useful when trying to find the perfect geometry.
EXAMPLE
root-tail -g 800x250+100+50 -font 10x20 /var/log/messages,green -font 12x24 /var/log/secure,red,'ALERT'
BUGS
Some desktop environments open a virtual root window and make it difficult to share it. If you cannot see anything after starting root-
tail, try to find a setting "allow programs on desktop" or similar, or manually specify a window id.
Should you happen to find any bugs please fix them and send me a diff.
NOTE: This program was modified by Marc Lehmann <pcg@goof.com>, who couldn't reach the original author. Please direct bug-reports etc. to
pcg@goof.com.
http://root-tail.plan9.de/
4.2 Berkeley Distribution 2004-03-27 ROOTTAIL(1)