The short answer is to process f2 first, then process f1. This will reduce your memory footprint as you'll only save 68 things in a[] rather than 48K things.
The long answer is to be a bit more clever which might also help speed things up. Your programme will loop through the entire contents of file f1 for each record in f2 (48,000 * 68) testing to see if there's a match. Instead, use the hash capabilities of awk to your advantage.
This example assumes that the 'key' (field 1 in file 2) can occur multiple times and so we must do a bit of looping for each f1 record, but the only looping needed when reading limited to the number of duplicate 'keys' that existed in f2 for the current f1 record. If f2 will not have duplicates, then the code can be simplified more, but not knowing you exact data, this general case will work for either. We also don't need to make an explicit check to see if the key in the current record matches the one saved from f2.
Hope this makes sense.
Last edited by agama; 06-19-2011 at 12:07 PM..
Reason: Corrected printf to output f2 then f1
As I know:
FNR: The ordinal number of the current record in the current file.
NR: The ordinal number of the current record from the start of input.
I don't understand really differency between NR and FNR. Who can explain it for me? And give me an example.
Thanks (1 Reply)
hi, i have two files, both with 3 columns, the 3rd column has common values between the two files and i want to produce a 3rd file with 4 columns.
file 1
a, ,b c
file 2
a, b ,d
I want to compare the 3rd value and if a match print to file 3 with the 3 columns from the first file... (11 Replies)
awk -F'' 'FNR==NR {a=$2; next} {$1=a} 1' $useralias ${entries} >> ${entries}_2
Hi,
Is there anyway to alter this command so that if it does not find a match it will just leave the line alone instead of replacing what it doesn't find with a blank space? (4 Replies)
I dont want to print the output in a EMC VMAX storage if it says "The specified device was not found", however it is not letting me do it.
I am trying to run this command:
symaccess -sid xxxx list -type storage -devs 1234
output:
The specified device was not found
I just want the script... (1 Reply)
Example:
$ cat file1
2
3$ cat file2
1
2
3
4
5
6The following awk script works like a charm, NR==FNR is true for file1, the remainder runs for file2:
awk '
NR==FNR {A; next}
($1 in A)
' file1 file2
2
3Now have an empty file1:
>file1and run the awk script again.
The result is empty... (8 Replies)
Hi everybody!
need some awk-support. i want a line-selective printout of a file.
wat i normally will do with ...
awk ' FNR==8' sample.txt
But now i need the data from line 8, 10 and the following data from line13 to 250 wich is not end of the file. I tried allready to combine it but without... (2 Replies)
To merge mutiple *.tab files as:
file1.tab
rs1 A A
rs2 A A
rs3 C C
rs4 C Cfile2.ind
rs1 T T
rs2 T T
rs3 G G
rs4 G Gand file3.tab
rs1 B B
rs2 B B
rs3 L L
rs4 L LOutput:
file1.tab file2.tab file3.tab
AA TT BB
AA TT BB
CC GG LL
CC GG ... (4 Replies)
Sorry for the probably strangely worded title but I don't really know how else to put it.
Background context: Post processing LAMMPS simulation data.
tl;dr: I'm making two spheres collide, every defined timestep the simulation outputs a bunch of data including total energy of the particles,... (10 Replies)
Discussion started by: ThomasP
10 Replies
LEARN ABOUT OSX
tdbtool
TDBTOOL(8)TDBTOOL(8)NAME
tdbtool - manipulate the contents TDB files
SYNOPSIS
tdbtool
tdbtool TDBFILE [COMMANDS...]
DESCRIPTION
This tool is part of the samba(1) suite.
tdbtool a tool for displaying and altering the contents of Samba TDB (Trivial DataBase) files. Each of the commands listed below can be
entered interactively or provided on the command line.
COMMANDS
create TDBFILE
Create a new database named TDBFILE.
open TDBFILE
Open an existing database named TDBFILE.
erase
Erase the current database.
dump
Dump the current database as strings.
cdump
Dump the current database as connection records.
keys
Dump the current database keys as strings.
hexkeys
Dump the current database keys as hex values.
info
Print summary information about the current database.
insert KEY DATA
Insert a record into the current database.
move KEY TDBFILE
Move a record from the current database into TDBFILE.
store KEY DATA
Store (replace) a record in the current database.
show KEY
Show a record by key.
delete KEY
Delete a record by key.
list
Print the current database hash table and free list.
free
Print the current database and free list.
! COMMAND
Execute the given system command.
first
Print the first record in the current database.
next
Print the next record in the current database.
quit
Exit tdbtool.
CAVEATS
The contents of the Samba TDB files are private to the implementation and should not be altered with tdbtool.
VERSION
This man page is correct for version 3.0.25 of the Samba suite.
AUTHOR
The original Samba software and related utilities were created by Andrew Tridgell. Samba is now developed by the Samba Team as an Open
Source project similar to the way the Linux kernel is developed.
TDBTOOL(8)