awk is designed to process big flatfiles, it should do well here. Thousands of files of thousands of lines comes to millions of lines, which is not unfeasible.
There's always ways to make things faster, of course. Will you be doing lots of things like
If so, you could do awk '{...}' file1 file2 file3 file4 ... > output
...which would save a lot of time since file1 wouldn't need to be read thousands of times, just once.
If you need different files for each one that's still possible, but would need changes to the code.
Last edited by Corona688; 07-17-2013 at 12:37 PM..
how can i use awk or sed to do a conditional statement, so that
HH:MM
if MM not great than 30 , then MM=00
else MM=30
ie:
10:34 will display 10:30
10:29 will display 10:00
a=$(echo 10:34 | awk ......)
Thanks in advance (10 Replies)
Hello guys,
I want to make a conditional cause in the following file using awk:
awk '{ if ($2 != 0) print $1, $2, $3}' test.csv > test2.csv
FILE EXAMPLE = test.csv
string,number,date
abc,0,20050101
def,1,20060101
ghi,2,20040101
jkl,12,20090101
mno,123,20020101 ... (2 Replies)
Hi Guys,
i have this files:
xyz20080716.log
opqrs20080716.log
abcdef20080716.log
xyz20080717.log
oprs20080717.log
abcde20080717.log
currentdate: 20080717.log
I want to make script to zip the file for past day. Can anyone help for this? i've just learn awk scripting & still confused with... (3 Replies)
Dear all,
I want to use awk to read the three columns in a file called "test" and change them to ( 1.5 1.5 1.5) if any element is found to be greater than three. A part of the file is shown below:
(0.478318 0.391032 -0.14054)
(0.45562 0.392523 -0.121685)
(0.437204 0.392811 -0.106158)... (3 Replies)
I have a column of numbers $2, I would like to add 360 to all numbers that are negative. This method seems a bit convoluted, and does not work (outputs 0):
BEGIN {
A=sprintf("%d", $2);
if(A<0) A=A+360;
BIN++;
}
END { for(A in BIN) print... (5 Replies)
Hi all,
I have a file containing the values that would be use as the basis for printing the lines of another set of files using awk. What I want to do is something like the one below:
stdev.txt
0.21
0.42
0.32
0.25
0.15
file1.txt file2.txt file3.txt ..filen.txt
0.45 0.23 ... (4 Replies)
Hi,
I have a file in the following format:
aabbba 25.31806899
baaabb 38.21808852
cccccu 1.31819523
552258121.31818253
ffddybb 5.41815555
almcamc87561812689
223aqas5.661828345
adacaaaaaaa1821285
adacaaaaaaa1821286
smckaa 3.81828756
ada2512510c1821287
ada2522511c1821328... (4 Replies)
Hello,
How can I use a conditional to produce an output file that varies with respect to the contents of column #4 in the data file:
Data file:
9780020080954 9.95 0.49 AS 23.3729
9780020130857 9.95 0.49 AS 23.3729
9780023001406 22.20 0.25 AOD ... (12 Replies)
Heya
I'm trying to get to know awk a bit better.
So i'm trying to get used to calls saving me a grep invocation just to get a specific part of a single line.
This said, i want to get the current screen resolution according to xrandr's output.
Screen 0: minimum 8 x 8, current 1920 x 1080,... (1 Reply)
I am having a difficult time getting an awk one-liner to work correctly that runs a mathematical operation upon values in a field when matching a given criteria.
I would like to subtract 1 from every value in field $6 that is greater than 12. In this particular case it is only a constant of... (3 Replies)
Discussion started by: jvoot
3 Replies
LEARN ABOUT BSD
join
JOIN(1) General Commands Manual JOIN(1)NAME
join - relational database operator
SYNOPSIS
join [ options ] file1 file2
DESCRIPTION
Join forms, on the standard output, a join of the two relations specified by the lines of file1 and file2. If file1 is `-', the standard
input is used.
File1 and file2 must be sorted in increasing ASCII collating sequence on the fields on which they are to be joined, normally the first in
each line.
There is one line in the output for each pair of lines in file1 and file2 that have identical join fields. The output line normally con-
sists of the common field, then the rest of the line from file1, then the rest of the line from file2.
Fields are normally separated by blank, tab or newline. In this case, multiple separators count as one, and leading separators are dis-
carded.
These options are recognized:
-an In addition to the normal output, produce a line for each unpairable line in file n, where n is 1 or 2.
-e s Replace empty output fields by string s.
-jn m Join on the mth field of file n. If n is missing, use the mth field in each file.
-o list
Each output line comprises the fields specified in list, each element of which has the form n.m, where n is a file number and m is a
field number.
-tc Use character c as a separator (tab character). Every appearance of c in a line is significant.
SEE ALSO sort(1), comm(1), awk(1)BUGS
With default field separation, the collating sequence is that of sort -b; with -t, the sequence is that of a plain sort.
The conventions of join, sort, comm, uniq, look and awk(1) are wildly incongruous.
7th Edition April 29, 1985 JOIN(1)