$ cat agg.awk
BEGIN { OFS = "\t" }
{
if ($1 != last) {
if (NR > 1) print last, a
last = $1
a = $2
} else a = a ", " $2
}
END { print last, a }
$ join -t$'\t' -a1 -a2 -e- -j1 -o0,1.2,2.2 <(awk -f agg.awk f1) <(awk -f agg.awk f2) |
join -t$'\t' -a1 -a2 -e- -j1 -o0,1.2,1.3,2.2 - <(awk -f agg.awk f3)
This code is incredible.
This works exactly what i wanted. Awesome.
Can you please explain the switches you used here especially join. Also if I have variable number of input files then how can I extend this.
* I never did awk programming but this works for me. I was using matlab to do this and is damn slow.
Thanks again.
---------- Post updated at 12:30 AM ---------- Previous update was at 12:28 AM ----------
Hi,
I need to join two files based on first column of both files.If first column of first file matches with the first column of second file, then the lines should be merged together and go for next line to check. It is something like:
File one:
110001 abc efd
110002 fgh dfg
110003 ... (10 Replies)
I have 100 data files labelled 250.1.txt through 250.100.txt. The second column of the data files partially match (there is about %90 overlap). Each data file has 4 columns.
I want the merge all these text files by the matching values in the second column. In the output, the first column should... (1 Reply)
Hi ,
I have few files which contains user name and data transfer rate in MBs and this data is collected for year and for each month report is saved in 12 different files I have to merge all the files to prepare the final report
Files are as below
Similarly I have 10 more files ... (5 Replies)
Hi,
Can anyone suggest quick way to get desired output?
Sample input file content:
A 12 9
A -0.3 2.3
B 1.0 -4
C 34 1000
C -111 900
C 99 0.09
Output required:
A 12 9 -0.3 2.3
B 1.0 -4
C 34 1000 -111 900 99 0.09
Thanks (3 Replies)
I have two text files that look something like this:
A:B:C 123
D:E:F 234
G:H:I 345
J:K:L 123
M:N:O 456
P:Q:R 567
A:B:C 456
D:E:F 567
G:H:I 678
J:K:L 456
M:N:O 789
P:Q:R 890
I want to find the line where the first column matches and then combine the second columns into a single... (8 Replies)
Hi all,
I'm looking for a way to merge multiple columns (from one file) into a single column in an output file.
The file I have looks somewhat like this:
@HWI-ST212 1:N:0 AGTCCTACCGGGAGT + @@@DDDDDHHHHHII
@HWI-ST212 1:N:0 CGTTTAAAAATTTCT + @;@B;DDDDH?:F;F... (4 Replies)
Hi Friends,
I have a file
file1.txt
1|ABC|3|jul|dhj
2|NHU|4|kil|eu
3|hjd|34|hfd|43
file2.txt
1||3|KING|dhj
2|NHU||k|
3|hjd|34|hd|43
i want to merge file1.txt file2.txt based on the column null values in file2.txif there are any nulls in column values , (5 Replies)
Hello all,
I am quite new in linux shell scripting and I have this issue.
I ve got some files including measurements taken every 10minutes for a whole day.
File name format is: 00.00, 00.10, 00.20,....23.50
File structure is: x | y | temperature
x and y is the same in all files (same... (12 Replies)
Hi,
Please excuse for often requesting queries and making R&D, I am trying to work out a possibility where i have two files field separated by pipe and another file containing only one field where there is no matching columns, Could you please advise how to merge two files.
$more... (3 Replies)
Hi all,
I have two separate csv files(comma delimited) file 1 and file 2.
File 1 contains
PAN,NAME,Salary
AAAAA5467D,Raj,50000
AAFAC5467D,Ram,60000
BDCFA5677D,Kumar,90000
File 2 contains
PAN,NAME,Dept,Salary
ASDFG6756T,Karthik,ABC,450000
QWERT8765Y,JAX,CDR,780000... (5 Replies)
Discussion started by: Nivas
5 Replies
LEARN ABOUT SUSE
end
END(7) SQL Commands END(7)NAME
END - commit the current transaction
SYNOPSIS
END [ WORK | TRANSACTION ]
DESCRIPTION
END commits the current transaction. All changes made by the transaction become visible to others and are guaranteed to be durable if a
crash occurs. This command is a PostgreSQL extension that is equivalent to COMMIT [commit(7)].
PARAMETERS
WORK
TRANSACTION
Optional key words. They have no effect.
NOTES
Use ROLLBACK [rollback(7)] to abort a transaction.
Issuing END when not inside a transaction does no harm, but it will provoke a warning message.
EXAMPLES
To commit the current transaction and make all changes permanent:
END;
COMPATIBILITY
END is a PostgreSQL extension that provides functionality equivalent to COMMIT [commit(7)], which is specified in the SQL standard.
SEE ALSO
BEGIN [begin(7)], COMMIT [commit(7)], ROLLBACK [rollback(7)]
SQL - Language Statements 2010-05-14 END(7)