07-28-2008
How to combine data files using for loop
Hi,
I have 5 files basically;namely file1.txt situated each at folder A to E respectively.
I would like to extract out third column from each of these file1.txt from folder A to folder E. Also, I wanted to extract the first and second column which are common. In other words, e.g
A/file1.txt
1 1 10
B/file1.txt
1 1 20
C/file1.txt
1 1 30
D/file1.txt
1 1 40
E/file1.txt
1 1 50
I tried
dirs=(A,B,C,D,E);
files=(file1.txt);
for file in "${files[@]}";
do for dir in "${dirs[@]}";
do awk {'print $3 '} "$dir/$file" >test.txt
done
done
This only able to print out the 3rd column separately. Ultimately, I wanted to have the below output in an external file (test.txt):-
1 1 10 20 30 40 50
The file1.txt might have more than one line. The above file1.txt data is just an example.
Thanks.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hi,
to all
give me some idea below scripts
file=`cat filelist`
for filename in $file
do
awk '{
if ($0 ~ /system/ && flag == 0) {
flag=1;
print $0;
}
else if ($0 ~ /system/ && flag == 1) {
printf("%s SYSLAY %s %s %s\n",$1,$3, $4, $5);
}
else
print $0;
}' $filename >... (6 Replies)
Discussion started by: LAKSHMI NARAYAN
6 Replies
2. UNIX for Dummies Questions & Answers
Using dd or similar tools to recover data from 2 damaged cdroms, I need a way to then combine the 2 files, 1 from each cd, and make a good file: this all result from finding that certain cd's tops scratch easily even when using the "proper" cd markers, hence making the file useless, however the... (1 Reply)
Discussion started by: saint65
1 Replies
3. Shell Programming and Scripting
my first post ... please be gentle.
I have been working on a script to get info out of mysql. Its a support ticket system database OTRS. I can write the subject of open tickets to a text file with a unique user id.
I also have a text file with the unique user id, username and email adres. I... (11 Replies)
Discussion started by: dicenl
11 Replies
4. Shell Programming and Scripting
hi people;
this is my file1.txt:192.168.1.1
192.168.1.2
192.168.1.3
192.168.1.4
...
this is my file2.txt:portnames
usernames
maxusercap
...
i want to write to file3.txt:l ./getports 192.168.1.1 'get all;l+;get . portnames;l-'
l ./getports 192.168.1.1 'get all;l+;get . usernames;l-'... (4 Replies)
Discussion started by: gc_sw
4 Replies
5. Shell Programming and Scripting
Dear friends,
I am just trying to print data from 2 file,namely file_1.txt and file_1.dat (specific column of ROW 1)
file_1.txt
12 13 14 15 99 AMC 69 36 89
12 13 14 15 99 AMC 69 84 -12
12 13 14 ... (6 Replies)
Discussion started by: nex_asp
6 Replies
6. Shell Programming and Scripting
I have a main file as follows
aaa 3/2 = 1.5
aba 55+6 = 61
aca 67+8 = 75
hjk 3+3 = 67
ghd 66+30 = 96
ghj 99-3 = 96
ffg 67+3 = 70
I have 4 sub files named sub1, sub2, sub3, sub4
content of sub1
aaa 23+5 = 28
hjk 45+6 = 51
ghd 40-20 = 20
... (2 Replies)
Discussion started by: jackevan
2 Replies
7. Shell Programming and Scripting
i made a script on my own. this is for the inventory to all of my AWS servers, and i run it to all of my servers to get the hostname, please look at file2. Then i need some data in file3 as well,. i need to combine them
#cat file1
192.10.1.41
server.age.com
######
192.10.0.40
ssh cant... (10 Replies)
Discussion started by: kenshinhimura
10 Replies
8. Shell Programming and Scripting
File 1
ID Name Po1 Po2
DD134 DD134_4A_1 NN-1 L_0_1
DD134 DD134_4B_1 NN-2 L_1_1
DD134 DD134_4C_1 NN-3 L_2_1
DD142 DD142_4A_1 NN-1 L_0_1
DD142 DD142_4B_1 NN-2 L_1_1
DD142 DD142_4C_1 NN-3 L_2_1
DD142 DD142_3A_1 NN-41 L_3_1
DD142 DD142_3A_1 NN-42 L_3_2
File 2 ( Combination of... (1 Reply)
Discussion started by: pareshkp
1 Replies
9. Shell Programming and Scripting
Hi,
How can I combine the data of of three files into one new file?
I try to give as much informations as possible.
The three existing files are called file1 file2 and file3
the new file should named output_combined.
The size of the files will be around 900 words/lines each .. but always... (5 Replies)
Discussion started by: MyMemberName
5 Replies
10. UNIX for Beginners Questions & Answers
i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies
XZDIFF(1) XZ Utils XZDIFF(1)
NAME
xzcmp, xzdiff, lzcmp, lzdiff - compare compressed files
SYNOPSIS
xzcmp [cmp_options] file1 [file2]
xzdiff [diff_options] file1 [file2]
lzcmp [cmp_options] file1 [file2]
lzdiff [diff_options] file1 [file2]
DESCRIPTION
xzcmp and xdiff invoke cmp(1) or diff(1) on files compressed with xz(1), lzma(1), gzip(1), or bzip2(1). All options specified are passed
directly to cmp or diff. If only one file is specified, then the files compared are file1 (which must have a suffix of a supported com-
pression format) and file1 from which the compression format suffix has been stripped. If two files are specified, then they are uncom-
pressed if necessary and fed to cmp(1) or diff(1). The exit status from cmp or diff is preserved.
The names lzcmp and lzdiff are provided for backward compatibility with LZMA Utils.
SEE ALSO
cmp(1), diff(1), xz(1), gzip(1), bzip2(1), zdiff(1)
BUGS
Messages from the cmp(1) or diff(1) programs refer to temporary filenames instead of those specified.
Tukaani 2009-07-05 XZDIFF(1)