Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to combine data files using for loop
Top Forums Shell Programming and Scripting How to combine data files using for loop Post 302219052 by ahjiefreak on Monday 28th of July 2008 02:52:39 AM
Old 07-28-2008
How to combine data files using for loop
Hi,

I have 5 files basically;namely file1.txt situated each at folder A to E respectively.

I would like to extract out third column from each of these file1.txt from folder A to folder E. Also, I wanted to extract the first and second column which are common. In other words, e.g

A/file1.txt
1 1 10

B/file1.txt
1 1 20

C/file1.txt
1 1 30

D/file1.txt
1 1 40

E/file1.txt
1 1 50

I tried

dirs=(A,B,C,D,E);
files=(file1.txt);

for file in "${files[@]}";

do for dir in "${dirs[@]}";
do awk {'print $3 '} "$dir/$file" >test.txt

done

done

This only able to print out the 3rd column separately. Ultimately, I wanted to have the below output in an external file (test.txt):-
1 1 10 20 30 40 50

The file1.txt might have more than one line. The above file1.txt data is just an example.

Thanks.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

i want to combine two awk scripts which is having same loop and filelist

hi, to all give me some idea below scripts file=`cat filelist` for filename in $file do awk '{ if ($0 ~ /system/ && flag == 0) { flag=1; print $0; } else if ($0 ~ /system/ && flag == 1) { printf("%s SYSLAY %s %s %s\n",$1,$3, $4, $5); } else print $0; }' $filename >... (6 Replies)
Discussion started by: LAKSHMI NARAYAN
6 Replies

2. UNIX for Dummies Questions & Answers

Recover data from 2 files then combine

Using dd or similar tools to recover data from 2 damaged cdroms, I need a way to then combine the 2 files, 1 from each cd, and make a good file: this all result from finding that certain cd's tops scratch easily even when using the "proper" cd markers, hence making the file useless, however the... (1 Reply)
Discussion started by: saint65
1 Replies

3. Shell Programming and Scripting

combine data of 2 files by variable

my first post ... please be gentle. I have been working on a script to get info out of mysql. Its a support ticket system database OTRS. I can write the subject of open tickets to a text file with a unique user id. I also have a text file with the unique user id, username and email adres. I... (11 Replies)
Discussion started by: dicenl
11 Replies

4. Shell Programming and Scripting

get data from files combine them to a file

hi people; this is my file1.txt:192.168.1.1 192.168.1.2 192.168.1.3 192.168.1.4 ... this is my file2.txt:portnames usernames maxusercap ... i want to write to file3.txt:l ./getports 192.168.1.1 'get all;l+;get . portnames;l-' l ./getports 192.168.1.1 'get all;l+;get . usernames;l-'... (4 Replies)
Discussion started by: gc_sw
4 Replies

5. Shell Programming and Scripting

How to combine data from 2 file ? How to print ?

Dear friends, I am just trying to print data from 2 file,namely file_1.txt and file_1.dat (specific column of ROW 1) file_1.txt 12 13 14 15 99 AMC 69 36 89 12 13 14 15 99 AMC 69 84 -12 12 13 14 ... (6 Replies)
Discussion started by: nex_asp
6 Replies

6. Shell Programming and Scripting

How to combine the data of files?

I have a main file as follows aaa 3/2 = 1.5 aba 55+6 = 61 aca 67+8 = 75 hjk 3+3 = 67 ghd 66+30 = 96 ghj 99-3 = 96 ffg 67+3 = 70 I have 4 sub files named sub1, sub2, sub3, sub4 content of sub1 aaa 23+5 = 28 hjk 45+6 = 51 ghd 40-20 = 20 ... (2 Replies)
Discussion started by: jackevan
2 Replies

7. Shell Programming and Scripting

Combine/omit data from 2 files

i made a script on my own. this is for the inventory to all of my AWS servers, and i run it to all of my servers to get the hostname, please look at file2. Then i need some data in file3 as well,. i need to combine them #cat file1 192.10.1.41 server.age.com ###### 192.10.0.40 ssh cant... (10 Replies)
Discussion started by: kenshinhimura
10 Replies

8. Shell Programming and Scripting

Combine data from two files base on uniq data

File 1 ID Name Po1 Po2 DD134 DD134_4A_1 NN-1 L_0_1 DD134 DD134_4B_1 NN-2 L_1_1 DD134 DD134_4C_1 NN-3 L_2_1 DD142 DD142_4A_1 NN-1 L_0_1 DD142 DD142_4B_1 NN-2 L_1_1 DD142 DD142_4C_1 NN-3 L_2_1 DD142 DD142_3A_1 NN-41 L_3_1 DD142 DD142_3A_1 NN-42 L_3_2 File 2 ( Combination of... (1 Reply)
Discussion started by: pareshkp
1 Replies

9. Shell Programming and Scripting

Combine data out of 3 files into one new file

Hi, How can I combine the data of of three files into one new file? I try to give as much informations as possible. The three existing files are called file1 file2 and file3 the new file should named output_combined. The size of the files will be around 900 words/lines each .. but always... (5 Replies)
Discussion started by: MyMemberName
5 Replies

10. UNIX for Beginners Questions & Answers

Automate splitting of files , scp files as each split completes and combine files on target server

i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies

LEARN ABOUT OSF1

rmf

rmf(1)							      General Commands Manual							    rmf(1)

NAME

       rmf - remove folder (only available within the message handling system, mh)

SYNOPSIS

       rmf [+folder] [-help] [-[no]interactive]

OPTIONS

       Prints  a  list of the valid options to this command.  Asks for confirmation before deleting a folder. By default, rmf deletes a folder and
       its messages without asking for confirmation.  If you specify the -interactive option, rmf asks if you are sure before deleting the folder.
       You are advised to use this option, since when rmf deletes a folder its contents are lost irretrievably.

DESCRIPTION

       The  rmf  command  removes all of the messages within the current folder, and then removes the folder itself. If there are any files within
       the folder which are not part of MH, they are not removed, and an error message is displayed.

       You can specify a folder other than the current folder by using the +folder argument. If you do not specify a folder, and rmf  cannot  find
       the current folder,rmf asks you whether you want to delete +inbox instead.

       If the current folder is removed, it makes +inbox current.

       Note that the rmf command irreversibly deletes messages that do not have other links, so use it with caution.

       If  the	folder	being removed is a sub-folder, the parent folder becomes the new current folder, and rmf tells you that this has happened.
       This provides an easy mechanism for selecting a set of messages, operating on the list, then removing the list and returning to the current
       folder from which the list was extracted.

       Using  rmf  to  delete a read-only folder deletes the private sequence and current message information from the file, without affecting the
       folder itself. If you have sub-folders within a folder, you must delete all the sub-folders before you can delete the folder itself.

PROFILE COMPONENTS

       Path: To determine the user's Mail directory

EXAMPLES

       This example shows how rmf asks for confirmation when the -interactive option is used: % rmf -interactive +test Remove folder "test"? y

FILES

       The user profile.

SEE ALSO

       rmm(1)

																	    rmf(1)
All times are GMT -4. The time now is 06:40 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy