Sponsored Content
Full Discussion: Combining multiple files
Top Forums Shell Programming and Scripting Combining multiple files Post 302784795 by Don Cragun on Saturday 23rd of March 2013 05:27:00 AM
Old 03-23-2013
You could try something like:
Code:
awk '
FNR == 1 {   
        f[++fc] = FILENAME
        if(w[fc] < length(FILENAME)) w[fc] = length(FILENAME)
}
FNR == NR {
        d[++lc] = $1
        t[lc] = $2
}
{       v[fc,$1,$2] = $3
        if(w[fc] < length($3)) w[fc] = length($3)
}
END {   printf("    Date  Time")
        for(j = 1; j <= fc; j++)
                printf("%*s%s", w[j] + 1, f[j], j == fc ? "\n" : "")
        for(i = 1; i <= lc; i++) {
                printf("%s%6s", d[i], t[i])
                for(j = 1; j <= fc; j++)
                        printf("%*d%s", w[j] + 1, v[j, d[i], t[i]],
                                j == fc ? "\n" : "")
        }
}' FILE[12]

If you are running on a Solaris/SunOS system, use /usr/xpg4/bin/awk or nawk instead of awk.

Note that this script will work for two or more files, but the 1st file given must include all date/time pairs that you want to appear in the output.

With the FILE1 and FILE2 contents specified in the 1st message in this thread, the output produced by this script is:
Code:
    Date  Time FILE1 FILE2
20130322 05:35  2219   170
20130322 05:40  1809   169
20130322 05:45  1617   172
20130322 05:50  1359   171
20130322 05:55  2233     0
20130322 06:00  1648     0
20130322 06:05  1552   176

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Combining Multiple files in one in a perl script

All, I want to combine multiple files in one file. Something like what we do on the commad line as follows -> cat file1 file2 file3 > Main_File. Can something like this be done in a perl script very efficiently? Thanks, Rahul. (1 Reply)
Discussion started by: rahulrathod
1 Replies

2. Shell Programming and Scripting

Merge text files while combining the multiple header/trailer records into one each.

Situation: Our system currently executes a job (COBOL Program) that generates an interface file to be sent to one of our vendors. Because this system processes information for over 100,000 employees/retirees (and growing), we'd like to multi-thread the job into processing-groups in order to... (4 Replies)
Discussion started by: oordonez
4 Replies

3. Shell Programming and Scripting

Combining multiple files into one with the same name/different extension

I've been trying to find information in regard to creating a script that will generate HTML files. I currently have a series of files that contain code I need to surround with a <textarea> tag for easy viewing. I have about a thousand files that contain code, one file that contains the HTML code up... (10 Replies)
Discussion started by: 12o
10 Replies

4. Shell Programming and Scripting

Combining columns from multiple files to one file

I'm trying to combine colums from multiple file to a single file but having some issues, appreciate your help. The filenames are the same except for the extension, path1.m0 --------- a b c d e f g h i path1.m1 --------- m n o p q r s t u File names are path1.m The... (3 Replies)
Discussion started by: rkmca
3 Replies

5. Shell Programming and Scripting

Combining multiple column files into one with file name as first row

Hello All, I have several column files like this $cat a_b_s1.xls 1wert 2tg 3asd 4asdf 5asdf $cat c_d_s2.xls 1wert 2tg 3asd 4asdf 5asdf desired put put $cat combined.txt s1 s2 (2 Replies)
Discussion started by: avatar_007
2 Replies

6. UNIX for Dummies Questions & Answers

Need help combining txt files w/ multiple lines into csv single cell - also need data merge

:confused:Hello -- i just joined the forums. I am a complete noob -- only about 1 week into learning how to program anything... and starting with linux. I am working in Linux terminal. I have a folder with a bunch of txt files. Each file has several lines of html code. I want to combine... (2 Replies)
Discussion started by: jetsetter
2 Replies

7. Shell Programming and Scripting

Combining columns from multiple files into one single output file

Hi, I have 3 files with one column value as shown File: a.txt ------------ Data_a1 Data_a2 File2: b.txt ------------ Data_b1 Data_b2 Data_b3 Data_b4 File3: c.txt ------------ Data_c1 Data_c2 Data_c3 Data_c4 Data_c5 (6 Replies)
Discussion started by: vfrg
6 Replies

8. Shell Programming and Scripting

Join two files combining multiple columns and produce mix and match output

I would like to join two files when two columns in each file matches with each other and then produce an output when taking multiple columns. Like I have file A 1234,ABCD,23,JOHN,NJ,USA 2345,ABCD,24,SAM,NY,USA 5678,GHIJ,24,TOM,NY,USA 5678,WXYZ,27,MAT,NJ,USA and file B ... (2 Replies)
Discussion started by: mady135
2 Replies

9. UNIX for Beginners Questions & Answers

Combining multiple files into one

Hello Everyone, I have 4 different files (one column in each) that I'm trying to combine into 1 file with four columns. Having issues trying to get the columns to format properly. I have tried the following: paste file1 file2 file3 file4 | column -s $'\t' -t > results.txt paste file1 file2... (1 Reply)
Discussion started by: malk71
1 Replies

10. Shell Programming and Scripting

Combining certain columns of multiple files into one file

Hello Unix gurus, I have a large number of files (say X) each containing two columns of data and the same number of rows. I would like to combine these files to create a unique merged file containing X columns corresponding to the second column of each file (with a bonus of having the first... (3 Replies)
Discussion started by: ksennin
3 Replies
CHPASS(1)						      General Commands Manual							 CHPASS(1)

NAME
chpass - add or change user database information SYNOPSIS
chpass [ -a list ] [ user ] DESCRIPTION
Chpass allows editing of the user database information associated with user or, by default, the current user. The information is formatted and supplied to an editor for changes. The vi editor will be used unless the environmental variable EDITOR selects an alternate editor. When the editor terminates, the information is re-read and used to update the user database itself. Only the user, or the super-user, may edit the information associated with the user. Only the information that the user is allowed to change is displayed. Possible display items are as follows: Login: user's login name Password: user's encrypted password Uid: user's id Gid: user's login group id Change: password change time Expire: account expiration time Class: user's general classification Home Directory: user's home directory Shell: user's login shell Full Name: user's real name Location: user's normal location Home Phone: user's home phone Office Phone: user's office phone The login field is the user name used to access the computer account. The password field contains the encrypted form of the user's password. The uid field is the number associated with the login field. Both of these fields should be unique across the system (and often across a group of systems) as they control file access. While it is possible to have multiple entries with identical login names and/or identical user id's, it is usually a mistake to do so. Routines that manipulate these files will often return only one of the multiple entries, and that one by random selection. The group field is the group that the user will be placed in upon login. Since this system supports multiple groups (see groups(1)) this field currently has little special meaning. This field may be filled in with either a number or a group name (see group(5)). The change field is the date by which the password must be changed. The expire field is the date on which the account expires. Both the change and expire fields should be entered in the form ``month day year'' where month is the month name (the first three charac- ters are sufficient), day is the day of the month, and year is the year. The class field is currently unused. In the near future it will be a key to a termcap(5) style database of user attributes. The user's home directory is the full UNIX path name where the user will be placed on login. The shell field is the command interpreter the user prefers. If the shell field is empty, the Bourne shell (/bin/sh) is assumed. When altering a login shell, and not the super-user, the user must select an approved shell from the list in /etc/shells. The last four fields are for storing the user's full name, office location, and home and work telephone numbers. The super-user is also allowed to directly supply a user database entry, in the format specified by passwd(5), as an argument to the -a option. This argument must be a colon (``:'') separated list of all the user database fields, although they may be empty. Once the information has been verified, chpass uses mkpasswd(8) to update the user database. This is run in the background, and, at very large sites could take several minutes. Until this update is completed, the password file is unavailable for other updates and the new information will not be available to programs. FILES
/etc/master.passwd The user database /etc/shells The list of approved shells SEE ALSO
login(1), finger(1), getusershell(3), passwd(5), mkpasswd(8), vipw(8) Robert Morris and Ken Thompson, UNIX password security BUGS
User information should (and eventually will) be stored elsewhere. 4th Berkeley Distribution March 12, 1989 CHPASS(1)
All times are GMT -4. The time now is 04:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy