Merge two files with different lengths Post: 302797567

Sponsored Content

Top Forums Shell Programming and Scripting Merge two files with different lengths Post 302797567 by Don Cragun on Monday 22nd of April 2013 08:56:52 PM

04-22-2013

Registered User

Here are two awk scripts that I think do what you need. Use the 1st script if the field separator in either file is a mixture of spaces and tabs. Use the 2nd script if the field separator in both files is always a single space. In both cases, if you're using a Solaris/SunOS system, use /usr/xpg4/bin/awk, /usr/xpg6/bin/awk, or nawk instead of awk:

Code:

echo 1st form:
awk '
function gf1() {
        if((getline file1line < file1) != 1) exit(0)
        split(file1line, field, /[ \t]+/)
        key1 = field[1] FS field[2]
        return(1)
}
{       while(key1 < $1 FS $2) {
                if(key1) print key1 " 0 0 0 0"
                gf1()
        }
}
key1 == $1 FS $2 {
        print key1, $3, $4, $5, $6
        gf1()
}
END {   while(1) {
                print key1 " 0 0 0 0"
                gf1()
        }
}' file1=file1 file2 > file3

echo 2nd form:

awk '
function gf1() {
        if((getline key1 < file1) != 1) exit(0)
        return(1)
}
{       while(key1 < $1 FS $2) {
                if(key1) print key1 " 0 0 0 0"
                gf1()
        }
}
key1 == $1 FS $2 {
        print
        gf1()
}
END {   while(1) {
                print key1 " 0 0 0 0"
                gf1()
        }
}' file1=file1 file2 > file4

Note that the 2nd form sends output to file4 instead of file3 (so you can run both forms and compare the output).

This User Gave Thanks to Don Cragun For This Post:

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Using grep to find strings of certain lengths?

I am trying to use grep to find strings of certain lengths that all start with the same letter. Is this possible?:confused:

2. Shell Programming and Scripting

Merge files of differrent size with one field common in both files using awk

hi, i am facing a problem in merging two files using awk, the problem is as stated below, file1: A|B|C|D|E|F|G|H|I|1 M|N|O|P|Q|R|S|T|U|2 AA|BB|CC|DD|EE|FF|GG|HH|II|1 .... .... .... file2 : 1|Mn|op|qr

3. Solaris

limit on Solaris username lengths?

Hi this question applies to Solaris 8,9,10 and opensolaris as in my environment it applies to all of these Is there a limit on the size of the username (in /etc/passwd) or indeed does there come a point where, like the 8 character limitation of passwords, the system receives the input but...

4. Shell Programming and Scripting

Read lines with different lengths in while loop

Hi there ! I need to treat files with variable line length, and process the tab-delimited words of each line. The tools I know are some basic bash scripting and sed ... I haven't got to python or perl yet. So my file looks like this obj1 0.01953 0.34576 0.04418 0.01249 obj2 0.78140...

5. Shell Programming and Scripting

Merging data from 2 files of different lengths?

Hi all, Sorry if someone has answered something like this already, but I have a problem. I am not brilliant with "awk" but think it should be the command to use to get what I am after. I have 2 files: job-file (several hundred lines like): 1018003,LONG MU WAN,1113S 1018004,LONG MU...

6. Shell Programming and Scripting

Checking in a directory how many files are present and basing on that merge all the files

Hi, My requirement is,there is a directory location like: :camp/current/ In this location there can be different flat files that are generated in a single day with same header and the data will be different, differentiated by timestamp, so i need to verify how many files are generated...

7. Shell Programming and Scripting

Merge files and generate a resume in two files

Dear Gents, Please I need your help... I need small script :) to do the following. I have a thousand of files in a folder produced daily. I need first to merge all files called. txt (0009.txt, 0010.txt, 0011.txt) and and to output a resume of all information on 2 separate files in csv...

8. Shell Programming and Scripting

Paste files of varying lengths

I have three files of varying lengths and different number of columns. How can I paste all three with all columns aligned? File1 ---- 123 File2 ---- 234 345 678 File3 ---- 456 789 Output should look like: 123 234 456 345 789

9. UNIX for Advanced & Expert Users

UTF-8,16,32 character lengths using awk

Hi All, I am trying to obtain count of characters using awk, but "length" function returns a value of 1 for 2-byte or 3-byte characters as well unlike wc -c command. I have tried to use the below commands within awk function, but it does not seem to work { cmd="wc -c "stringtocheck ( cmd )...

10. Programming

Simple C program to count word lengths

So my program is not working and I keep changing it to figure out why. So I have two questions, can I do tracing similar to bash, and also what is wrong with this. The idea is simple, I want to count "word" lengths, with the loose definition of word not being a space, tab, or newline. Here is...

LEARN ABOUT CENTOS

intltool-merge

INTLTOOL-MERGE(8)					      System Manager's Manual						 INTLTOOL-MERGE(8)

NAME

       intltool-merge - merge translated strings into various types of file

SYNOPSIS

       intltool-merge [option]... PO_DIRECTORY FILENAME OUTPUT_FILE

DESCRIPTION

       Merge  translated strings in po files in PO_DIRECTORY with the original application file FILENAME, and output the file OUTPUT_FILE contain-
       ing both original and localized strings.

       If FILENAME is an XML file, OUTPUT_FILE will contain repeated xml nodes, where each  node  contains  one  of  the  localized  strings  with
       "xml:lang" attribute.

OPTIONS

   Mode of operation
       -b
       --ba-style
	   Merge files in bonobo-activation style, which is used for bonobo servers.

       -d
       --desktop-style
	   Merge files in desktop style, which is similar to the Windows .ini file format.

       -k
       --keys-style
	   Merge files in keys style, which is used for metadata.

       -o
       --oaf-style
	   (OBSOLETE) Same as -b/--ba-style.

       -r
       --rfc822deb-style
	   Merge files in RFC 822 style, which is usually used in Debian configuration files.

       --quoted-style
	   Merge files in quoted string style, which just translates any strings within "".

       -x
       --xml-style
	   Merge files in standard XML style, both as attributes and as raw pcdata.

   Other options
       -u
       --utf8
	   Convert all strings to UTF-8 before merging.

       -p
       --pass-through
	   Use strings as is in .po files without conversion (STRONGLY unrecommended with -x).

       -c
       --cache
	   (TBD)

       -q
       --quiet
	   Be quiet while running.

       -v
       --version
	   Show version information.

       -h
       --help
	   Show usage and basic help information.

FILES

       po/.intltool-merge-cache
	      Cache file generated by intltool-merge, that contains all strings in all po files separated by 1.

REPORTING BUGS

       Report bugs to http://bugs.launchpad.net/intltool

AUTHOR

       Darin Adler <darin@bentspoon.com>
       Kenneth Christiansen <kenneth@gnu.org>
       Maciej Stachowiak <mjs@eazel.com>

SEE ALSO

       iconv(1), intltoolize(8), intltool-prepare(8), intltool-extract(8), intltool-update(8)

intltool							    2003-08-02							 INTLTOOL-MERGE(8)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Using grep to find strings of certain lengths?

Discussion started by: crabtruck

2. Shell Programming and Scripting

Merge files of differrent size with one field common in both files using awk

Discussion started by: shashi1982

3. Solaris

limit on Solaris username lengths?

Discussion started by: hcclnoodles

4. Shell Programming and Scripting

Read lines with different lengths in while loop

Discussion started by: jossojjos