Need shell script to read two file at same time and print out in single file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need shell script to read two file at same time and print out in single file
# 1  
Old 03-07-2009
Data Need shell script to read two file at same time and print out in single file

Need shell script to read two file at same time and print output in single file


Example I have two files 1) file1.txt 2) file2.txt

File1.txt contains

Aaa
Bbb
Ccc
Ddd
Eee
Fff


File2.txt contains

Zzz
Yyy
Xxx
www
vvv
uuu


I need output file like output.txt

Aaa
Zzz
-----
Bbb
Yyy
----
Ccc
Xxx
----
Ddd
www


please help me any one Smilie


# 2  
Old 03-07-2009
There are probably a million better ways to do this...
but here goes...
Code:
#!/bin/sh
linecount1=$(wc -l file1.txt | cut -d\  -f 1 )
linecount2=$(wc -l file2.txt | cut -d\  -f 1 )
i=1 j=1
while [ $i -le $linecount1 -a $j -le $linecount2 ]; do
    sed -n -e "${i}p" file1.txt >> output.txt
    sed -n -e "${j}p" file2.txt >> output.txt
    echo "-----" >> output.txt
    i=$(( i + 1 )); j=$(( j + 1))
done

I had to do the cut stuff when assigning linecount, because my wc -l prints the file name after the number of lines. (Debian)

Regards,
MD
# 3  
Old 03-08-2009
With (g|n|m)awk

Code:
awk 'NR==FNR{_[NR]=$0}NR!=FNR{print _[FNR] "\n" $0 "\n---"}' file1 file2

# 4  
Old 03-08-2009
ripat,

I knew there would be a better way, most likely awk.
Here, I try to explain how it works...
Code:
awk '
NR==FNR {_[NR]=$0}  
                    # NR is total number of lines read in both files.
                    # FNR is number of lines read, reset for each file.
                    # _[NR] is an array named _ with NR as index.
                    # This loads array with contents of file1,
                    # and ignores file2.
                    
NR!=FNR {print _[FNR] "\n" $0 "\n---"}
                    # This part ignores file1.
                    # For each line in file 2,
                    # Print the corresponding line from the array,
                    # using FNR as index.
                    # then a newline, then the line from file2,
                    # another newline, then the dashes, then another newline.
' file1 file2

Hopefully, this is a correct explanation.
I was initially confused by the _[NL] thing, thinking this was some kind of special awk reserved variable or something, but then I realized it's just an array named _
I guess that if file1 were super huge, you could run out of memory because it gets loaded into an array. There's probably a way to do this in perl that can handle huge files without slurping into an array...

Regards,
MD
# 5  
Old 03-08-2009
Quote:
Originally Posted by mjd_tech
Hopefully, this is a correct explanation.
That's exactly it.
Quote:
Originally Posted by mjd_tech
I was initially confused by the _[NL] thing, thinking this was some kind of special awk reserved variable or something, but then I realized it's just an array named _
_ has no special meaning. It's just a fast and, I confess, obfuscated way of writing array names.

Quote:
Originally Posted by mjd_tech
I guess that if file1 were super huge, you could run out of memory because it gets loaded into an array. There's probably a way to do this in perl that can handle huge files without slurping into an array...
Well, maybe. However, awk never hit the memory barrier on my systems even on large test files (1 Mega lines and more). But you are probably right. You could do that by parallel looping through two file handles in perl.
# 6  
Old 03-08-2009
Quote:
Originally Posted by mjd_tech
I guess that if file1 were super huge, you could run out of memory because it gets loaded into an array.
Code:
awk '{print;getline < "file1";print $0 "\n---"}' file2

Assuming the files have the same number of lines.

Regards
# 7  
Old 03-08-2009
thank you all for quick reply
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Creating script to read many files and load into database via single control file

Hi, I have many files but with only 2 names , I want to load the data of that file into database through sqlldr with single control file. how can i do that ????? Example: switch_file switch_file billing_file billing_file now these files should be loaded into same database but different... (1 Reply)
Discussion started by: niti_sharma
1 Replies

2. UNIX for Beginners Questions & Answers

Shell Script to Read the given file contents into a merged one file

Like to have shell script to Read the given file contents into a merged one file with header of path+file name followed by file contents into a single output file. While reading and merging the file contents into a single file, Like to keep the format of the source file. ... (4 Replies)
Discussion started by: Siva SQL
4 Replies

3. UNIX for Dummies Questions & Answers

Reading XML file and print the values in the text file using Linux shell script

hi guys, i want help... Reding XML file and print the values into the text file using linux shell script file as per below xml file <sequence> <Filename>aldorzum.doc</Filename> <DivisionCode>US</DivisionCode> <ContentType>Template</ContentType> <ProductCode>VIMZIM</ProductCode> </sequence>... (1 Reply)
Discussion started by: sravanreddy
1 Replies

4. Shell Programming and Scripting

Shell script to read specified value from file and echo to the same location to other file.

Hello. I want to to backup some "default:" values from a file do some other job and after restore that "default:" values back. The problem is that the source and destination file has a lot of default: strings in it but with different values... So.. Here is an example: A part of my source... (6 Replies)
Discussion started by: ausdim
6 Replies

5. Shell Programming and Scripting

Shell script to read file and check file type

Hi, I have a file with few values in it. I need script help to read file line by line and check: 1/if it's a file (with extension eg .java .css .jar etc ) or 2/if it's a file without extension and treat it as a directory and then check if the directory exists in working copy else create one... (6 Replies)
Discussion started by: iaav
6 Replies

6. Shell Programming and Scripting

script to read the contents of a file and print

Hi, Need help in writing a script to read the contents of this file test Test 00a 00b 00c 00d 00e 00f where it need to read each line to give a display such as form meta from dev 00a , config=Striped; add dev 00b:00f to meta 00a Can any one help me in writing this script (2 Replies)
Discussion started by: praveen1516
2 Replies

7. Shell Programming and Scripting

Read Oracle Username password SID from single file and pass it to shell

Dear All I am trying to write one shell which will be running through Cron which contain one SQL query. But I want to draw/fetch the Username password and Instance name (required to loging to the database) from one single file to run that SQL query . Also this file contain details of multiple... (2 Replies)
Discussion started by: jhon
2 Replies

8. Shell Programming and Scripting

search for the contents in many file and print that file using shell script

hello have a file1 H87I Y788O T347U J23U and file2 J23U U887Y I99U T556U file3 I99O J99T F557J file4 N99I T666U R55Y file5 H87I T347U file6 H77U R556Y E44T file7 Y788O K98U H8I May be using script we can use file1 to search for all the files and have the output H87I file5... (3 Replies)
Discussion started by: cdfd123
3 Replies

9. Shell Programming and Scripting

why shell scripting takes more time to read a file

i have done a coding in shell scripting which reads a file line by line and does something....it takes more than 30 seconds to execute for a single file. when i do the same with perl scripting it takes less than a second. is that shell scripting is not efficient while working with large number of... (1 Reply)
Discussion started by: brkavi_in
1 Replies
Login or Register to Ask a Question