Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Merging two files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Merging two files
# 1  
Old 07-16-2012
Power Merging two files
Guys,

I am having little problem with getting a daily report!

The daily process that I do is as follows
HTML Code:
1. Unload Header for the report from the systables to one unl file, say Header.unl
2. Unload the data from the required table/tables to another unl file, say Data.unl
3. Send a mail consolidating these unl files as a report
What I have done for automating this is, written a script that unloads these files from the server. Here is where the trouble came Smilie

I used,

Code:
 cat Header.unl ##All the header data will be in a single line(used perl for this)
echo ""
cat Data.unl

But this is turning out to be ugly. No formatting, proper spacing etc.

Please suggest any ideas that would transform the script to do as below,
HTML Code:
1. Convert the Header.unl(with mulitple lines) to a single line file
2. Merge the new Header.unl and Data.unl to another file so that, all the columns are properly spaced, like one tabspace b/w every column
Header.unl
HTML Code:
Head1|
Head2|
Head3|
Data.unl
HTML Code:
1231|txt|this|
345|blah|that|
56741|awesome|plam|
Output expected Smilie
HTML Code:
Head1    Head2    Head3
1231    txt    this
345    blah    that
56741    awesome    plam
# 2  
Old 07-16-2012
Hello, PikK45:

Code:
paste -sd '\0' Header.unl | cat - Data.unl | sed 's/|$//; y/|/<tab>/'

Note: Replace <tab> with a literal tab character (or space if you prefer).

That assumes that the trailing pipe isn't intended to create an empty field at the end of every single line in your sample data. If it is, then this simpler alternative will do the job:
Code:
paste -sd '\0' Header.unl | cat - Data.unl | tr '|' '\t'

Regards,
Alister
# 3  
Old 07-16-2012
With awk (assuming that Header.unl contains no blank lines between data lines):

Code:
awk 'NR==1{gsub(/\n/,"");RS="\n"} {sub(/\|$/,"");gsub(/\|/,"\t")}1' RS="" Header.unl Data.unl

Last edited by elixir_sinari; 07-16-2012 at 11:36 AM.. Reason: Escaped the alternation metacharacter
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merging two files

Hi All , I have a scenario where we need to combine two files . Below are the sample files and expected output , File 1: 1|ab 1|ac 1|ae 2|ad 2|ac File 2: 1|xy 1|fc 2|gh 2|ku Output file : 1|ab|xy (3 Replies)
Discussion started by: saj
3 Replies

2. Shell Programming and Scripting

Help with merging 2 files into 1

::::::::: ::FileA:: ::::::::: A1-------A2--------A3---A4---A5-- ================================= AC5VXVLT-XX---------------------- B57E434--XXXX1-----MMMM-ZZZ--111- C325G20--XXXXX3----CCCC------3332 DC35S51--XXXXY1----DDDD------44X- DC35S52--XXXXY2----DDDD------44Y-... (5 Replies)
Discussion started by: lordsmiter
5 Replies

3. Shell Programming and Scripting

Merging two files with same name

Hello all, I have limited experience in shell scripting. Here goes my question: I have two directories that have same number of files with same file names i.e. consider 2 directories A and B. Both directories have files 1.txt, 2.txt...... I need to merge the file 1.txt of A with file 1.txt... (5 Replies)
Discussion started by: jaysean
5 Replies

4. Shell Programming and Scripting

Merging files

I have two files file 1 containing x rows and 1 column file 2 containing x rows and 1 column I want to merge both the files and add a comma between the two eg plz guide (1 Reply)
Discussion started by: test_user
1 Replies

5. UNIX for Dummies Questions & Answers

Merging two files

Hi, I have two files a.txt and b.txt. a.txt 1 2 3 4 b.txt a b c d e I want to generate a file c.txt by merging these two file and the resultant file would contain c.txt 1 (4 Replies)
Discussion started by: siba.s.nayak
4 Replies

6. Shell Programming and Scripting

merging of files.

Hi, I want to merge the two files on the basis of columns like... file 1 Data Key A 12 B 13 file2 Data Value A A1 A A2 B B1 B B2 (5 Replies)
Discussion started by: clx
5 Replies

7. Shell Programming and Scripting

merging two files

Hi everyone, I have two files which will be exactly same at first. After sometime there will be inserts in one file. My problem is how to reflect these changes in second file also. I found out that any compare and merge utility would do the job like, GNU " sdiff " command. But the... (14 Replies)
Discussion started by: rameshonline
14 Replies

8. Shell Programming and Scripting

Help with merging files

i would like to merge two files that have the same format but have different data. i would like to create one output file that contains information from both the original files.:rolleyes: (2 Replies)
Discussion started by: joe black
2 Replies

9. Shell Programming and Scripting

Merging 2 files

Hi, I have got two files 1.txt 1111|apple| 2222|orange| 2.txt 1111|1234|000000000004356| 1111|1234|000000001111| 1111|1234|002000011112| 2222|5678|000000002222| 2222|9102|000000002222| I need to merge these two so that my out put looks like below: Search code being used should be... (4 Replies)
Discussion started by: jisha
4 Replies

10. Shell Programming and Scripting

merging files

Thanks in advance I have 2 files having key field in each.I would like to join both on common key.I have used join but not sucessful. The files are attached here . what i Want in the output is on the key field SLS OFFR . I have used join commd but not successful. File one ======= SNO ... (6 Replies)
Discussion started by: vakharia Mahesh
6 Replies
Login or Register to Ask a Question