Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

How do I merge multiple columns into one column?

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers How do I merge multiple columns into one column?
# 1  
Old 12-18-2012
Question How do I merge multiple columns into one column?
Hi all,

I'm looking for a way to merge multiple columns (from one file) into a single column in an output file.

The file I have looks somewhat like this:

Code:
@HWI-ST212	1:N:0	AGTCCTACCGGGAGT	+	@@@DDDDDHHHHHII
@HWI-ST212	1:N:0	CGTTTAAAAATTTCT	+	@;@B;DDDDH?:F;F
@HWI-ST212	1:N:0	TCGGAGATTCCGTAC	+	???DDDDDDDDDDII
@HWI-ST212	1:N:0	GGATATAGGCGATCT	+	@@@DDDDDFFFFFII

I'd like data from each line in the input file to appear in subsequent lines in the output file, like this:

Code:
@HWI-ST212
1:N:0
AGTCCTACCGGGAGT
+
@@@DDDDDHHHHHII
@HWI-ST212
1:N:0
CGTTTAAAAATTTCT
+
@;@B;DDDDH?:F;F
@HWI-ST212
1:N:0
TCGGAGATTCCGTAC
+
???DDDDDDDDDDII
@HWI-ST212
1:N:0
GGATATAGGCGATCT
+
@@@DDDDDFFFFFII

Does anybody know how to do this?

I'm rather a newbie, any help would be appreciated Smilie

Thanks.
# 2  
Old 12-18-2012
Code:
$ xargs -n1 < file
@HWI-ST212
1:N:0
AGTCCTACCGGGAGT
+
@@@DDDDDHHHHHII
@HWI-ST212
1:N:0
CGTTTAAAAATTTCT
+
@;@B;DDDDH?:F;F
@HWI-ST212
1:N:0
TCGGAGATTCCGTAC
+
???DDDDDDDDDDII
@HWI-ST212
1:N:0
GGATATAGGCGATCT
+
@@@DDDDDFFFFFII

To write it to a new file
Code:
$ xargs -n1 < file > newfile

This User Gave Thanks to Scott For This Post:
Vnguyen
# 3  
Old 12-18-2012
With awk..

Code:
awk '{ for(i=1;i<=NF;i++){ print $i}}' file > new_file

This User Gave Thanks to pamu For This Post:
Vnguyen
# 4  
Old 12-19-2012
Thanks Scott and pamu!
Both worked.
# 5  
Old 12-19-2012
Code:
$ nawk 'gsub("\t","\n")' input.txt
@HWI-ST212
1:N:0
AGTCCTACCGGGAGT
+
@@@DDDDDHHHHHII
@HWI-ST212
1:N:0
CGTTTAAAAATTTCT
+
@;@B;DDDDH?:F;F
@HWI-ST212
1:N:0
TCGGAGATTCCGTAC
+
???DDDDDDDDDDII
@HWI-ST212
1:N:0
GGATATAGGCGATCT
+
@@@DDDDDFFFFFII

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Join and merge multiple files with duplicate key and fill void columns

Join and merge multiple files with duplicate key and fill void columns Hi guys, I have many files that I want to merge: file1.csv: 1|abc 1|def 2|ghi 2|jkl 3|mno 3|pqr file2.csv: (5 Replies)
Discussion started by: yjacknewton
5 Replies

2. UNIX for Beginners Questions & Answers

Merge multiple columns into one using cat

I will like to merge several files using 'cat', but I observe the output is not consistent. the merge begins at the last line of the first file. file1.txt: 1234 1234 1234 file2.txt: aaaa bbbb cccc dddd cat file1.txt file2.txt > file3.txt file3.txt: 1234 1234 1234aaaa bbbb cccc... (13 Replies)
Discussion started by: geomarine
13 Replies

3. Shell Programming and Scripting

Seperated by columns, merge in a file, sort them on common column

Hi All, I have 4 files in below format. I took them as an example. File 1: Cut from position 1-4 then 6-7 then 8-14 then rest left and make them as columns in one new file. Inserting character H to the initial of all line like HCTOT. CTOT 456787897 Low fever CTOR 556712345 High fever... (2 Replies)
Discussion started by: Mannu2525
2 Replies

4. Shell Programming and Scripting

Merge columns from multiple files

Hello and Good day I have a lot of files with same number of rows and columns.$2 and $3 are the same in all files . I need to merge $2,$3,$6 from first file and $6 from another files. File1: $1 $2 $3 $4 $5 $6... (8 Replies)
Discussion started by: ali.seifaddini
8 Replies

5. Shell Programming and Scripting

Merge records based on multiple columns

Hi, I have a file with 16 columns and out of these 16 columns 14 are key columns, 15 th is order column and 16th column is having information. I need to concate the 16th column based on value of 1-14th column as key in order of 15th column. Here are the example file Input File (multiple... (3 Replies)
Discussion started by: Ravi Agrawal
3 Replies

6. UNIX for Dummies Questions & Answers

Merge columns from multiple files

Hi all, I've searched the web for a long time trying to figure out how to merge columns from multiple files. I know paste will append columns like so: paste file1 file2 file3 file4 file5 ... But this becomes inconvenient when you want to append a large number of files into a single file. ... (2 Replies)
Discussion started by: torchij
2 Replies

7. Shell Programming and Scripting

Multiple file merge by column

Hello all, I am quite new in linux shell scripting and I have this issue. I ve got some files including measurements taken every 10minutes for a whole day. File name format is: 00.00, 00.10, 00.20,....23.50 File structure is: x | y | temperature x and y is the same in all files (same... (12 Replies)
Discussion started by: atzounis
12 Replies

8. Shell Programming and Scripting

Merge two columns from two files into one if another column matches

I have two text files that look something like this: A:B:C 123 D:E:F 234 G:H:I 345 J:K:L 123 M:N:O 456 P:Q:R 567 A:B:C 456 D:E:F 567 G:H:I 678 J:K:L 456 M:N:O 789 P:Q:R 890 I want to find the line where the first column matches and then combine the second columns into a single... (8 Replies)
Discussion started by: pbluescript
8 Replies

9. Shell Programming and Scripting

How to merge multiple rows into single row if first column matches ?

Hi, Can anyone suggest quick way to get desired output? Sample input file content: A 12 9 A -0.3 2.3 B 1.0 -4 C 34 1000 C -111 900 C 99 0.09 Output required: A 12 9 -0.3 2.3 B 1.0 -4 C 34 1000 -111 900 99 0.09 Thanks (3 Replies)
Discussion started by: cbm_000
3 Replies

10. UNIX for Advanced & Expert Users

merge two column multiple files into one

Hi I have multiple files each with two columns and I need to combine all those file into a tab delimited file. (multiple entry with same name separated by a comma) The content of the files are as follows: --- file1.txt: name var1 aaa xx aaa gg bbb yy ddd zz --- file2.txt ... (8 Replies)
Discussion started by: mary271
8 Replies
Login or Register to Ask a Question