How do I merge multiple columns into one column?


 
Thread Tools Search this Thread
# 1  
Question How do I merge multiple columns into one column?

Hi all,

I'm looking for a way to merge multiple columns (from one file) into a single column in an output file.

The file I have looks somewhat like this:

Code:
@HWI-ST212	1:N:0	AGTCCTACCGGGAGT	+	@@@DDDDDHHHHHII
@HWI-ST212	1:N:0	CGTTTAAAAATTTCT	+	@;@B;DDDDH?:F;F
@HWI-ST212	1:N:0	TCGGAGATTCCGTAC	+	???DDDDDDDDDDII
@HWI-ST212	1:N:0	GGATATAGGCGATCT	+	@@@DDDDDFFFFFII

I'd like data from each line in the input file to appear in subsequent lines in the output file, like this:

Code:
@HWI-ST212
1:N:0
AGTCCTACCGGGAGT
+
@@@DDDDDHHHHHII
@HWI-ST212
1:N:0
CGTTTAAAAATTTCT
+
@;@B;DDDDH?:F;F
@HWI-ST212
1:N:0
TCGGAGATTCCGTAC
+
???DDDDDDDDDDII
@HWI-ST212
1:N:0
GGATATAGGCGATCT
+
@@@DDDDDFFFFFII

Does anybody know how to do this?

I'm rather a newbie, any help would be appreciated Smilie

Thanks.
# 2  
Code:
$ xargs -n1 < file
@HWI-ST212
1:N:0
AGTCCTACCGGGAGT
+
@@@DDDDDHHHHHII
@HWI-ST212
1:N:0
CGTTTAAAAATTTCT
+
@;@B;DDDDH?:F;F
@HWI-ST212
1:N:0
TCGGAGATTCCGTAC
+
???DDDDDDDDDDII
@HWI-ST212
1:N:0
GGATATAGGCGATCT
+
@@@DDDDDFFFFFII

To write it to a new file
Code:
$ xargs -n1 < file > newfile

This User Gave Thanks to Scott For This Post:
# 3  
With awk..

Code:
awk '{ for(i=1;i<=NF;i++){ print $i}}' file > new_file

This User Gave Thanks to pamu For This Post:
# 4  
Thanks Scott and pamu!
Both worked.
# 5  
Code:
$ nawk 'gsub("\t","\n")' input.txt
@HWI-ST212
1:N:0
AGTCCTACCGGGAGT
+
@@@DDDDDHHHHHII
@HWI-ST212
1:N:0
CGTTTAAAAATTTCT
+
@;@B;DDDDH?:F;F
@HWI-ST212
1:N:0
TCGGAGATTCCGTAC
+
???DDDDDDDDDDII
@HWI-ST212
1:N:0
GGATATAGGCGATCT
+
@@@DDDDDFFFFFII

 

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Merge multiple columns into one using cat

I will like to merge several files using 'cat', but I observe the output is not consistent. the merge begins at the last line of the first file. file1.txt: 1234 1234 1234 file2.txt: aaaa bbbb cccc dddd cat file1.txt file2.txt > file3.txt file3.txt: 1234 1234 1234aaaa bbbb cccc... (13 Replies)
Discussion started by: geomarine
13 Replies

2. Shell Programming and Scripting

Seperated by columns, merge in a file, sort them on common column

Hi All, I have 4 files in below format. I took them as an example. File 1: Cut from position 1-4 then 6-7 then 8-14 then rest left and make them as columns in one new file. Inserting character H to the initial of all line like HCTOT. CTOT 456787897 Low fever CTOR 556712345 High fever... (2 Replies)
Discussion started by: Mannu2525
2 Replies

3. Shell Programming and Scripting

Merge columns from multiple files

Hello and Good day I have a lot of files with same number of rows and columns.$2 and $3 are the same in all files . I need to merge $2,$3,$6 from first file and $6 from another files. File1: $1 $2 $3 $4 $5 $6... (8 Replies)
Discussion started by: ali.seifaddini
8 Replies

4. Shell Programming and Scripting

Merge records based on multiple columns

Hi, I have a file with 16 columns and out of these 16 columns 14 are key columns, 15 th is order column and 16th column is having information. I need to concate the 16th column based on value of 1-14th column as key in order of 15th column. Here are the example file Input File (multiple... (3 Replies)
Discussion started by: Ravi Agrawal
3 Replies

5. UNIX for Dummies Questions & Answers

Merge columns from multiple files

Hi all, I've searched the web for a long time trying to figure out how to merge columns from multiple files. I know paste will append columns like so: paste file1 file2 file3 file4 file5 ... But this becomes inconvenient when you want to append a large number of files into a single file. ... (2 Replies)
Discussion started by: torchij
2 Replies

6. Shell Programming and Scripting

Multiple file merge by column

Hello all, I am quite new in linux shell scripting and I have this issue. I ve got some files including measurements taken every 10minutes for a whole day. File name format is: 00.00, 00.10, 00.20,....23.50 File structure is: x | y | temperature x and y is the same in all files (same... (12 Replies)
Discussion started by: atzounis
12 Replies

7. Shell Programming and Scripting

Merge two columns from two files into one if another column matches

I have two text files that look something like this: A:B:C 123 D:E:F 234 G:H:I 345 J:K:L 123 M:N:O 456 P:Q:R 567 A:B:C 456 D:E:F 567 G:H:I 678 J:K:L 456 M:N:O 789 P:Q:R 890 I want to find the line where the first column matches and then combine the second columns into a single... (8 Replies)
Discussion started by: pbluescript
8 Replies

8. Shell Programming and Scripting

How to merge multiple rows into single row if first column matches ?

Hi, Can anyone suggest quick way to get desired output? Sample input file content: A 12 9 A -0.3 2.3 B 1.0 -4 C 34 1000 C -111 900 C 99 0.09 Output required: A 12 9 -0.3 2.3 B 1.0 -4 C 34 1000 -111 900 99 0.09 Thanks (3 Replies)
Discussion started by: cbm_000
3 Replies

9. UNIX for Advanced & Expert Users

merge two column multiple files into one

Hi I have multiple files each with two columns and I need to combine all those file into a tab delimited file. (multiple entry with same name separated by a comma) The content of the files are as follows: --- file1.txt: name var1 aaa xx aaa gg bbb yy ddd zz --- file2.txt ... (8 Replies)
Discussion started by: mary271
8 Replies

10. UNIX for Dummies Questions & Answers

Writing a loop to merge multiple files by common column

I have 100 data files labelled 250.1.txt through 250.100.txt. The second column of the data files partially match (there is about %90 overlap). Each data file has 4 columns. I want the merge all these text files by the matching values in the second column. In the output, the first column should... (1 Reply)
Discussion started by: evelibertine
1 Replies

Featured Tech Videos