Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Merge multiple columns into one using cat
Top Forums UNIX for Beginners Questions & Answers Merge multiple columns into one using cat Post 303018122 by wisecracker on Tuesday 29th of May 2018 12:53:20 PM
Old 05-29-2018
Hi geomarine...

Think of your problem and how to get round it.
You want a single file in UNIX format.

Here is a DEMO of your two files:
Code:
#!/bin/sh
# All longhand to see the sequence of events.

echo "Create files as per OP."
printf "1234\r\n1234\r\n1234" > /tmp/file1.txt
printf "aaaa\r\nbbbb\r\ncccc\r\ndddd" > /tmp/file2.txt
echo "Join together to test."
cat /tmp/file1.txt /tmp/file2.txt > /tmp/file3.txt
cat -v /tmp/file3.txt
echo ""
echo "Remove ^M, <CR> character and create temp files 4 and 5..."
tr -d '\r' < /tmp/file1.txt > /tmp/file4.txt
tr -d '\r' < /tmp/file2.txt > /tmp/file5.txt
cat /tmp/file4.txt /tmp/file5.txt > /tmp/file3.txt
echo "...and check the error exists."
cat -v /tmp/file3.txt
echo ""
echo "Now add the newlines in the correct place, longhand."
cat /tmp/file4.txt > /tmp/file3.txt
echo "" >> /tmp/file3.txt
cat /tmp/file5.txt >> /tmp/file3.txt
echo "" >> /tmp/file3.txt
echo "Finalisation."
cat /tmp/file3.txt
echo "Check file validity using 'hexdump'."
hexdump -C /tmp/file3.txt

Result: OSX 10.13.4, default bash terminal calling OSX 'sh'.
Code:
Last login: Tue May 29 17:17:20 on ttys000
AMIGA:barrywalker~> cd Desktop/Code/Shell
AMIGA:barrywalker~/Desktop/Code/Shell> chmod 755 CATFiles.sh
AMIGA:barrywalker~/Desktop/Code/Shell> ./CATFiles.sh
Create files as per OP.
Join together to test.
1234^M
1234^M
1234aaaa^M
bbbb^M
cccc^M
dddd
Remove ^M, <CR> character and create temp files 4 and 5...
...and check the error exists.
1234
1234
1234aaaa
bbbb
cccc
dddd
Now add the newlines in the correct place, longhand.
Finalisation.
1234
1234
1234
aaaa
bbbb
cccc
dddd
Check file validity using 'hexdump'.
00000000  31 32 33 34 0a 31 32 33  34 0a 31 32 33 34 0a 61  |1234.1234.1234.a|
00000010  61 61 61 0a 62 62 62 62  0a 63 63 63 63 0a 64 64  |aaa.bbbb.cccc.dd|
00000020  64 64 0a                                          |dd.|
00000023
AMIGA:barrywalker~/Desktop/Code/Shell> _

Last edited by wisecracker; 05-29-2018 at 02:37 PM.. Reason: Put ':' in place of '/' in 'Here is a DEMO of your two files:'
This User Gave Thanks to wisecracker For This Post:
geomarine
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

use of sed over cat to merge files

I have three files, basically: file 1 - one line header file 2 - big data (approx 80GB) file 3 - a one line trailer the existing process cats these together i.e cat file 1 file 2 file 3 however... I was thinking, surely it could be more efficient to insert the header (file 1) on the... (2 Replies)
Discussion started by: miwinter
2 Replies

2. Shell Programming and Scripting

How to merge rows into columns ????

Hi guz I want to merge multiple rows into a multiple columns based on the first column. The file has symbol // I want to break the symbool // and I nedd exactlynew column at that point the output will be like this please guyz help in this isssue!!!!! merging rows into columns ... (4 Replies)
Discussion started by: bogu0001
4 Replies

3. Shell Programming and Scripting

Merge columns

Hi all - I have a file like below: A: A1,A2,A3,A4 B: 1,2,3,4 C: z,y,x,w .... This format repeats The output should come in a single line merging the first line field with the other two rows: A1_1 A1_z A2_2 A2_y A3_3 A3_x A4_4 A4_w Could anyone help with some directions ... (4 Replies)
Discussion started by: deepakgang
4 Replies

4. Shell Programming and Scripting

Merge columns of different files

Hi, I have tab limited file 1 and tab limited file 2 The output should contain common first column vales and corresponding 2nd column values; AND also unique first column value with corresponding 2nd column value of the file that contains it and 0 for the second file. the output should... (10 Replies)
Discussion started by: polsum
10 Replies

5. UNIX for Dummies Questions & Answers

How do I merge multiple columns into one column?

Hi all, I'm looking for a way to merge multiple columns (from one file) into a single column in an output file. The file I have looks somewhat like this: @HWI-ST212 1:N:0 AGTCCTACCGGGAGT + @@@DDDDDHHHHHII @HWI-ST212 1:N:0 CGTTTAAAAATTTCT + @;@B;DDDDH?:F;F... (4 Replies)
Discussion started by: Vnguyen
4 Replies

6. UNIX for Dummies Questions & Answers

Merge columns from multiple files

Hi all, I've searched the web for a long time trying to figure out how to merge columns from multiple files. I know paste will append columns like so: paste file1 file2 file3 file4 file5 ... But this becomes inconvenient when you want to append a large number of files into a single file. ... (2 Replies)
Discussion started by: torchij
2 Replies

7. Shell Programming and Scripting

Merge columns on different files

Hello, I have two files that have this format: file 1 86.82 0.00 86.82 43.61 86.84 0.00 86.84 43.61 86.86 0.00 86.86 43.61 86.88 0.00 86.88 43.61 file 2 86.82 0.22 86.84 0.22 86.86 0.22 86.88 0.22 I would like to merge these two files such that the final file looks like... (5 Replies)
Discussion started by: kayak
5 Replies

8. Shell Programming and Scripting

Merge records based on multiple columns

Hi, I have a file with 16 columns and out of these 16 columns 14 are key columns, 15 th is order column and 16th column is having information. I need to concate the 16th column based on value of 1-14th column as key in order of 15th column. Here are the example file Input File (multiple... (3 Replies)
Discussion started by: Ravi Agrawal
3 Replies

9. Shell Programming and Scripting

Merge columns from multiple files

Hello and Good day I have a lot of files with same number of rows and columns.$2 and $3 are the same in all files . I need to merge $2,$3,$6 from first file and $6 from another files. File1: $1 $2 $3 $4 $5 $6... (8 Replies)
Discussion started by: ali.seifaddini
8 Replies

10. Shell Programming and Scripting

Join and merge multiple files with duplicate key and fill void columns

Join and merge multiple files with duplicate key and fill void columns Hi guys, I have many files that I want to merge: file1.csv: 1|abc 1|def 2|ghi 2|jkl 3|mno 3|pqr file2.csv: (5 Replies)
Discussion started by: yjacknewton
5 Replies

LEARN ABOUT DEBIAN

parallel-slurp

PARALLEL-SLURP(1)														 PARALLEL-SLURP(1)

NAME

       parallel-slurp - copy files from listed hosts

SYNOPSIS

       parallel-slurp [OPTIONS] -h hosts.txt -L destdir remote local

DESCRIPTION

       pssh provides a number of commands for executing against a group of computers, using SSH. It's most useful for operating on clusters of
       homogenously-configured hosts.

       parallel-slurp gathers specified files from hosts you listed.

OPTIONS

       -r --recursive
	   recusively copy directories (OPTIONAL)

       -L --localdir
	   output directory for remote file copies

       -h --hosts
	   hosts file (each line "host[:port] [user]")

       -l --user
	   username (OPTIONAL)

       -p --par
	   max number of parallel threads (OPTIONAL)

       -o --outdir
	   output directory for stdout files (OPTIONAL)

       -e --errdir
	   output directory for stderr files (OPTIONAL)

       -t --timeout
	   timeout (secs) (-1 = no timeout) per host (OPTIONAL)

       -O --options
	   SSH options (OPTIONAL)

       -v --verbose
	   turn on warning and diagnostic messages (OPTIONAL)

EXAMPLE

       An example to copy /home/irb2/foo.txt from each host. Files gathered will be stored in /tmp/outdir/hostname/foo.txt.

	   # prallel-slurp -h hosts.txt -L /tmp/outdir -l irb2 
		    /home/irb2/foo.txt foo.txt

ENVIRONMENT

       All four programs take similar sets of options. All of these options can be set using the following environment variables:

       o   PSSH_HOSTS
       o   PSSH_USER
       o   PSSH_PAR
       o   PSSH_OUTDIR
       o   PSSH_VERBOSE
       o   PSSH_OPTIONS

SEE ALSO

       parallel-ssh(1), parallel-scp(1), parallel-nuke(1), parallel-rsync(1), ssh(1)

AUTHOR

       Brent N. Chun <bnc@theether.org>

COPYING

       Copyright: 2003, 2004, 2005, 2006, 2007 Brent N. Chun

NOTES

	1. bnc@theether.org
	   mailto:bnc@theether.org

								    03/30/2009							 PARALLEL-SLURP(1)
All times are GMT -4. The time now is 10:30 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy