Concatenate files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Concatenate files
# 1  
Old 02-17-2011
Concatenate files

Hi, I want to create a batch(bash) file to combine 23 files together. These files have the same extension. I want the final file is save to a given folder. Once it is done it will delete the 23 files.

Thanks for help. Need script.
# 2  
Old 02-17-2011
Code:
#!/bin/sh

cat file1.ext file2.ext file3.ext....................... file23.ext > directory_of_choice/outfile.ext

rm file1.ext file2.ext file3.ext....................... file23.ext

exit 0

If these 23 files are alone in one directory, use
Code:
#!/bin/sh

cat *.ext > directory_of_choice/outfile.ext

rm *.ext

exit 0

# 3  
Old 02-17-2011
Two questions:
1. The combined file is in the same folder with the 23 files.
Code:
rm *.ext

will delete the final result as well.
2. How to mark the issue is resloved?
# 4  
Old 02-17-2011
Quote:
Originally Posted by zhshqzyc
Code:
rm *.ext

will delete the final result as well.
Yes, use a temporary extension to bypass the problem:
Code:
#!/bin/sh

cat *.ext > outfile.temp

rm *.ext

mv outfile.temp outfile.ext

exit 0


Last edited by tukuyomi; 02-17-2011 at 04:03 PM..
# 5  
Old 02-19-2011
Every file has the same header (the first row), I only want one in the final result.
# 6  
Old 02-19-2011
If your version of tail supports -n + and -q you can do: ( echo HEADER ; tail -q -n +2 * ) > path/to/output
tail -n +2 will strip off the headers as it reads every file, so you add one to the front with ECHO first and redirect the whole block into a new file.
# 7  
Old 02-19-2011
Code:
awk 'FNR>1||NR==1' *.ext > outtfile.tenp

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Concatenate files by pairs

Hi, I would like to batch concatenate files by pairs. I have quite a few of them so I would not like to do that pair by pair separately. the names of the file is of the type: file1.fastq newfile1_new.fastq file2.fastq newfile2_new.fastq and so on... I would like to concatenate file1... (2 Replies)
Discussion started by: jawad
2 Replies

2. UNIX for Dummies Questions & Answers

Concatenate files and delete source files. Also have to add a comment.

- Concatenate files and delete source files. Also have to add a comment. - I need to concatenate 3 files which have the same characters in the beginning and have to remove those files and add a comment and the end. Example: cat REJ_FILE_ABC.txt REJ_FILE_XYZ.txt REJ_FILE_PQR.txt >... (0 Replies)
Discussion started by: eskay
0 Replies

3. UNIX for Dummies Questions & Answers

Concatenate files

Hi I am trying to learn linux step by step an i am wondering can i use cat command for concatenate files but i want to place context of file1 to a specific position in file2 place of file 2 and not at the end as it dose on default? Thank you. (3 Replies)
Discussion started by: iliya24
3 Replies

4. UNIX for Dummies Questions & Answers

Concatenate Several Files to One

Hi All, Need your help. I will need to concatenate around 100 files but each end of the file I will need to insert my name DIRT1228 on each of the file and before the next file is added and arrived with just one file for all the 100files. Appreciate your time. Dirt (6 Replies)
Discussion started by: dirt1228
6 Replies

5. UNIX for Dummies Questions & Answers

Concatenate 560 files in one

HI all, could please help me in this code. I have 560 files containing the same columns but different rows. i want to concatenate all these files in one big file. i want to keep the header of the first file then add the dat from other files horizontally. the name of my files contains 2 variables... (7 Replies)
Discussion started by: biopsy
7 Replies

6. Shell Programming and Scripting

Concatenate files

I have a file named "file1" which has the following data 10000 20000 30000 And I have a file named "file2" which has the following data ABC DEF XYZ My output should be 10000ABC 20000DEF (3 Replies)
Discussion started by: bobby1015
3 Replies

7. UNIX for Dummies Questions & Answers

Concatenate more than 200 files

Hi, I have a bunch of files (around 500) with the .log extension and each having a different name. Is there an easy way to concatenate them all into a single file? I've tried: cat *.log > complete.log and it seems that files are overlapping each other...thus the new file is not complete.... (2 Replies)
Discussion started by: amarn
2 Replies

8. Shell Programming and Scripting

Concatenate files

I have directory structure sales_only under which i have multiple directories for each dealer example: ../../../Sales_Only/xxx_Dealer ../../../Sales_Only/yyy_Dealer ../../../Sales_Only/zzz_Dealer Every day i have one file produce under each directory when the process runs. The requirement... (3 Replies)
Discussion started by: mohanmuthu
3 Replies

9. Shell Programming and Scripting

Script to concatenate several files

I need a script to concatenate several files in one step, I have 3 header files say file.S, file.X and file.R, I need to concatenate these 3 header files to data files, say file1.S, file1.R, file1.X so that the header file "file.S" will be concatenated to all data files with .S extentions and so on... (3 Replies)
Discussion started by: docaia
3 Replies

10. UNIX for Dummies Questions & Answers

How to concatenate all files.

Hi, I'm totally new to Unix. I'm an MVS mainframer but ran into a situation where a Unix server I have available will help me. I want to be able to remotely connect to another server using FTP, login and MGET all files from it's root or home directory, logout, then login as a different user and do... (1 Reply)
Discussion started by: s80bob
1 Replies
Login or Register to Ask a Question