How to merge files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to merge files
# 1  
Old 06-06-2007
Error How to merge files

Hello guys,

I gotta question, i have a lot of log files (simple text) and i need to merge them in group of 10 files, one next to the other, that have sense?

For example, i have the files:

File1
File2
File3
File4
.
.
File100

I need to merge the contents of each file into a new file named Total1, but into Total1 only will be the File1 to File10, then will be another Total2 with the content of File11 to File20... etc, etc... Please your help.

Thanx
# 2  
Old 06-06-2007
Lestat,
See if this works for you:
Code:
typeset -i mCnt=0
typeset -i mSeq=1
mOutFile='Total1'
for mFName in `find . -type f`
do
  cat mFName >> $mOutFile
  mCnt=$mCnt+1
  if [ ${mCnt} -eq 10 ]; then
    mSeq=$mSeq+1
    mOutFile='Total'$mSeq
    mCnt=0
  fi
done

# 3  
Old 06-06-2007
Another solution (ksh or bash) :
Code:
# Script file: concat.sh

shopt -s extglob # Not need for ksh

src_prefix=File
out_prefix=Total

typeset -i src_seq out_seq

for src_file in ${src_prefix}+([0-9])
do
   src_seq=${src_file#${src_prefix}}
   (( out_seq=src_seq/10+1 ))
   echo "cat ${src_file} >> ${out_prefix}${out_seq}"
done

Execution:
Code:
$ ls File*
File1  File100  File11  File19  File2  File9  File91  File92  File99
$ concat.sh
cat File1 >> Total1
cat File100 >> Total11
cat File11 >> Total2
cat File19 >> Total2
cat File2 >> Total1
cat File9 >> Total1
cat File91 >> Total10
cat File92 >> Total10
cat File99 >> Total10$

Jean-Pierre.
# 4  
Old 06-07-2007
merge number of files

code
#!/bin/sh
echo enter file name
read f
echo enter number of such files
read n
i=1
while test $i -ne $n
do
echo $f$i >> outfile
cat $f$i >> outfile
i=`expr $i + 1`
done



by the use of above code you can see the file name also before its content.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to merge two files?

Dear Frens, I have two files and need to merge into one file. Like File_1: Field1 Field2 1 4 File_2: Field1 Field2 3 5 I need one single output as File_1: Field1 Field2 1 4 3 5 This means taking header from either file. (8 Replies)
Discussion started by: manisha_singh
8 Replies

2. Shell Programming and Scripting

Merge files and generate a resume in two files

Dear Gents, Please I need your help... I need small script :) to do the following. I have a thousand of files in a folder produced daily. I need first to merge all files called. txt (0009.txt, 0010.txt, 0011.txt) and and to output a resume of all information on 2 separate files in csv... (14 Replies)
Discussion started by: jiam912
14 Replies

3. Shell Programming and Scripting

Checking in a directory how many files are present and basing on that merge all the files

Hi, My requirement is,there is a directory location like: :camp/current/ In this location there can be different flat files that are generated in a single day with same header and the data will be different, differentiated by timestamp, so i need to verify how many files are generated... (10 Replies)
Discussion started by: srikanth_sagi
10 Replies

4. UNIX for Dummies Questions & Answers

Merge files

Hi, I would like to know how can I merge files based on their coordinates, but mantaining the score of each file in the output file like: Note: 1st column is for chromosome, 2nd for start, 3rd for end of segment, 4th for score file1: 1 200 300 20 1 400 500 30 file2: 1 200 350 30 1... (1 Reply)
Discussion started by: fadista
1 Replies

5. Shell Programming and Scripting

MERGE FILES

Hi all! How could I merge all the text files (in format xml) of a single folder, after having deleted from each of them all the text from its beginning up to a specific string: "<body>" ? Thanks a lot! mjomba (4 Replies)
Discussion started by: mjomba
4 Replies

6. Shell Programming and Scripting

Merge 2 files

Hi , This might be the stupidest question I am asking, but I am struck with this problem. I am trying to merge 2 files, file1 has header and file2 has contents. while I merge them , it merges from the 1st line of file1. for ex: file1 col1|col2|col3| file2 123|234|456|... (2 Replies)
Discussion started by: rashmisb
2 Replies

7. Shell Programming and Scripting

How can i merge these two files into several...

Given are File A and File B File A has for example 5 lines: AAA BBB CCC DDD EEE File B has 3 lines: 111 222 333 How can i merge A and B into: 111 222 333 AAA (first line from A) then a new file: (4 Replies)
Discussion started by: Y-T
4 Replies

8. Shell Programming and Scripting

Merge 2 files

Hello, i'd like a bash script to merge 2 files without duplicate lines. Example : file1 : toto titi file2 : toto tata Expected result, file3 : toto (5 Replies)
Discussion started by: Celmar
5 Replies

9. Shell Programming and Scripting

Merge files of differrent size with one field common in both files using awk

hi, i am facing a problem in merging two files using awk, the problem is as stated below, file1: A|B|C|D|E|F|G|H|I|1 M|N|O|P|Q|R|S|T|U|2 AA|BB|CC|DD|EE|FF|GG|HH|II|1 .... .... .... file2 : 1|Mn|op|qr (2 Replies)
Discussion started by: shashi1982
2 Replies

10. Shell Programming and Scripting

merge files

Hi, i have the files f1 and f2 like: files f1: c1 a1 c2 a2 c3 a3 file f2: c1 b1 c2 b2 c3 b3 i want merge the f1 and f2 file to f3 file like: c1 a1 b1 c2 a2 b3 c3 a3 b3........ .... . . please help me onthis..... (5 Replies)
Discussion started by: koti_rama
5 Replies
Login or Register to Ask a Question