Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Concatenate several thousand files in unix
Top Forums UNIX for Dummies Questions & Answers Concatenate several thousand files in unix Post 302371024 by jim mcnamara on Friday 13th of November 2009 07:11:58 AM
Old 11-13-2009
40,000 filenames probably exceeds ARG_MAX bytes on a lot of systems, so a solution with wildcards like * that globs could fail. find (as above) is not globbing.
Code:
for file in *.extension

does glob.

another way
Code:
ls | grep '\.extension' |
while read fname
do
   cat $fname
done > outputfile

Code:
getconf ARG_MAX

shows what the ARG_MAX limit is.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to concatenate all files.

Hi, I'm totally new to Unix. I'm an MVS mainframer but ran into a situation where a Unix server I have available will help me. I want to be able to remotely connect to another server using FTP, login and MGET all files from it's root or home directory, logout, then login as a different user and do... (1 Reply)
Discussion started by: s80bob
1 Replies

2. UNIX for Advanced & Expert Users

Concatenate text of two files in UNIX.

I have a file MyTest.csv saved in Unicode format in Incoming directory, and I have another file called MyTest.csv saved in ANSII format in InProcess Directory. I need to concatenate the text of both these files and put in another file MyTest.csv which is placed in the root directory. How do I... (1 Reply)
Discussion started by: Uniq
1 Replies

3. Infrastructure Monitoring

How to concatenate this simple line in Unix?

Hi: I use the snmpget command everyday. And Im getting tire of writing the same line evertime I have to verify something. Example of the line: snmpget -c DreamTeam dal2-hr2 ifAlias.227 The .227 its the circuit interface and also its variable; could be any other number depending on the... (13 Replies)
Discussion started by: javygonx
13 Replies

4. Shell Programming and Scripting

Concatenate files

I have directory structure sales_only under which i have multiple directories for each dealer example: ../../../Sales_Only/xxx_Dealer ../../../Sales_Only/yyy_Dealer ../../../Sales_Only/zzz_Dealer Every day i have one file produce under each directory when the process runs. The requirement... (3 Replies)
Discussion started by: mohanmuthu
3 Replies

5. Shell Programming and Scripting

Concatenate files

Hi, I want to create a batch(bash) file to combine 23 files together. These files have the same extension. I want the final file is save to a given folder. Once it is done it will delete the 23 files. Thanks for help. Need script. (6 Replies)
Discussion started by: zhshqzyc
6 Replies

6. UNIX for Dummies Questions & Answers

Concatenate more than 200 files

Hi, I have a bunch of files (around 500) with the .log extension and each having a different name. Is there an easy way to concatenate them all into a single file? I've tried: cat *.log > complete.log and it seems that files are overlapping each other...thus the new file is not complete.... (2 Replies)
Discussion started by: amarn
2 Replies

7. Shell Programming and Scripting

Concatenate files

I have a file named "file1" which has the following data 10000 20000 30000 And I have a file named "file2" which has the following data ABC DEF XYZ My output should be 10000ABC 20000DEF (3 Replies)
Discussion started by: bobby1015
3 Replies

8. UNIX for Dummies Questions & Answers

Concatenate Several Files to One

Hi All, Need your help. I will need to concatenate around 100 files but each end of the file I will need to insert my name DIRT1228 on each of the file and before the next file is added and arrived with just one file for all the 100files. Appreciate your time. Dirt (6 Replies)
Discussion started by: dirt1228
6 Replies

9. UNIX for Dummies Questions & Answers

Concatenate files

Hi I am trying to learn linux step by step an i am wondering can i use cat command for concatenate files but i want to place context of file1 to a specific position in file2 place of file 2 and not at the end as it dose on default? Thank you. (3 Replies)
Discussion started by: iliya24
3 Replies

10. UNIX for Dummies Questions & Answers

Concatenate files and delete source files. Also have to add a comment.

- Concatenate files and delete source files. Also have to add a comment. - I need to concatenate 3 files which have the same characters in the beginning and have to remove those files and add a comment and the end. Example: cat REJ_FILE_ABC.txt REJ_FILE_XYZ.txt REJ_FILE_PQR.txt >... (0 Replies)
Discussion started by: eskay
0 Replies

LEARN ABOUT CENTOS

zip_name_locate

ZIP_NAME_LOCATE(3)					     Library Functions Manual						ZIP_NAME_LOCATE(3)

NAME

       zip_name_locate - get index of file by name

LIBRARY

       libzip (-lzip)

SYNOPSIS

       #include <zip.h>

       int zip_name_locate(struct zip *archive, const char *fname, int flags);

DESCRIPTION

       The  zip_name_locate  function returns the index of the file named fname in archive.  If archive does not contain a file with that name, -1
       is returned.  The are specified by or'ing the following values, or 0 for none of them.

	      ZIP_FL_NOCASE  Ignore case distinctions.

	      ZIP_FL_NODIR   Ignore directory part of file name in archive.

RETURN VALUES

       zip_name_locate returns the index of the file named fname or -1, if archive does not contain an entry of that name.

ERRORS

       The zip_name_locate function fails and sets the error information to ZIP_ER_NOENT if no entry of the name fname is found  in  the  archive.
       If one of the arguments is invalid, the error information is set to ZIP_ER_INVAL.

SEE ALSO

       libzip(3), zip_get_name(3)

AUTHORS

       Dieter Baron <dillo@giga.or.at> and Thomas Klausner <tk@giga.or.at>

NiH								  October 4, 2006						ZIP_NAME_LOCATE(3)
All times are GMT -4. The time now is 01:47 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy