script to splite large file to number of small files Post: 302214510

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large file into small files

Hi, I need to split a large file into small files based on a string. At different palces in the large I have the string ^Job. I need to split the file into different files starting from ^Job to the last character before the next ^Job. Also all the small files should be automatically named....

2. Shell Programming and Scripting

moving large number of files

I have a task to move more than 35000 files every two hours, from the same directory to another directory based on a file that has the list of filenames I tried the following logics (1) find . -name \*.dat > list for i in `cat list` do mv $i test/ done (2) cat list|xargs -i mv "{}"...

3. Shell Programming and Scripting

Split large file and add header and footer to each small files

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?

4. Shell Programming and Scripting

Script to Compare a large number of files.

I have a large Filesystem on an AIX server and another one on a Red Hat box. I have syncd the two filesystems using rsysnc. What Im looking for is a script that would compare to the two filesystems to make sure the bits match up and the number of files match up. its around 2.8 million...

5. Shell Programming and Scripting

Concatenation of a large number of files

Hellow i have a large number of files that i want to concatenate to one. these files start with the word 'VOICE_' for example VOICE_0000000000 VOICE_1223o23u0 VOICE_934934927349 I use the following code: cat /ODS/prepaid/CDR_FLOW/MEDIATION/VOICE_* >> /ODS/prepaid/CDR_FLOW/WORK/VOICE ...

6. UNIX for Dummies Questions & Answers

Delete large number of files

Hi. I need to delete a large number of files listed in a txt file. There are over 90000 files in the list. Some of the directory names and some of the file names do have spaces in them. In the file, each line is a full path to a file: /path/to/the files/file1 /path/to/some other/files/file 2...

7. Shell Programming and Scripting

Sftp large number of files

Want to sftp large number of files ... approx 150 files will come to server every minute. (AIX box) Also need make sure file has been sftped successfully... Please let me know : 1. What is the best / faster way to transfer files? 2. should I use batch option -b so that connectivity will be...

8. Shell Programming and Scripting

Breaking large file into small files

Dear all, I have huge txt file with the input files for some setup_code. However for running my setup_code, I require txt files with maximum of 1000 input files Please help me in suggesting way to break down this big txt file to small txt file of 1000 entries only. thanks and Greetings, Emily

9. Shell Programming and Scripting

Removing large number of temp files

Hi All, I am having a situation now to delete a huge number of temp files created during run times approx. 16700+ files. We have never imagined that we will get this this much big list of files during run time. It worked fine for lesser no of files in the list. But when list is huge we are...

10. UNIX for Beginners Questions & Answers

Split large file into 24 small files on one hour basis

I Have a large file with 24hrs log in the below format.i need to split the large file in to 24 small files on one hour based.i.e ex:from 09:55 to 10:55,10:55-11:55 can any one help me on this.! ...

LEARN ABOUT OSF1

temporary

Temporary(4)						     Kernel Interfaces Manual						      Temporary(4)

NAME

       Temporary - Stores data files during transfers to remote systems

SYNOPSIS

       /usr/spool/uucp/SystemName/TM.xxPID.000

DESCRIPTION

       The  uucp  Temporary  (TM.*) files store data files during transfers to remote systems.	After a Data (D.*) file is transferred to a remote
       system by the uucico daemon, the uucp program places it in a subdirectory of the uucp spooling directory named  /usr/spool/uucp/SystemName,
       where  the SystemName directory is named for the computer that is transmitting the file.  The uucp program creates a temporary data file to
       hold the original data file.

       The full pathname of the temporary data file is in the following format: /usr/spool/uucp/SystemName/TM.xxPID.000

       where the SystemName directory is named for the computer that is sending the file, and TM.xxPID.000 is the name of the file;  for  example,
       TM.00451.000.  The PID variable is the process ID of the job.

FILES

       Describes accessible remote systems Contains uucp command, data, and execute files Contain data to be transferred.  Contain files that uucp
       has transferred

RELATED INFORMATION

       Daemons: uucico(8)

       Commands: uucp(1), uudemon.cleanu(4), uupick(1), uuto(1), uux(1) delim off

																      Temporary(4)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large file into small files

Discussion started by: dncs

2. Shell Programming and Scripting

moving large number of files

Discussion started by: bryan

3. Shell Programming and Scripting

Split large file and add header and footer to each small files

Discussion started by: ashish4422

4. Shell Programming and Scripting

Script to Compare a large number of files.

Discussion started by: zippdawg2001