Breaking large file into small files Post: 302937357

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large file into small files

Hi, I need to split a large file into small files based on a string. At different palces in the large I have the string ^Job. I need to split the file into different files starting from ^Job to the last character before the next ^Job. Also all the small files should be automatically named....

2. Shell Programming and Scripting

Split a file into 16 small files

Hi I want to split a file that has 'n' number of records into 16 small files. Can some one suggest me how to do this using Unix script? Thanks rrkk

3. Shell Programming and Scripting

Split large file and add header and footer to each small files

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?

4. Shell Programming and Scripting

script to splite large file to number of small files

Dear All, Could you please help me to split a file contain around 240,000,000 line to 4 files all equally likely , note that we need to maintain that the end of each file should started by start flage (MSISDN) and ended by end flag (End), also the number of the line between the...

5. Shell Programming and Scripting

Breaking one file into many files based on first column?

Hi, I have a file that looks like this (tab deliminited). MAT1 YKR2 3 MAT1 YMR1 2 MAT1 YFG2 2 MAT2 YLM4 4 MAT2 YHL2 1 BAR1 YKR2 3 BAR1 YFR1 4 BAR1 YMR1 1 What I want to do is break this file down into multiple files. So the result will look like this: File 1...

6. Shell Programming and Scripting

Breaking the files as 10k recs. per file

Hi, I have a code as given below Set -A _Category="A\ B\ C" for _cat in ${_Category} do sed -e "s:<TABLE_NAME>:${_cat}:g" \ -e "s:<date>:${_dt}:g" \ ${_home}/skl/sq1.sql >> ${_dest}/del_${_dt}.sql fi ...

7. UNIX for Advanced & Expert Users

Splitting a file into small files

Hi Folks, Please help me in solving the problem. I want to write script in order to split a file into small pieces and send it automatically through mail. Ex. The file name is CALM*.txt . It is around 50 MB. I want to split the file into 20 MB 2-3 smaller files and send (like uuencode) it...

8. UNIX for Dummies Questions & Answers

Breaking a fasta formatted file into multiple files containing each gene separately

Hey, I've been trying to break a massive fasta formatted file into files containing each gene separately. Could anyone help me? I've tried to use the following code but i've recieved errors every time: for i in *.rtf.out do awk '/^>/{f=++d".fasta"} {print > $i.out}' $i done

9. Shell Programming and Scripting

Split a large array into small chunks

Hi, I need to split a large array "@sharedArray" into 10 small arrays. The arrays should be like @sharedArray1,@sharedArray2,@sharedArray3...so on.. Can anyone help me with the logic to do so :(:confused:

10. UNIX for Beginners Questions & Answers

Split large file into 24 small files on one hour basis

I Have a large file with 24hrs log in the below format.i need to split the large file in to 24 small files on one hour based.i.e ex:from 09:55 to 10:55,10:55-11:55 can any one help me on this.! ...

LEARN ABOUT DEBIAN

trcs

trcs(1) 							   User Manuals 							   trcs(1)

NAME

       trcs - convert text files from one codeset to other

SYNOPSIS

       trcs -C | -l | -h

       trcs [-s] [-f input-codeset ] [-t output-codeset ] [ file ]...

DESCRIPTION

       trcs  is a program for translation of text files from one codeset to other.  When exact translation is impossible it tries to make approxi-
       mations.  For example pseudographic characters are approximated by ASCII characters in codesets that have no pseudographic  characters  and
       characters with diacritical marks are approximated by existing characters.

       If the option -s or --gen-script is given trcs will generate simple script that invokes tr(1) This is useful if you want to include this in
       your script or for faster conversion of many files.

       If none of -C, -s, -l, -h and their equivalents is given each file will be read assuming it is coded with codeset input-codeset On standard
       output  it will be recoded so to use codeset output-codeset If there is no file given trcs will act as filter.  Both input-codeset and out-
       put-codeset are case insensitive and default to `cp1251'.

OPTIONS

       -C, --copyright
	      Display copying conditions and warranty information.

       -s, --gen-script
	      Generates conversion script for given input and output encodings instead to convert text files.

       -l, --list
	      List all known codesets with their aliases.

       -h, --help
	      Display this help and exit.

       -f input-codeset, --from[=]input-codeset
	      Codeset of the source.

       -f output-codeset, --to[=]output-codeset
	      Codeset of the output.

EXAMPLES

       trcs -fcyrillic -t koi8-r letter.txt
	      Convert letter.txt from ISO-8859-5 (cyrillic) to KOI8-R and output the result on standard output.

       trcs --from cp437 --to=mik --gen-script >ibm2mik
	      Generates script ibm2mik for converting from CP437 to MIK.

       sh ibm2mik screen.txt
	      Convert screen.txt from CP437 to MIK.  Output the result on standard output.  Without parameters ibm2mik acts as filter.

AUTHOR

       Anton Zinoviev <anton@lml.bas.bg>, <zinoviev@fmi.uni-sofia.bg>

SEE ALSO

       tr(1)

Linux								     JUN 2000								   trcs(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large file into small files

Discussion started by: dncs

2. Shell Programming and Scripting

Split a file into 16 small files

Discussion started by: rrkks

3. Shell Programming and Scripting

Split large file and add header and footer to each small files

Discussion started by: ashish4422

4. Shell Programming and Scripting

script to splite large file to number of small files

Discussion started by: ahmed.gad