Split huge File System Post: 303037764

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split a huge data into few different files?!

Input file data contents: >seq_1 MSNQSPPQSQRPGHSHSHSHSHAGLASSTSSHSNPSANASYNLNGPRTGGDQRYRASVDA >seq_2 AGAAGRGWGRDVTAAASPNPRNGGGRPASDLLSVGNAGGQASFASPETIDRWFEDLQHYE >seq_3 ATLEEMAAASLDANFKEELSAIEQWFRVLSEAERTAALYSLLQSSTQVQMRFFVTVLQQM ARADPITALLSPANPGQASMEAQMDAKLAAMGLKSPASPAVRQYARQSLSGDTYLSPHSA...

2. Shell Programming and Scripting

Perl script error to split huge data one by one.

Below is my perl script: #!/usr/bin/perl open(FILE,"$ARGV") or die "$!"; @DATA = <FILE>; close FILE; $join = join("",@DATA); @array = split( ">",$join); for($i=0;$i<=scalar(@array);$i++){ system ("/home/bin/./program_name_count_length MULTI_sequence_DATA_FILE -d...

3. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

I’m new to Linux script and not sure how to filter out bad records from huge flat files (over 1.3GB each). The delimiter is a semi colon “;” Here is the sample of 5 lines in the file: Name1;phone1;address1;city1;state1;zipcode1 Name2;phone2;address2;city2;state2;zipcode2;comment...

4. Shell Programming and Scripting

how to split a huge file by every 100 lines

into small files. i need to add a head.txt and tail.txt into small files at the begin and end, and give a name as q1.xml q2.xml q3.xml .... thank you very much.

5. UNIX for Dummies Questions & Answers

How to split a huge file into small pieces (per 2000 columns)?

Dear all, I have a big file:2879(rows)x400,170 (columns) like below. I 'd like to split the file into small pieces:2879(rows)x2000(columns) per file (the last small piece will be 2879x170. So far, I only know how to create one samll piece at one time. But actually I need to repeat this work...

6. UNIX for Dummies Questions & Answers

My file system is 100%, can't find the huge file

Please help. My file system is 100%, I can't seem to find what is taking so much space. The total hard drive space is 150Gig free but I got nothing now. I did to this to find the big file but it's taking so much time. Is there any other way? du -ah / | more find ./ -size +200M...

7. Shell Programming and Scripting

Split a file using 2-D indexing system

I have a file and want to split it using a 2-D index system for example if the file is p.dat with 6 data sets separated by ">". I want to set nx=3, ny=2. I need to create files p.dat.1.1 p.dat.1.2 p.dat.1.3 p.dat.2.1 p.dat.2.2 p.dat.2.3 I have tried using a single index and want...

8. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below ...

9. Shell Programming and Scripting

Split a folder with huge number of files in n folders

We have a folder XYZ with large number of files (>350,000). how can i split the folder and create say 10 of them XYZ1 to XYZ10 with 35,000 files each. (doesnt matter which files go where).

10. Solaris

Backup for NAS huge File system

Gents, I have NAS File System mounted in Solaris as \Sysapp with size 8 TB the problem once the backup stared it is impacting the performance of the OS. Do you have any idea how to can we backup this FS with fast scenario without impacting the OS. Backup type : Netbackup

LEARN ABOUT OSF1

cdxar

cdxar(1)						      General Commands Manual							  cdxar(1)

NAME

       cdxar - Read the Extended Attribute Record from a CD-ROM

SYNOPSIS

       /usr/bin/cdxar [-s number] [-b] file

OPTIONS

       Specifies  the  File  Section  for  which the XAR is to be read.  The numbering starts with one and number can be any whole number. If this
       option is not used, the last file section of the named file is assumed.	Copies the entire XAR from a CD-ROM in binary format  to  standard
       output.	Names a file or directory within the CD-ROM file hierarchy of a mounted CD-ROM File System.

DESCRIPTION

       The  cdxar  command accesses the Extended Attribute Record (XAR) associated with the File Section of a file or directory and lists its con-
       tents on standard output.

       The output is formatted in a table that contains the name of each field of the XAR and the corresponding contents of the entry as  recorded
       on  the	CD-ROM. Note that the Application Use Field and the Escape Sequences are not listed because they may contain non-printable charac-
       ters.

       If the command is used without the -b option, only the fixed part of the XAR is copied from the CD-ROM.

       Users must have read permission for file in order to execute the command.

EXIT STATUS

       The following exit values are returned: The command was successful.  The named file was not found, or was not within the CD-ROM	hierarchy,
       or  access permission was denied.  The File Section indicated by -s does not exist.  The File Section indicated by -s has no XAR.  The File
       Section indicated by -s is not on the mounted CD-ROM.

SEE ALSO

       Functions:  cd_cxar(3), cd_xar(3)

																	  cdxar(1)