Perl script error to split huge data one by one. Post: 302377017

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script to check the unique numbers in huge data

Friends, I have to write a shell script,the description is---- i Have to check the uniqueness of the numbers in a file. A file is containing 200thousand tickets and a ticket have 15 numbers in asecending order.And there is a strip that is having 6 tickets that means 90 numbers.I...

2. Shell Programming and Scripting

Split a huge data into few different files?!

Input file data contents: >seq_1 MSNQSPPQSQRPGHSHSHSHSHAGLASSTSSHSNPSANASYNLNGPRTGGDQRYRASVDA >seq_2 AGAAGRGWGRDVTAAASPNPRNGGGRPASDLLSVGNAGGQASFASPETIDRWFEDLQHYE >seq_3 ATLEEMAAASLDANFKEELSAIEQWFRVLSEAERTAALYSLLQSSTQVQMRFFVTVLQQM ARADPITALLSPANPGQASMEAQMDAKLAAMGLKSPASPAVRQYARQSLSGDTYLSPHSA...

3. Shell Programming and Scripting

Problem running Perl Script with huge data files

Hello Everyone, I have a perl script that reads two types of data files (txt and XML). These data files are huge and large in number. I am using something like this : foreach my $t (@text) { open TEXT, $t or die "Cannot open $t for reading: $!\n"; while(my $line=<TEXT>){ ...

4. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

I’m new to Linux script and not sure how to filter out bad records from huge flat files (over 1.3GB each). The delimiter is a semi colon “;” Here is the sample of 5 lines in the file: Name1;phone1;address1;city1;state1;zipcode1 Name2;phone2;address2;city2;state2;zipcode2;comment...

5. AIX

Error while copying huge amount of data in aix

Hi When i copy 300GB of data from one filesystem to the other filesystem in AIX I get the error : tar: 0511-825 The file 'SAPBRD.dat' is too large. The command I used is : # tar -cf - . | (cd /sapbackup ; tar -xf - ) im copying as root The below is my ulimit -a output : ...

6. Shell Programming and Scripting

how to split a huge file by every 100 lines

into small files. i need to add a head.txt and tail.txt into small files at the begin and end, and give a name as q1.xml q2.xml q3.xml .... thank you very much.

7. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below ...

8. Shell Programming and Scripting

Split a folder with huge number of files in n folders

We have a folder XYZ with large number of files (>350,000). how can i split the folder and create say 10 of them XYZ1 to XYZ10 with 35,000 files each. (doesnt matter which files go where).

9. UNIX for Advanced & Expert Users

Need Optimization shell/awk script to aggreagte (sum) for all the columns of Huge data file

Optimization shell/awk script to aggregate (sum) for all the columns of Huge data file File delimiter "|" Need to have Sum of all columns, with column number : aggregation (summation) for each column File not having the header Like below - Column 1 "Total Column 2 : "Total ... ......

10. Solaris

Split huge File System

Gents I have huge NAS File System as /sys with size 10 TB and I want to Split each 1TB in spirit File System to be mounted in the server. How to can I do that without changing anything in the source. Please your support.

LEARN ABOUT DEBIAN

file::checktree

File::CheckTree(3perl)					 Perl Programmers Reference Guide				    File::CheckTree(3perl)

NAME

       File::CheckTree - run many filetest checks on a tree

SYNOPSIS

	   use File::CheckTree;

	   $num_warnings = validate( q{
	       /vmunix		       -e || die
	       /boot		       -e || die
	       /bin		       cd
		   csh		       -ex
		   csh		       !-ug
		   sh		       -ex
		   sh		       !-ug
	       /usr		       -d || warn "What happened to $file?
"
	   });

DESCRIPTION

       The validate() routine takes a single multiline string consisting of directives, each containing a filename plus a file test to try on it.
       (The file test may also be a "cd", causing subsequent relative filenames to be interpreted relative to that directory.)	After the file
       test you may put "|| die" to make it a fatal error if the file test fails.  The default is "|| warn".  The file test may optionally have a
       "!' prepended to test for the opposite condition.  If you do a cd and then list some relative filenames, you may want to indent them
       slightly for readability.  If you supply your own die() or warn() message, you can use $file to interpolate the filename.

       Filetests may be bunched:  "-rwx" tests for all of "-r", "-w", and "-x".  Only the first failed test of the bunch will produce a warning.

       The routine returns the number of warnings issued.

AUTHOR

       File::CheckTree was derived from lib/validate.pl which was written by Larry Wall.  Revised by Paul Grassie <grassie@perl.com> in 2002.

HISTORY

       File::CheckTree used to not display fatal error messages.  It used to count only those warnings produced by a generic "|| warn" (and not
       those in which the user supplied the message).  In addition, the validate() routine would leave the user program in whatever directory was
       last entered through the use of "cd" directives.  These bugs were fixed during the development of perl 5.8.  The first fixed version of
       File::CheckTree was 4.2.

perl v5.14.2							    2011-09-19						    File::CheckTree(3perl)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script to check the unique numbers in huge data

Discussion started by: namishtiwari

2. Shell Programming and Scripting

Split a huge data into few different files?!

Discussion started by: patrick87

3. Shell Programming and Scripting

Problem running Perl Script with huge data files

Discussion started by: ad23

4. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

Discussion started by: lv99