Split a huge data into few different files?! Post: 302366719

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Perl script error to split huge data one by one.

Below is my perl script: #!/usr/bin/perl open(FILE,"$ARGV") or die "$!"; @DATA = <FILE>; close FILE; $join = join("",@DATA); @array = split( ">",$join); for($i=0;$i<=scalar(@array);$i++){ system ("/home/bin/./program_name_count_length MULTI_sequence_DATA_FILE -d...

2. Shell Programming and Scripting

Problem running Perl Script with huge data files

Hello Everyone, I have a perl script that reads two types of data files (txt and XML). These data files are huge and large in number. I am using something like this : foreach my $t (@text) { open TEXT, $t or die "Cannot open $t for reading: $!\n"; while(my $line=<TEXT>){ ...

3. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

I’m new to Linux script and not sure how to filter out bad records from huge flat files (over 1.3GB each). The delimiter is a semi colon “;” Here is the sample of 5 lines in the file: Name1;phone1;address1;city1;state1;zipcode1 Name2;phone2;address2;city2;state2;zipcode2;comment...

4. Shell Programming and Scripting

how to split a huge file by every 100 lines

into small files. i need to add a head.txt and tail.txt into small files at the begin and end, and give a name as q1.xml q2.xml q3.xml .... thank you very much.

5. Shell Programming and Scripting

Split a file into several files using a data

Hi All, I have file(File1) with data like below: 102100|LName|Gender|Company|Branch|Bday|Salary|Age 102100|bbbb|male|cccc|dddd|19900814|15000|20| 102101|asdg|male|gggg|ksgu|19911216||| 102102|bdbm|male|kkkk|acke|19931018||23| 102102|kfjg|male|kkkc|gkgg|19921213|14000|24|...

6. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below ...

7. Shell Programming and Scripting

Split a folder with huge number of files in n folders

We have a folder XYZ with large number of files (>350,000). how can i split the folder and create say 10 of them XYZ1 to XYZ10 with 35,000 files each. (doesnt matter which files go where).

8. Shell Programming and Scripting

Split JSON to different data files

Hi Gurus, I have below JSON file, now I want to rewrite this file into a new file. I will appreciate if anyone can help me to provide the solution...I can't use jq. { "_id": "3ad893cb4cf1560add7b4caffd4b6126", "_rev": "1-1f0ce165e1d210319cf6e9f9c6ff654f", "name":...

9. UNIX for Advanced & Expert Users

File comaprsons for the Huge data files ( around 60G) - Need optimized and teh best way to do this

I have 2 large file (.dat) around 70 g, 12 columns but the data not sorted in both the files.. need your inputs in giving the best optimized method/command to achieve this and redirect the not macthing lines to the thrid file ( diff.dat) File 1 - 15 columns File 2 - 15 columns Data is...

10. Solaris

Split huge File System

Gents I have huge NAS File System as /sys with size 10 TB and I want to Split each 1TB in spirit File System to be mounted in the server. How to can I do that without changing anything in the source. Please your support.

LEARN ABOUT SUSE

nseq

NSEQ(1) 							      OpenSSL								   NSEQ(1)

NAME

       nseq - create or examine a netscape certificate sequence

SYNOPSIS

       openssl nseq [-in filename] [-out filename] [-toseq]

DESCRIPTION

       The nseq command takes a file containing a Netscape certificate sequence and prints out the certificates contained in it or takes a file of
       certificates and converts it into a Netscape certificate sequence.

COMMAND OPTIONS

       -in filename
	   This specifies the input filename to read or standard input if this option is not specified.

       -out filename
	   specifies the output filename or standard output by default.

       -toseq
	   normally a Netscape certificate sequence will be input and the output is the certificates contained in it. With the -toseq option the
	   situation is reversed: a Netscape certificate sequence is created from a file of certificates.

EXAMPLES

       Output the certificates in a Netscape certificate sequence

	openssl nseq -in nseq.pem -out certs.pem

       Create a Netscape certificate sequence

	openssl nseq -in certs.pem -toseq -out nseq.pem

NOTES

       The PEM encoded form uses the same headers and footers as a certificate:

	-----BEGIN CERTIFICATE-----
	-----END CERTIFICATE-----

       A Netscape certificate sequence is a Netscape specific form that can be sent to browsers as an alternative to the standard PKCS#7 format
       when several certificates are sent to the browser: for example during certificate enrollment.  It is used by Netscape certificate server
       for example.

BUGS

       This program needs a few more options: like allowing DER or PEM input and output files and allowing multiple certificate files to be used.

1.0.0								    2000-01-21								   NSEQ(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Perl script error to split huge data one by one.

Discussion started by: patrick87

2. Shell Programming and Scripting

Problem running Perl Script with huge data files

Discussion started by: ad23

3. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

Discussion started by: lv99

4. Shell Programming and Scripting

how to split a huge file by every 100 lines

Discussion started by: dtdt