Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Script to split text files
Top Forums Shell Programming and Scripting Script to split text files Post 302405936 by drl on Saturday 20th of March 2010 07:45:23 PM
Old 03-20-2010
Hi,

If you you get a yen to do your own coding, then a perl module, Algorithm::Numerical::Sample - search.cpan.org , implements the single-pass algorithm described in Knuth. It actually has 2 parts, one to sample from an array, and the other to sample as you read a file.

The module may be already installed, or in an available repository. If not, it's always available at CPAN .

There may be other facilities in other languages to do the same thing -- python likely has one, for example ... cheers, drl
This User Gave Thanks to drl For This Post:
azherkn3
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to split files based on number of lines

I am getting a few gzip files into a folder by doing ftp to another server. Once I get them I move them to another location .But before that I need to make sure each gzip is not more than 5000 lines and split it up . The files I get are anywhere from 500 lines to 10000 lines in them and is in gzip... (4 Replies)
Discussion started by: gubbu
4 Replies

2. Shell Programming and Scripting

Split line to multiple files Awk/Sed/Shell Script help

Hi, I need help to split lines from a file into multiple files. my input look like this: 13 23 45 45 6 7 33 44 55 66 7 13 34 5 6 7 87 45 7 8 8 9 13 44 55 66 77 8 44 66 88 99 6 I want to split every 3 lines from this file to be written to individual files. (3 Replies)
Discussion started by: saint2006
3 Replies

3. UNIX for Dummies Questions & Answers

Writing awk script to read csv files and split them

Hi Here is my script that calls my awk script #!/bin/bash set -x dir="/var/local/dsx/csv" testfile="$testfile" while getopts " f: " option do case $option in f ) testfile="$OPTARG";; esac; done ./scriptFile --testfile=$testfile >> $dir/$testfile.csv It calls my awk... (1 Reply)
Discussion started by: ladyAnne
1 Replies

4. Shell Programming and Scripting

Script to create a text file whose content is the text of another files

Hello everyone, I work under Ubuntu 11.10 (c-shell) I need a script to create a new text file whose content is the text of another text files that are in the directory $DIRMAIL at this moment. I will show you an example: - On the one hand, there is a directory $DIRMAIL where there are... (1 Reply)
Discussion started by: tenteyu
1 Replies

5. Shell Programming and Scripting

Backup script to split and tar files

Hi Guys, I'm very new to bash scripting. Please help me on this. I'm in need of a backup script which does the ff. 1. If a file is larger than 5GB. split it and tar the file. 2. Weekly backup file to amazon s3 using s3rsync 3. If a file is unchanged it doesn't need to copy to amazon s3 ... (4 Replies)
Discussion started by: ganitolngyundre
4 Replies

6. Shell Programming and Scripting

perl script to split the text file after every 4th field

I had a text file(comma seperated values) which contains as below 196237,ram,25-May-06,ram.kiran@xyz.com,204183,Pavan,4-Jun-07,Pavan.Desai@xyz.com,237107,ram Chandra,15-Mar-10,ram.krishna@xyz.com ... (3 Replies)
Discussion started by: giridhar276
3 Replies

7. Shell Programming and Scripting

awk script to split file into multiple files based on many columns

So I have a space delimited file that I'd like to split into multiple files based on multiple column values. This is what my data looks like 1bc9A02 1 10 1000 FTDLNLVQALRQFLWSFRLPGEAQKIDRMMEAFAQRYCQCNNGVFQSTDTCYVLSFAIIMLNTSLHNPNVKDKPTVERFIAMNRGINDGGDLPEELLRNLYESIKNEPFKIPELEHHHHHH 1ku1A02 1 10... (9 Replies)
Discussion started by: viored
9 Replies

8. Shell Programming and Scripting

Split a text file into multiple text files?

I have a text file with entries like 1186 5556 90844 7873 7722 12 7890.6 78.52 6679 3455 9867 1127 5642 ..N so many records like this. I want to split this file into multiple files like cluster1.txt, cluster2.txt, cluster3.txt, ..... clusterN.txt. (4 Replies)
Discussion started by: sammy777
4 Replies

9. Shell Programming and Scripting

How to split files using shell script?

solid top facet normal 0 1 0 outer loop vertex 0 1 0 vertex 1 1 1 vertex 1 1 0 endloop endfacet facet normal 0 1 0 outer loop vertex 0 1 0 vertex 0 1 1 vertex 1 1 1 endloop endfacet endsolid top solid bottom facet normal 0 -1 ... (3 Replies)
Discussion started by: linuxUser_
3 Replies

10. UNIX for Beginners Questions & Answers

Shell script to Split matrix file with delimiter into multiple files

I have a large semicolon delimited file with thousands of columns and many thousands of line. It looks like: ID1;ID2;ID3;ID4;A_1;B_1;C_1;A_2;B_2;C_2;A_3;B_3;C_3 AA;ax;ay;az;01;02;03;04;05;06;07;08;09 BB;bx;by;bz;03;05;33;44;15;26;27;08;09 I want to split this table in to multiple files: ... (1 Reply)
Discussion started by: trymega
1 Replies

LEARN ABOUT DEBIAN

svn::class::repos

SVN::Class::Repos(3pm)					User Contributed Perl Documentation				    SVN::Class::Repos(3pm)

NAME

       SVN::Class::Repos - represents the repository of a Subversion workspace

SYNOPSIS

	use SVN::Class;

	my $file = svn_file( 'path/to/file' );
	my $info = $file->info;
	my $url  = $info->url;
	print "repository URL is $url
";

DESCRIPTION

       SVN::Class::URL represents the source repository for a workspace.

METHODS

       SVN::Class::URL inherits from Rose::URI and SVN::Class.

   init
       Override the base Rose::URI method to set some default values in object.

AUTHOR

       Peter Karman, "<karman at cpan.org>"

BUGS

       Please report any bugs or feature requests to "bug-svn-class at rt.cpan.org", or through the web interface at
       http://rt.cpan.org/NoAuth/ReportBug.html?Queue=SVN-Class <http://rt.cpan.org/NoAuth/ReportBug.html?Queue=SVN-Class>.  I will be notified,
       and then you'll automatically be notified of progress on your bug as I make changes.

SUPPORT

       You can find documentation for this module with the perldoc command.

	   perldoc SVN::Class

       You can also look for information at:

       o   AnnoCPAN: Annotated CPAN documentation

	   http://annocpan.org/dist/SVN-Class <http://annocpan.org/dist/SVN-Class>

       o   CPAN Ratings

	   http://cpanratings.perl.org/d/SVN-Class <http://cpanratings.perl.org/d/SVN-Class>

       o   RT: CPAN's request tracker

	   http://rt.cpan.org/NoAuth/Bugs.html?Dist=SVN-Class <http://rt.cpan.org/NoAuth/Bugs.html?Dist=SVN-Class>

       o   Search CPAN

	   http://search.cpan.org/dist/SVN-Class <http://search.cpan.org/dist/SVN-Class>

ACKNOWLEDGEMENTS

       I looked at SVN::Agent before starting this project. It has a different API, more like SVN::Client in the SVN::Core, but I cribbed some of
       the ideas.

       The Minnesota Supercomputing Institute "http://www.msi.umn.edu/" sponsored the development of this software.

COPYRIGHT

       Copyright 2008 by the Regents of the University of Minnesota.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

SEE ALSO

       Rose::URI, Path::Class, Class::Accessor::Fast, SVN::Agent, IPC::Cmd

perl v5.14.2							    2012-01-31						    SVN::Class::Repos(3pm)
All times are GMT -4. The time now is 03:21 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy