Split a large array into small chunks Post: 302779629

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large file into small files

Hi, I need to split a large file into small files based on a string. At different palces in the large I have the string ^Job. I need to split the file into different files starting from ^Job to the last character before the next ^Job. Also all the small files should be automatically named....

2. Shell Programming and Scripting

Split a file into 16 small files

Hi I want to split a file that has 'n' number of records into 16 small files. Can some one suggest me how to do this using Unix script? Thanks rrkk

3. Shell Programming and Scripting

Split large file and add header and footer to each small files

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file?

4. Shell Programming and Scripting

script to splite large file to number of small files

Dear All, Could you please help me to split a file contain around 240,000,000 line to 4 files all equally likely , note that we need to maintain that the end of each file should started by start flage (MSISDN) and ended by end flag (End), also the number of the line between the...

5. Shell Programming and Scripting

Split file into chunks of low & high byte

Hi guys, i have a question about spliting a binary file into 2 chunks. First chunk with all high bytes and the second one with all low bytes. What unix tools can i use? And how can this be performed? I looked in manpages of split and dd but this does not help. Thanks

6. Shell Programming and Scripting

Breaking large file into small files

Dear all, I have huge txt file with the input files for some setup_code. However for running my setup_code, I require txt files with maximum of 1000 input files Please help me in suggesting way to break down this big txt file to small txt file of 1000 entries only. thanks and Greetings, Emily

7. Shell Programming and Scripting

Bash arrays: rebin/interpolate smaller array to large array

hello, i need a bit of help on how to do this effectively in bash without a lot of extra looping or massive switch/case i have a long array of M elements and a short array of N elements, so M > N always. M is not a multiple of N. for case 1, I want to stretch N to fit M arrayHuge H = (...

8. Shell Programming and Scripting

Modification of perl script to split a large file into chunks of 5000 chracters

I have a perl script which splits a large file into chunks.The script is given below use strict; use warnings; open (FH, "<monolingual.txt") or die "Could not open source file. $!"; my $i = 0; while (1) { my $chunk; print "process part $i\n"; open(OUT, ">part$i.log") or die "Could...

9. UNIX for Beginners Questions & Answers

Split large file into smaller files without disturbing the entry chunks

Dears, Need you help with the below file manipulation. I want to split the file into 8 smaller files but without cutting/disturbing the entries (meaning every small file should start with a entry and end with an empty line). It will be helpful if you can provide a one liner command for this...

10. UNIX for Beginners Questions & Answers

Split large file into 24 small files on one hour basis

I Have a large file with 24hrs log in the below format.i need to split the large file in to 24 small files on one hour based.i.e ex:from 09:55 to 10:55,10:55-11:55 can any one help me on this.! ...

LEARN ABOUT DEBIAN

xdf_define_arrays

XDF_DEFINE_ARRAYS(3)					     xdffileio library manual					      XDF_DEFINE_ARRAYS(3)

NAME

       xdf_define_arrays - Specify the number of input/output arrays

SYNOPSIS

       #include <xdfio.h>

       int xdf_define_arrays(struct xdf* xdf,
			     unsigned int narrays, const size_t *strides);

DESCRIPTION

       xdf_define_arrays()  specifies  the  number  of	arrays and its strides for upcoming calls to xdf_write(3) and xdf_read(3) using xdf.  This
       function is used to configure the upcoming transfer. As such, it must be called before xdf_prepare_transfer(3) (calling it after will  pro-
       duce an error). However the function may be called several times but only the last call is meaningful for the transfer.

       narrays specifies the number of arrays that will be provided in the argument list of xdf_write(3) or xdf_read(3).

       strides argument should point to an array of narrays unsigned int corresponding respectively to the stride of each arrays that will be sup-
       plied to the upcoming call to xdf_write(3) or xdf_read(3).  The stride corresponds to the length in byte between two consecutive samples of
       the same channel in the array.

RETURN VALUE

       xdf_define_arrays() returns 0 in case of success, otherwise -1 and errno is set appropriately.

ERRORS

       ENOMEM The system is unable to allocate resources.

SEE ALSO

       xdf_prepare_transfer(3), xdf_read(3), xdf_write(3)

EPFL
								       2010						      XDF_DEFINE_ARRAYS(3)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Splitting large file into small files

Discussion started by: dncs

2. Shell Programming and Scripting

Split a file into 16 small files

Discussion started by: rrkks

3. Shell Programming and Scripting

Split large file and add header and footer to each small files

Discussion started by: ashish4422

4. Shell Programming and Scripting

script to splite large file to number of small files

Discussion started by: ahmed.gad