Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Split file based on file size in Korn script
Top Forums Shell Programming and Scripting Split file based on file size in Korn script Post 302661723 by in2nix4life on Monday 25th of June 2012 04:14:50 PM
Old 06-25-2012
This may help get you started:

Code:
#!/bin/ksh
#
#

# declare an array and populate it with files larger
# than 2GBs in the current directory
set -A files $(find . -maxdepth 1 -size +2000000 -type f | sed 's/\.\///')

# set counter
counter=0

# get number of files in the array
numfiles=${#files[*]}

# set linecount
linecount=0

# set number of lines
numlines=0

# iterate through the array files, retrieve the line count,
# divide it by 2 and feed everything to the split command
while [ $counter -lt $numfiles ]
do
    linecount=$(wc -l ${files[$counter]} | awk '{print $1}')
    numlines=$(expr $linecount / 2)
    split -l $numlines ${files[$counter]} ${files[$counter]}
    ((counter=$counter+1))
done

# done
exit 0

This User Gave Thanks to in2nix4life For This Post:
ssemple2000
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk script to split a file based on the condition

I have the file with the records like 4234234 US phone 3244234 US cup 2342342 CA phone 8947234 US phone 2389472 CA cup 2348972 US maps 3894234 CA phone I want the records with (US,phone) as record to be in one file, (Us, cup) in another file and (CA,cup) to be in another I mean all... (12 Replies)
Discussion started by: superprogrammer
12 Replies

2. Programming

create a spool file based on values passed from korn shell to sql script

this is my issue. 4 parameters are passed from korn shell to sql script. parameter_1= varchar2 datatype or no value entered my user. parameter_2= number datatype or no value entered my user. parameter_3= number datatype or no value entered my user. parameter_4= number datatype or no... (5 Replies)
Discussion started by: megha2525
5 Replies

3. Shell Programming and Scripting

Split file based on size

Hi Friends, Below is my requirement. I have a file with the below structure. 0001A1.... 0001B1.. .... 0001L1 0002A1 0002B1 ...... 0002L1 .. the first 4 characters are the sequence numbers for a record, A record will start with A1 and end with L1 with same sequence number. Now the... (2 Replies)
Discussion started by: diva_thilak
2 Replies

4. Shell Programming and Scripting

Split a file into multiple files based on first two digits of file.

Hi , I do have a fixedwidth flatfile that has data for 10 different datasets each identified by the first two digits in the flatfile. 01 in the first two digit position refers to Set A 02 in the first two digit position refers to Set B and so on I want to genrate 10 different files from my... (6 Replies)
Discussion started by: okkadu
6 Replies

5. Shell Programming and Scripting

Split a file based on pattern and size

Hello, I have a large file (2GB) that I would like to split based on pattern and size. I've used the following command to split the file (token is "HELLO") awk '/HELLO/{i++}{print > "file"i}' input.txt and the output is similar to the following (i included filesize in KB): 10 ... (2 Replies)
Discussion started by: jl487
2 Replies

6. Shell Programming and Scripting

How to split file into multiple files using awk based on 1 field in the file?

Good day all I need some helps, say that I have data like below, each field separated by a tab DATE NAME ADDRESS 15/7/2012 LX a.b.c 15/7/2012 LX1 a.b.c 16/7/2012 AB a.b.c 16/7/2012 AB2 a.b.c 15/7/2012 LX2 a.b.c... (2 Replies)
Discussion started by: alexyyw
2 Replies

7. Shell Programming and Scripting

awk script to split file into multiple files based on many columns

So I have a space delimited file that I'd like to split into multiple files based on multiple column values. This is what my data looks like 1bc9A02 1 10 1000 FTDLNLVQALRQFLWSFRLPGEAQKIDRMMEAFAQRYCQCNNGVFQSTDTCYVLSFAIIMLNTSLHNPNVKDKPTVERFIAMNRGINDGGDLPEELLRNLYESIKNEPFKIPELEHHHHHH 1ku1A02 1 10... (9 Replies)
Discussion started by: viored
9 Replies

8. Shell Programming and Scripting

Split the File based on Size

I have a file that is about 7 GB in size. The requirement is I should split the file equally in such a way that the size of the split files is less than 2Gb. If the file is less than 2gb, than nothing needs to be done. ( need to done using shell script) Thanks, (4 Replies)
Discussion started by: rudoraj
4 Replies

9. Answers to Frequently Asked Questions

How to split a dat file based on another file ni UNIX?

i have two files , one is var.txt and another res.dat file var.txt contains informaton like below date,request,sales,item 20171015,1,123456,216 20171015,1,123456,217 20171015,2,345678,214 20171015,3,456789,218 and res.dat contains is a one huge file contains information like... (1 Reply)
Discussion started by: pogo
1 Replies

10. UNIX for Beginners Questions & Answers

File Size Split up based on Month

Hi, I have a directory in Unix and there are folders available in the directory. Files are created on different month and now i have a requirement to calculate size of the folder on month basis. Is there any Unix command to check this please?? Thanks (6 Replies)
Discussion started by: Nivas
6 Replies

LEARN ABOUT DEBIAN

ost_counter

ost::Counter< T >(3)					     Library Functions Manual					      ost::Counter< T >(3)

NAME

       ost::Counter< T > -

       The counter template is used for generic objects which act as automatic counters.

SYNOPSIS

       #include <counter.h>

   Public Member Functions
       Counter ()
	   Construct and initialize a counter to zero.
       Counter (const Counter &counter)
	   Construct a counter with an initial value set for another counter.
       Counter (T initial)
	   Construct a counter with an initial value of the specified data type.
       T & operator= (T c)
       operator T ()

   Protected Attributes
       T count

Detailed Description
   template<typename T>class ost::Counter< T >
       The counter template is used for generic objects which act as automatic counters.

       Each time the object is accessed, the underlying counted data type is incremented.

       Author:
	   David Sugar dyfet@gnutelephony.org Automatic counter template class.

Constructor &; Destructor Documentation
   template<typename T > ost::Counter< T >::Counter () [inline]
       Construct and initialize a counter to zero.

       References ost::Counter< T >::count.

   template<typename T > ost::Counter< T >::Counter (const Counter< T > &counter) [inline]
       Construct a counter with an initial value set for another counter. Parameters:
	   counter to copy from.

       References ost::Counter< T >::count.

   template<typename T > ost::Counter< T >::Counter (Tinitial) [inline]
       Construct a counter with an initial value of the specified data type. Parameters:
	   initial value to set.

       References ost::Counter< T >::count.

Member Function Documentation
   template<typename T > ost::Counter< T >::operator T () [inline]
       References ost::Counter< T >::count.

   template<typename T > T& ost::Counter< T >::operator= (Tc) [inline]
Member Data Documentation
   template<typename T > T ost::Counter< T >::count [protected]
       Referenced by ost::Counter< T >::Counter(), and ost::Counter< T >::operator T().

Author
       Generated automatically by Doxygen for GNU CommonC++ from the source code.

GNU CommonC++							  Sat Jun 23 2012					      ost::Counter< T >(3)
All times are GMT -4. The time now is 07:01 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy