Cutting a large log file in to smaller ones Post: 51311

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Need help cutting a couple of fields from log file.

Data begins as such; Mar 16 03:27:05 afzpimdn01 named: denied update from .3983 for "nnn.nnn.in-addr.arpa" IN Mar 16 03:27:37 afzpimdn01 named: denied update from .4844 for "nnn.nnn.in-addr.arpa" IN Mar 16 03:27:56 afzpimdn01 named: denied update from .2650 for "nnn.nnn.in-addr.arpa" IN ...

2. UNIX for Dummies Questions & Answers

splitting the large file into smaller files

hi all im new to this forum..excuse me if anythng wrong. I have a file containing 600 MB data in that. when i do parse the data in perl program im getting out of memory error. so iam planning to split the file into smaller files and process one by one. can any one tell me what is the code...

3. Shell Programming and Scripting

Help with splitting a large text file into smaller ones

Hi Everyone, I am using a centos 5.2 server as an sflow log collector on my network. Currently I am using inmons free sflowtool to collect the packets sent by my switches. I have a bash script running on an infinate loop to stop and start the log collection at set intervals - currently one...

4. UNIX for Dummies Questions & Answers

multiple smaller files from one large file

I have a file with a simple list of ids. 750,000 rows. I have to break it down into multiple 50,000 row files to submit in a batch process.. Is there an easy script I could write to accomplish this task?

5. Shell Programming and Scripting

Split large file into smaller file

hi Guys i need some help here.. i have a file which has > 800,000 lines in it. I need to split this file into smaller files with 25000 lines each. please help thanks

6. Shell Programming and Scripting

Help needed - Split large file into smaller files based on pattern match

Help needed urgently please. I have a large file - a few hundred thousand lines. Sample CP START ACCOUNT 1234556 name 1 CP END ACCOUNT CP START ACCOUNT 2224444 name 1 CP END ACCOUNT CP START ACCOUNT 333344444 name 1 CP END ACCOUNT I need to split this file each time "CP START...

7. Shell Programming and Scripting

Sed: Splitting A large File into smaller files based on recursive Regular Expression match

I will simplify the explaination a bit, I need to parse through a 87m file - I have a single text file in the form of : <NAME>house........ SOMETEXT SOMETEXT SOMETEXT . . . . </script> MORETEXT MORETEXT . . .

8. UNIX for Dummies Questions & Answers

Split large file to smaller fastly

hi , I have a requirement input file: 1 1111111111111 108 1 1111111111111 109 1 1111111111111 109 1 1111111111111 110 1 1111111111111 111 1 1111111111111 111 1 1111111111111 111 1 1111111111111 112 1 1111111111111 112 1 1111111111111 112 The output should be,

9. Shell Programming and Scripting

Bash arrays: rebin/interpolate smaller array to large array

hello, i need a bit of help on how to do this effectively in bash without a lot of extra looping or massive switch/case i have a long array of M elements and a short array of N elements, so M > N always. M is not a multiple of N. for case 1, I want to stretch N to fit M arrayHuge H = (...

10. UNIX for Beginners Questions & Answers

Split large file into smaller files without disturbing the entry chunks

Dears, Need you help with the below file manipulation. I want to split the file into 8 smaller files but without cutting/disturbing the entries (meaning every small file should start with a entry and end with an empty line). It will be helpful if you can provide a one liner command for this...

LEARN ABOUT REDHAT

sa2

SA2(8)								Linux User's Manual							    SA2(8)

NAME

       sa2 - Write a daily report in the /var/log/sa directory.

SYNOPSIS

       /usr/lib/sa/sa2

DESCRIPTION

       The  sa2  command  is  a shell procedure variant of the sar command which writes a daily report in the /var/log/sa/sardd file, where the dd
       parameter indicates the current day. The sa2 command handles all of the flags and parameters of the sar command.

       The sa2 command is designed to be started automatically by the cron command.

EXAMPLES

       To run the sa2 command daily, place the following entry in your root or adm crontab file:

       5 19 * * 1-5 /usr/lib/sa/sa2 -A &

       This will generate a daily report called /var/log/sa/sardd It will also remove reports more than one week old.

FILES

       /var/log/sa/sardd
	      Indicate the daily report file, where the dd parameter is a number representing the day of the month.

AUTHOR

       Sebastien Godard <sebastien.godard@wanadoo.fr>

SEE ALSO

       sar(1), sadc(8), sa1(8), mpstat(1), iostat(1), vmstat(8)

       http://perso.wanadoo.fr/sebastien.godard/

Linux								   DECEMBER 1999							    SA2(8)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Need help cutting a couple of fields from log file.

Discussion started by: altamaha

2. UNIX for Dummies Questions & Answers

splitting the large file into smaller files

Discussion started by: vsnreddy

3. Shell Programming and Scripting

Help with splitting a large text file into smaller ones

Discussion started by: lord_butler

4. UNIX for Dummies Questions & Answers

multiple smaller files from one large file

Discussion started by: rtroscianecki

5. Shell Programming and Scripting

Split large file into smaller file

Discussion started by: sitaldip

6. Shell Programming and Scripting

Help needed - Split large file into smaller files based on pattern match

Discussion started by: frustrated1

7. Shell Programming and Scripting

Sed: Splitting A large File into smaller files based on recursive Regular Expression match

Discussion started by: sumguy