Help with splitting a large text file into smaller ones Post: 302334374

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Cutting a large log file in to smaller ones

I have a very large (150 megs) IRC log file from 2000-2001 which I want to cut down to individual daily log files. I have a very basic knowledge of the cat, sed and grep commands. The log file is time stamped and each day in the large log file begins with a "Session Start" string like so: ...

2. Shell Programming and Scripting

Splitting a Larger File Into Mutiple Smaller ones.

Hello.. Iam in need to urgent help with the below. Have data-file with 40,567 and need to split them into multiple files with smaller line-count. Iam aware of "split" command with -l option which allows you to specify the no of lines in smaller files ,with the target file-name pattern...

3. UNIX for Dummies Questions & Answers

splitting the large file into smaller files

hi all im new to this forum..excuse me if anythng wrong. I have a file containing 600 MB data in that. when i do parse the data in perl program im getting out of memory error. so iam planning to split the file into smaller files and process one by one. can any one tell me what is the code...

4. Shell Programming and Scripting

splitting text file into smaller ones

Hello We have a text file with 400,000 lines and need to split into multiple files each with 5000 lines ( will result in 80 files) Got an idea of using head and tail commands to do that with a loop but looked not efficient. Please advise the simple and yet effective way to do it. TIA...

5. UNIX for Dummies Questions & Answers

multiple smaller files from one large file

I have a file with a simple list of ids. 750,000 rows. I have to break it down into multiple 50,000 row files to submit in a batch process.. Is there an easy script I could write to accomplish this task?

6. Shell Programming and Scripting

splitting a large text file into paragraphs

Hello all, newbie here. I've searched the forum and found many "how to split a text file" topics but none that are what I'm looking for. I have a large text file (~15 MB) in size. It contains a variable number of "paragraphs" (for lack of a better word) that are each of variable length. A...

7. Shell Programming and Scripting

Splitting a file into several smaller files using perl

Hi, I'm trying to split a large file into several smaller files the script will have two input arguments argument1=filename and argument2=no of files to be split. In my large input file I have a header followed by 100009 records The first line is a header; I want this header in all my...

8. Shell Programming and Scripting

Sed: Splitting A large File into smaller files based on recursive Regular Expression match

I will simplify the explaination a bit, I need to parse through a 87m file - I have a single text file in the form of : <NAME>house........ SOMETEXT SOMETEXT SOMETEXT . . . . </script> MORETEXT MORETEXT . . .

9. UNIX for Dummies Questions & Answers

Split large file to smaller fastly

hi , I have a requirement input file: 1 1111111111111 108 1 1111111111111 109 1 1111111111111 109 1 1111111111111 110 1 1111111111111 111 1 1111111111111 111 1 1111111111111 111 1 1111111111111 112 1 1111111111111 112 1 1111111111111 112 The output should be,

10. Shell Programming and Scripting

Splitting a text file into smaller files with awk, how to create a different name for each new file

Hello, I have some large text files that look like, putrescine Mrv1583 01041713302D 6 5 0 0 0 0 999 V2000 2.0928 -0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 5.6650 0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 3.5217 ...

LEARN ABOUT HPUX

readahead-collector

readahead-collector(8)                                        System Manager's Manual                                       readahead-collector(8)

NAME

       readahead-collector - collect list of files used during the boot process

SYNOPSIS

       readahead-collector [options]

DESCRIPTION

       readahead-collector is a files list generator for use in readahead(8) based on the files used during the boot process.

       Note: readahead-collector uses the audit subsystem of the kernel
              to  gather  the  list  of  accessed  files; for this reason, it is necessary that the kernel is built with the CONFIG_AUDIT and CON-
              FIG_AUDITSYSCAL options enabled.  Stock Debian kernels are built with these options.

OPTIONS

       -d     enable debug mode.

       -f     leave the daemon in the foreground for debugging, output goes to stdout.

       -h     print the usage information.

FILES

       /etc/readahead.conf

SEE ALSO

       readahead(8)

AUTHORS

       Karel Zak <kzak@redhat.com>,

       This manual page was written by Raphael Geissert <geissert@debian.org>

                                                                    August 2009                                             readahead-collector(8)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Cutting a large log file in to smaller ones

Discussion started by: MrTangent

2. Shell Programming and Scripting

Splitting a Larger File Into Mutiple Smaller ones.

Discussion started by: madhubt_1982

3. UNIX for Dummies Questions & Answers

splitting the large file into smaller files

Discussion started by: vsnreddy

4. Shell Programming and Scripting

splitting text file into smaller ones

Discussion started by: prvnrk