If disk i/o is not making split "too slow" then try awk. But you should consider that a big I/O request queue length on that filesystem is a likely candidate for slow splitting, rather than split being a bad performer.
awk version of split:
I have an excel file with more than 65K records... Since excel does not take more than 65K records i wan to split the file and send it as two excel files... Could some help me how to use the csplit by specifiying the no of records (7 Replies)
Hi All,
Can someone please help me write a script for the following requirement in awk, grep, sed or perl.
Buuuu xxx bbb
Kmmmm rrr ssss uuuu
Kwwww zzzz ccc
Roooowwww eeee
Bxxxx jjjj dddd
Kuuuu eeeee nnnn
Rpppp cccc vvvv cccc
Rhhhhhhyyyy tttt
Lhhhh rrrrrssssss
Bffff mmmm iiiii
Ktttt... (5 Replies)
Dear all,
I have a large file which is composed of 8000 frames, what i would like to do is split the file into 8000 single files names file.pdb.1, file.pdb.2 etc etc
each frame in the large file is seperated by a "ENDMDL" flag so my thinking is to use this flag a a point to split the files... (4 Replies)
Hello!
Have some problem with extract files from saved session.
File contains any kind of special/printable characters.
DATA NumberA DATA
DATA Begin
DATA1.1
DATA1.2 NumberB1 DATA1.3
DATA1.4
End DATA
DATA
DATA Begin
DATA2.1
DATA2.2 NumberB2 DATA2.3
DATA2.4
End DATA
DATA
... (4 Replies)
Hi all,
I'm pretty new to Shell scripting and I need some help to split a source text file into multiple files. The source has a row with pattern where the file needs to be split, and the pattern row also contains the file name of the destination for that specific piece. Here is an example:
... (2 Replies)
Hello;
I have a file consists of 4 columns separated by tab. The problem is the third fields. Some of the them are very long but can be split by the vertical bar "|". Also some of them do not contain the string "UniProt", but I could ignore it at this moment, and sort the file afterwards. Here is... (5 Replies)
Hello, I have a large file (2GB) that I would like to split based on pattern and size.
I've used the following command to split the file (token is "HELLO")
awk '/HELLO/{i++}{print > "file"i}' input.txt
and the output is similar to the following (i included filesize in KB):
10 ... (2 Replies)
Hello,
I want to split a big file into smaller ones with certain "counts". I am aware this type of job has been asked quite often, but I posted again when I came to csplit, which may be simpler to solve the problem.
Input file (fasta format):
>seq1
agtcagtc
agtcagtc
ag
>seq2
agtcagtcagtc... (8 Replies)
Hi ,
I have huge files around 400 mb, which has clob data and have diffeent scenarios:
I am trying to pass scenario number as parameter and and get required modified file based on the scenario number and criteria.
Scenario 1:
file name : scenario_1.txt
... (2 Replies)
Hello All,
I have records in a file in a pattern A,B,B,B,B,K,A,B,B,K
Is there any command or simple logic I can pull out records into multiple files based on A record? I want output as
File1: A,B,B,B,B,K
File2: A,B,B,K (9 Replies)
Discussion started by: deal1dealer
9 Replies
LEARN ABOUT DEBIAN
queue-repair
queue-repair(8) System Manager's Manual queue-repair(8)NAME
queue-repair - deal with the qmail queue directory structure
SYNOPSIS
queue-repair [ -htrcbn ] [ -n split ] [ conf-qmail ]
DESCRIPTION
queue-repair deals with the qmail queue structure; it can create a new queue, move and properly rename a queue, dynamically change the
conf-split value, convert big-todo queues to non-big-todo and vice versa, and repair a corrupted queue.
conf-qmail defaults to /var/lib/qmail/ on Debian.
OPTIONS
-h|--help
Display usage information and built-in defaults, then exit.
-t|--test
Run in test-only mode. queue-repair will attempt to report all problems that it finds, without correcting them. This is the
default.
-r|--repair
Run in repair mode. queue-repair will attempt to correct all problems that it finds, except if the basic queue directories (queue,
queue/mess, queue/info, etc) are not found.
-c|--create
Run in create-and-repair mode. queue-repair will attempt to correct all problems that it finds, including creation of a new queue
structure from scratch.
-s|--split split
Specify split as the value of conf-split. This is the number of split subdirectories for those queue directories which are hashed.
The default for qmail is 23. Appropriate values depend on the volume of mail handled, OS filesystem efficiency, and other factors,
but this should always be a prime number.
If you do not specify conf-split, queue-repair will attempt to determine the current value from the existing queue. This option can
be used, however, to change the conf-split value of an existing queue (qmail will still have to be recompiled with the new value).
When creating a new queue, this option must always be specified.
-b|--bigtoto
Use big-todo. queue-repair should be able to automatically determine if you're using qmail patched with the big-todo patch. This
option can be used, however, to convert a non-big-todo queue to a big-todo queue (qmail will still have to be recompiled with the
big-todo patch).
If neither this option nor --no-bigtodo is used, queue-repair will attempt to determine this automatically. When creating a new
queue, either this option or --no-bigtodo must always be specified.
-n|--no-bigtodo
Do not use big-todo. queue-repair should be able to automatically determine if you're using qmail patched with the big-todo patch.
This option can be used, however, to convert a big-todo queue to a non big-todo queue (qmail will still have to be recompiled with-
out the big-todo patch).
If neither this option nor --bigtodo is used, queue-repair will attempt to determine this automatically. When creating a new queue,
either this option or --bigtodo must always be specified.
--i-want-a-broken-conf-split
Force the use of a non-prime value for conf-split.
SEE ALSO qmail(7)queue-repair(8)