I have a file which has about 500K records and I need to delete about 50 records from the file. I know line numbers and am using
sed '13456,13457,......d' filename > new file.
It does not seem to be working.
Any help will greatly appreciated. (5 Replies)
Input:
a
b
b
c
d
d
I need:
a
c
I know how to get this (the lines that have duplicates) :
b
d
sort file | uniq -d
But i need opossite of this. I have searched the forum and other places as well, but have found solution for everything except this variant of the problem. (3 Replies)
Hi All,
I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space.
I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Hi
This is a sample of my data file.
##field PH01000000 1 4869017
#PH01000000G0240
WWW278545G0240 P.he_model_v1.0 erine 119238 121805 . - . ID=PH01000000G0240;Description="zinc finger, C3HC4 type domain containing protein, expressed"... (7 Replies)
Hello,
I have file of more than 10000 lines.
I want to delete 40 lines after every 20 lines.
e.g from a huge file, i want to delete line no from 34 - 74, then 94 - 134 etc and so on.
Please let me know how i can do it.
Best regards, (11 Replies)
Hi,
I have a txt document having a format like this:
DATA1 | DATA2 | DATA3 | 23-JAN-20 23:41:34
DATA1 | DATA2 | DATA3 | 23-JAN-20 23:41:32
DATA1 | DATA2 | DATA3 | 23-JAN-20 23:41:30
...
DATA1 | DATA2 | DATA3 | 23-JAN-20 22:35:31
DATA1 | DATA2 | DATA3 | 23-JAN-20 22:30:34
DATA1 | DATA2 |... (1 Reply)
Discussion started by: gc_sw
1 Replies
LEARN ABOUT CENTOS
sge_request
SGE_REQUEST(5) Sun Grid Engine File Formats SGE_REQUEST(5)NAME
sge_request - Sun Grid Engine default request definition file format
DESCRIPTION
sge_request reflects the format of the files to define default request profiles. If available, default request files are read and processed
during job submission before any submit options embedded in the job script and before any options in the qsub(1) or qsh(1) command-line are
considered. Thus, the command-line and embedded script options may overwrite the settings in the default request files (see qsub(1) or
qsh(1) for details).
There is a cluster global, a user private and a working directory local default request definition file. The working directory local
default request file has the highest precedence and is followed by the user private and then the cluster global default request file.
Note, that the -clear option to qsub(1) or qsh(1) can be used to discard any previous settings at any time in a default request file, in
the embedded script flags or in a qsub(1) or qsh(1) command-line option.
The format of the default request definition files is:
o The default request files may contain an arbitrary number of lines. Blank lines and lines with a '#' sign in the first column are
skipped.
o Each line not to be skipped may contain any qsub(1) option as described in the Sun Grid Engine Reference Manual. More than one option
per line is allowed. The batch script file and argument options to the batch script are not considered as qsub(1) options and thus are
not allowed in a default request file.
EXAMPLES
The following is a simple example of a default request definition file:
=====================================================
# Default Requests File
# request group to be sun4 and a CPU-time of 5hr
-l arch=sun4,s_cpu=5:0:0
# don't restart the job in case of system crashes
-r n
=====================================================
Having defined a default request definition file like this and submitting a job as follows:
qsub test.sh
would have precisely the same effect as if the job was submitted with:
qsub -l arch=sun4,s_cpu=5:0:0 -r n test.sh
FILES
<sge_root>/<cell>/common/sge_request
global defaults file
$HOME/.sge_request user private defaults file
$cwd/.sge_request cwd directory defaults file
SEE ALSO sge_intro(1), qsh(1), qsub(1), Sun Grid Engine Installation and Administration Guide
COPYRIGHT
See sge_intro(1) for a full statement of rights and permissions.
SGE 6.2u5 $Date$ SGE_REQUEST(5)