Dear community,
I have to remove duplicate lines from a file contains a very big ammount of rows (milions?) based on 1st and 3rd columns
The data are like this:
Code:
Region 23/11/2014 09:11:36 41752
Medio 23/11/2014 03:11:38 4132
Info 23/11/2014 05:11:09 4323
Test 23/11/2014 05:11:14 4323
Info 23/11/2014 07:11:09 4323
Test2 23/11/2014 08:11:14 4323
In that case I need to remove one of the line who contains "Info" and "4323". So the output will be:
Code:
Region 23/11/2014 09:11:36 41752
Medio 23/11/2014 03:11:38 4132
Info 23/11/2014 05:11:09 4323
Test 23/11/2014 05:11:14 4323
Test2 23/11/2014 08:11:14 4325
I am doing KSH script to remove duplicate lines in a file. Let say the file has format below.
FileA
1253-6856
3101-4011
1827-1356
1822-1157
1822-1157
1000-1410
1000-1410
1822-1231
1822-1231
3101-4011
1822-1157
1822-1231
and I want to simply it with no duplicate line as file... (5 Replies)
I have a log file "logreport" that contains several lines as seen below:
04:20:00 /usr/lib/snmp/snmpdx: Agent snmpd appeared dead but responded to ping
06:38:08 /usr/lib/snmp/snmpdx: Agent snmpd appeared dead but responded to ping
07:11:05 /usr/lib/snmp/snmpdx: Agent snmpd appeared dead but... (18 Replies)
Hi,
I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g.
COL1 COL2 COL3
A 1234 1234
B 3k32 2322
C Xk32 TTT
A NEW XX22
B 3k32 ... (7 Replies)
Hii Friends.. I have a huge set of data stored in a file.Which is as shown below
a.dat:
RAO 1869 12 19 0 0 0.00 17.9000 82.3000 10.0 0 0.00 0 3.70 0.00 0.00 0 0.00 3.70 4 NULL
LEE 1870 4 11 1 0 0.00 30.0000 99.0000 0.0 0 0.00 0 0.00 0.00 0.00 0 ... (3 Replies)
hello all,
I have an input file with four columns like this with a lot of lines
and for example, line 1 and line 5 match because the first 4 characters match and the fourth column matches too. I want to keep the line that has the lowest number in the third column. So I discard line 5.... (5 Replies)
Hey guys, need some help to fix this script. I am trying to remove all the duplicate lines in this file.
I wrote the following script, but does not work. What is the problem?
The output file should only contain five lines:
Later! (5 Replies)
hi,
Please help me to write a command to delete duplicate lines from a file. And the size of file is 50 MB. How to remove duplicate lins from such a big file. (6 Replies)
Hi,
In a file, I have to mark duplicate records as 'D' and the latest record alone as 'C'.
In the below file, I have to identify if duplicate records are there or not based on Man_ID, Man_DT, Ship_ID and I have to mark the record with latest Ship_DT as "C" and other as "D" (I have to create... (7 Replies)
I have a csv file that I would like to remove duplicate lines based on field 1 and sort. I don't care about any of the other fields but I still wanna keep there data intact. I was thinking I could do something like this but I have no idea how to print the full line with this. Please show any method... (8 Replies)
Hi,
I have a csv file which contains some millions of lines in it.
The first line(Header) repeats at every 50000th line. I want to remove all the duplicate headers from the second occurance(should not remove the first line).
I don't want to use any pattern from the Header as I have some... (7 Replies)
Discussion started by: sudhakar T
7 Replies
LEARN ABOUT CENTOS
info
INFO(1) User Commands INFO(1)NAME
info - read Info documents
SYNOPSIS
info [OPTION]... [MENU-ITEM...]
DESCRIPTION
Read documentation in Info format.
OPTIONS -k, --apropos=STRING
look up STRING in all indices of all manuals.
-d, --directory=DIR
add DIR to INFOPATH.
--dribble=FILENAME
remember user keystrokes in FILENAME.
-f, --file=FILENAME
specify Info file to visit.
-h, --help
display this help and exit.
--index-search=STRING
go to node pointed by index entry STRING.
-n, --node=NODENAME
specify nodes in first visited Info file.
-o, --output=FILENAME
output selected nodes to FILENAME.
-R, --raw-escapes
output "raw" ANSI escapes (default).
--no-raw-escapes
output escapes as literal text.
--restore=FILENAME
read initial keystrokes from FILENAME.
-O, --show-options, --usage
go to command-line options node.
--strict-node-location
(for debugging) use Info file pointers as-is.
--subnodes
recursively output menu items.
--vi-keys
use vi-like and less-like key bindings.
--version
display version information and exit.
-w, --where, --location
print physical location of Info file.
The first non-option argument, if present, is the menu entry to start from; it is searched for in all `dir' files along INFOPATH. If it is
not present, info merges all `dir' files and shows the result. Any remaining arguments are treated as the names of menu items relative to
the initial node visited.
For a summary of key bindings, type h within Info.
EXAMPLES
info show top-level dir menu
info info
show the general manual for Info readers
info info-stnd
show the manual specific to this Info program
info emacs
start at emacs node from top-level dir
info emacs buffers
start at buffers node within emacs manual
info --show-options emacs
start at node with emacs' command line options
info --subnodes -o out.txt emacs
dump entire manual to out.txt
info -f ./foo.info
show file ./foo.info, not searching dir
REPORTING BUGS
Email bug reports to bug-texinfo@gnu.org, general questions and discussion to help-texinfo@gnu.org.
Texinfo home page: http://www.gnu.org/software/texinfo/
COPYRIGHT
Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
SEE ALSO
The full documentation for info is maintained as a Texinfo manual. If the info program is properly installed at your site, the command
info info
should give you access to the complete manual. (Or, if you have Emacs, M-x info will lead to the manual.)
info 5.1 June 2014 INFO(1)