I got a list of IP address from which I would like to remove the duplicates. I cat the file and pipe it to uniq -u or uniq -c, I got the same output with all the duplicates. Can anybody please tell me how I can remove the duplicates IPs from this file? This is what I used.
Thanks,
Last edited by Franklin52; 04-12-2011 at 03:38 AM..
Reason: Please use code tags
Hello,
Here is my problem. there are two files.
first.txt <<< contains email address
======
abc@mail.com
abd@mail.com
abe@mail.com
second.txt <<< contains webpage links
========
http//www.test.com/abc/index.html
http://www.test.com/abd/index.html
http://www.test.com/abe/index.html... (2 Replies)
Wrote a script to create a hidden account in OS X. It works perfect but I need to check if the UID is already in use before I tried to create the account.
dscl . list /Users UniqueID | awk '{print $2}' | while read UIDS
do
if ; then
echo "UID Is Already in USE"
i=`expr "$2" - 1`
echo... (4 Replies)
I have a question
I have like 19 different list which contains the name of the server but what I need is just unique ones.
First thing I need to do is just make a unique list within the list itself
i.e. delete anything that is repeated inside the list
like for example
in list1
i... (1 Reply)
Trying to do a ksh script that needs to list all ip address between ip address a and b ..
ie.
Ip address A=192.168.1.200
Ip address B=192.168.2.15
So the subnet changes from 1 to 2 but I want to list all possible ip addresses between the 2..
Which would be:
192.168.1.200... (4 Replies)
Hi,
I am going to fetch a list of numbers that starts with "0032" from a file with a format like the given below:
"
0032459999 0032458888 0032457777
0032451111 0032452222 0032453333
0032459999 0032458888 0032457777
0032451111 0032452222 0032453333
"
I want to get a unique... (6 Replies)
Hi
How can i find the unique list of file extensions in a folder/subfolders
e.g.
MAIN/
a.txt
b.txt
a.clas
a.java
b.class
a.txt.112
c.12.ram.jar
i just need to get the below out irrespective of file being present in folder or subfolders
txt
clas
java (5 Replies)
I have a large directory of web pages. I am doing a search through the web pages using grep and would like to get a list of unique file names of search results. The following command works fine to give me a list of file names where term appears:
grep -l term *.html
However, since these are... (3 Replies)
Hi,
I want to generate 2000 mac address. Please let me know how to do so.
Perl script or there is some tool availlable wherein i can give the count and it will generate that many mac-address
Thanks,
Kriti (4 Replies)
I need a script that will search through multiple files and when the first 2 columns match, print out Columns 1 and 2 and the minimum value.
File 1
24.01 -81.01 1.0
24.02 -81.02 1.0
24.03 -81.03 3.0
File 2
24.01 -81.01 5.0
24.02 -81.02 3.0
24.03 -81.03 ... (3 Replies)
Hi All,
Does anyone have any suggestions/examples of how i could show only lines where the first field is not duplicated. If the first field is listed more than once it shouldnt be shown even if the other columns make it unique.
Example file :
876,RIBDA,EC2
876,RIBDH,EX7
877,RIBDF,E28... (4 Replies)
Discussion started by: mutley2202
4 Replies
LEARN ABOUT REDHAT
uniq
UNIQ(1) FSF UNIQ(1)NAME
uniq - remove duplicate lines from a sorted file
SYNOPSIS
uniq [OPTION]... [INPUT [OUTPUT]]
DESCRIPTION
Discard all but one of successive identical lines from INPUT (or standard input), writing to OUTPUT (or standard output).
Mandatory arguments to long options are mandatory for short options too.
-c, --count
prefix lines by the number of occurrences
-d, --repeated
only print duplicate lines
-D, --all-repeated[=delimit-method] print all duplicate lines
delimit-method={none(default),prepend,separate} Delimiting is done with blank lines.
-f, --skip-fields=N
avoid comparing the first N fields
-i, --ignore-case
ignore differences in case when comparing
-s, --skip-chars=N
avoid comparing the first N characters
-u, --unique
only print unique lines
-w, --check-chars=N
compare no more than N characters in lines
--help display this help and exit
--version
output version information and exit
A field is a run of whitespace, then non-whitespace characters. Fields are skipped before chars.
AUTHOR
Written by Richard Stallman and David MacKenzie.
REPORTING BUGS
Report bugs to <bug-coreutils@gnu.org>.
COPYRIGHT
Copyright (C) 2002 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICU-
LAR PURPOSE.
SEE ALSO
The full documentation for uniq is maintained as a Texinfo manual. If the info and uniq programs are properly installed at your site, the
command
info uniq
should give you access to the complete manual.
uniq (coreutils) 4.5.3 February 2003 UNIQ(1)