10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I have a csv file which contains some millions of lines in it.
The first line(Header) repeats at every 50000th line. I want to remove all the duplicate headers from the second occurance(should not remove the first line).
I don't want to use any pattern from the Header as I have some... (7 Replies)
Discussion started by: sudhakar T
7 Replies
2. UNIX for Dummies Questions & Answers
I have a file with following data
A
B
C
I would like to print like this n times(For eg:5 times)
A
B
C
A
B
C
A
B
C
A
B
C
A (7 Replies)
Discussion started by: nsuresh316
7 Replies
3. Shell Programming and Scripting
hello all
in my bash script I have a file and I only want to keep the lines that appear twice in the file.Is there a way to do this?
thanks in advance! (4 Replies)
Discussion started by: vlm
4 Replies
4. UNIX for Advanced & Expert Users
Hi,
I copied the contents of a binary file into a .text file using hd (hexdump) command. The data in binary file is such that I get in many places like following
00000250 00 00 00 00 3f 2d 91 68 3f 69 fb e7 00 00 00 00 |....?-.h?i......|
00000260 00 00 00 00 00 00 00 00 00 00 00 00 00... (2 Replies)
Discussion started by: KidD312
2 Replies
5. Shell Programming and Scripting
Hey guys, need some help to fix this script. I am trying to remove all the duplicate lines in this file.
I wrote the following script, but does not work. What is the problem?
The output file should only contain five lines:
Later! (5 Replies)
Discussion started by: Ernst
5 Replies
6. UNIX for Advanced & Expert Users
Hi All,
I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space.
I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Discussion started by: krishnix
16 Replies
7. UNIX for Dummies Questions & Answers
I have a log file "logreport" that contains several lines as seen below:
04:20:00 /usr/lib/snmp/snmpdx: Agent snmpd appeared dead but responded to ping
06:38:08 /usr/lib/snmp/snmpdx: Agent snmpd appeared dead but responded to ping
07:11:05 /usr/lib/snmp/snmpdx: Agent snmpd appeared dead but... (18 Replies)
Discussion started by: Nysif Steve
18 Replies
8. UNIX for Dummies Questions & Answers
Hi,
I am having a file which contains many duplicate lines. I wanted to redirect these duplicate lines into another file.
Suppose I have a file called file_dup.txt which contains some line as
file_dup.txt
A100-R1
ACCOUNTING-CONTROL
ACTONA-ACTASTOR
ADMIN-AUTH-STATS
ACTONA-ACTASTOR... (3 Replies)
Discussion started by: zing_foru
3 Replies
9. UNIX for Advanced & Expert Users
Hi,
I have a file with duplicate lines in it. I want to keep only the duplicate lines and delete the non duplicates. Can some one please help me?
Regards
Narayana Gupta (3 Replies)
Discussion started by: guptan
3 Replies
10. Shell Programming and Scripting
I am doing KSH script to remove duplicate lines in a file. Let say the file has format below.
FileA
1253-6856
3101-4011
1827-1356
1822-1157
1822-1157
1000-1410
1000-1410
1822-1231
1822-1231
3101-4011
1822-1157
1822-1231
and I want to simply it with no duplicate line as file... (5 Replies)
Discussion started by: Teh Tiack Ein
5 Replies
RIG(6) Games Manual RIG(6)
NAME
RIG - Random Identity Generator
USAGE
rig [ -f | -m ] [ -d datadir ] [ -c num ]
DESCRIPTION
Rig is a utility that will piece together a random first name, last name, street number and address, along with a geographically consistant
(ie, they all match the same area) city, state, ZIP code, and area code.
It is suitable for such applications as feeding the NY times registration page to fend off junk (snail) mail and telemarketers, or for reg-
istering on BBS's to which you don't wish to reveal your real information.
OPTIONS
-f, -m Respectively, use female and male names. If neither or both options are selected, RIG uses both female and male names.
-d datadir
Use data files found in datadir. Without this option, the default directory of /usr/share/rig is assumed.
-c num Output num identities. Default is 1.
FILES
/usr/share/rig/locdata.idx
/usr/share/rig/street.idx
/usr/share/rig/fnames.idx
/usr/share/rig/mnames.idx
/usr/share/rig/lnames.idx
HISTORY
Based on "fake" written for MS-DOS. Unfortunately the author and publish date are unknown.
First UNIX version written from scratch in 1999.
This manpage based on RIG version 1.10.
AUTHORS
UNIX version (c) 1999-2002 Ian Turner with contributions from Ian Prowell, Nick Rusnov, and Schneelocke. Geography Database is from the
original version and I believe it to be held in the public domain. Names database is from the US Census at
http://www.census.gov/genealogy/names/ , courtesy of Trent Stanley.
Send all comments and bug-reports to:
vectro@RIG.sourceforge.net
4 JUN 2002 RIG(6)
