Sponsored Content
Top Forums UNIX for Dummies Questions & Answers searching text files on specific columns for duplicates Post 81248 by jim mcnamara on Wednesday 17th of August 2005 03:10:21 PM
Old 08-17-2005
input file = filename
Code:
G405H SURG FERGUSON SG00308258 01/16/52 GGHB
G405H ORTHO FERGUSON SG00308258 05/21/23 A&C
G405H ENT HOUGHTON SG03102407 04/22/70 GGHB
G405H ENT HOUGHTON SG00308258 10/08/60 GGHB
G405H GYN TAGGART SG03132070 05/15/53 GGHB

output
Code:
 
G405H ENT HOUGHTON SG00308258 10/08/60 GGHB
G405H SURG FERGUSON SG00308258 01/16/52 GGHB

Code:
 
sort  -k 4.1,4.10 -k 6.1,6.4 filename |
awk ' {
    if (arr[ $4 $6 ])
    {print arr[ $4 $6 ];print $0}    
    else { arr [$4 $6 ]	= $0 }
    }' filename | sort -u


Last edited by jim mcnamara; 08-17-2005 at 06:45 PM..
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replacing text on specific columns

Hi , i have one file like : APP101A APP103B MSG307A MSG308B XADM002A and so on , and i expect to replace the last character A by B and B by A the result would be : APP101B APP103A MSG307B MSG308A XADM002B how can i do that ? (3 Replies)
Discussion started by: Nicol
3 Replies

2. Shell Programming and Scripting

Replacing text on specific columns 2nd

Hi , I'm so surprised to see my thread closed ! i come here many times and work with some great guys like Perderabo , each time i search for many solutions to write some scripts for my job , at this time i don't see how i can solve this one , so please don't take me as a pupil ! i can test... (16 Replies)
Discussion started by: Nicol
16 Replies

3. UNIX for Advanced & Expert Users

How to perform Grep on many Gzip files, Searching for Specific information

Hello, I am wondering if you can assist with my question and ask kindly for this. I have a number of files that are listed as file1.gz through file100.gz. I am trying to perform a grep on the files and find a specific date that only resides within within one of the files. There are... (3 Replies)
Discussion started by: legharb
3 Replies

4. Shell Programming and Scripting

remove white space from specific columns in text file

Hello i have a text file like this: 1 AB AC AD EE 2 WE TR YT WW 3 AS UY RF YT the file is bigger , but that's an example of the data what i want to do is to merge all columns together except the first one, it will become like this : 1 ABACADEE 2 WETRYTWW 3 ASUYRFYT (8 Replies)
Discussion started by: shelladdict
8 Replies

5. Shell Programming and Scripting

Searching for files with specific extensions

Hi, Could someone give me a hand with a search for files with two possible extensions, please. The requirement is simple - I need to issue a single ls command searching for files with the suffix of, say, *.txt and *.log. I've tried to use ls *.txt *.log which works if there are both... (4 Replies)
Discussion started by: neilmw
4 Replies

6. UNIX for Dummies Questions & Answers

How do you view specific columns from a space delimited text file?

I have a space delimited text file with 1,000,000+ columns? I would only like to view specific ones (let's say through 1:10), how can I do that? Thanks! (3 Replies)
Discussion started by: evelibertine
3 Replies

7. Red Hat

Moving of file content to another two files after searching with specific pattern

Hello, Please help me with this!! Thanks in advance!! I have a file named file.gc with the content: 1-- Mon Sep 10 08:53:09 CDT 2012 2revoke connect from FR2261; 3delete from mkt_allow where grantee = 'FR2261'; 4grant connect to FR2261 with '******'; 5alter user FR2261 comment... (0 Replies)
Discussion started by: raosr020
0 Replies

8. Shell Programming and Scripting

Add specific text to columns in file by sed

What is the proper syntax to add specific text to a column in a file? Both the input and output below are tab-delineated. What if there are multiple text/fields, such as /CP&/2 /CM&/3 /AA&/4 Thank you :). sed 's/*/Index&/1' del.txt.hg19_multianno.txt > matrix.del.txt (4 Replies)
Discussion started by: cmccabe
4 Replies

9. UNIX for Beginners Questions & Answers

Searching the value of a specific attribute among xmls files from a particular directory location

Hi Folks , I have the different xml files at the following directory `/opt/app/rty/servers/tr/current/ops/config` Let's say there are three files named abc.xml bv.xml ert.xml Now inside these xml there can be many tags as like shown below <bean id="sdrt"... (6 Replies)
Discussion started by: unclesamm
6 Replies
SECURENET(8)						      System Manager's Manual						      SECURENET(8)

NAME
securenet - Digital Pathways SecureNet Key remote authentication box DESCRIPTION
The SecureNet box is used to authenticate connections to Plan 9 from a foreign system such as a Unix machine or plain terminal. The box, which looks like a calculator, performs DES encryption with a key held in its memory. Another copy of the key is kept on the authentica- tion server. Each box is protected from unauthorized use by a four digit PIN. When the system requires SecureNet authentication, it prompts with a numerical challenge. The response is compared to one generated with the key stored on the authentication server. Respond as follows: Turn on the box and enter your PIN at the EP prompt, followed by the ENT button. Enter the challenge at Ed prompt, again followed ENT. Then type to Plan 9 the response generated by the box. If you make a mistake at any time, reset the box by pressing ON. The authentica- tion server compares the response generated by the box to one computed internally. If they match, the user is accepted. The box will lose its memory if given the wrong PIN five times in succession or if its batteries are removed. To reprogram it, type a 4 at the E0 prompt. At the E1 prompt, enter your key, which consists of eight three-digit octal numbers. While you are entering these digits, the box displays a number ranging from 1 to 8 on the left side of the display. This number corresponds to the octal number you are entering, and changes when you enter the first digit of the next number. When you are done entering your key, press ENT twice. At the E2 prompt, enter a PIN for the box. After you confirm by retyping the PIN at the E3 prompt, you can use the box as normal. You can change the PIN using the following procedure. First, turn on the box and enter your current PIN at the EP prompt. Press ENT three times; this will return you to the EP prompt. Enter your PIN again, followed by ENT; you should see a Ed prompt with a - on the right side of the display. Enter a 0 and press ENT. You should see the E2 prompt; follow the instructions above for entering a PIN. The SecureNet box performs the same encryption as the netcrypt routine (see encrypt(2)). The entered challenge, a decimal number between 0 and 100000, is treated as a text string with trailing binary zero fill to 8 bytes. These 8 bytes are encrypted with the DES algorithm. The first four bytes are printed on the display as hexadecimal numbers. However, when set up as described, the box does not print hexadec- imal digits greater than 9. Instead, it prints a 2 for an A, B, or C, and a 3 for a D, E, or F. If a 5 rather than a 4 is entered at the E0 print, the hexadecimal digits are printed. This is not recommended, as letters are too easily confused with digits on the SecureNet display. SEE ALSO
encrypt(2), auth(2) Digital Pathways, Mountain View, California BUGS
The box is too clumsy. If carried in a pocket, it can turn itself on and wear out the batteries. SECURENET(8)
All times are GMT -4. The time now is 12:56 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy