Sponsored Content
Full Discussion: Remove duplicate phrase
Top Forums Shell Programming and Scripting Remove duplicate phrase Post 302092978 by anbu23 on Monday 16th of October 2006 05:16:42 PM
Old 10-16-2006
Code:
echo $val | 
awk ' 
{
   for(i=1;i<=NF;++i)  arr[$i]; 
   for(key in arr) printf("%s ",key)
}'

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicate

i have a text its contain many record, but its written in one line, i want to remove from that line the duplicate record, not record have fixed width ex: width = 4 inputfile test.txt =abc cdf abc abc cdf fgh fgh abc abc i want the outputfile =abc cdf fgh only those records can any one help... (4 Replies)
Discussion started by: kazanoova2
4 Replies

2. Shell Programming and Scripting

Remove duplicate ???

Hi all, I have a out.log file CARR|02/26/2006 10:58:30.107|CDxAcct=1405157051 CARR|02/26/2006 11:11:30.107|CDxAcct=1405157051 CARR|02/26/2006 11:18:30.107|CDxAcct=7659579782 CARR|02/26/2006 11:28:30.107|CDxAcct=9534922327 CARR|02/26/2006 11:38:30.107|CDxAcct=9534922327 CARR|02/26/2006... (3 Replies)
Discussion started by: sabercats
3 Replies

3. Shell Programming and Scripting

Remove duplicate

Hi all, I have a text file fileA.txt DXRV|02/28/2006 11:36:49.049|SAC||||CDxAcct=2420991350 DXRV|02/28/2006 11:37:06.404|SAC||||CDxAcct=6070970034 DXRV|02/28/2006 11:37:25.740|SAC||||CDxAcct=2420991350 DXRV|02/28/2006 11:38:32.633|SAC||||CDxAcct=6070970034 DXRV|02/28/2006... (2 Replies)
Discussion started by: sabercats
2 Replies

4. Shell Programming and Scripting

remove duplicate

Hi, I am tryung to use shell or perl to remove duplicate characters for example , if I have " I love google" it will become I love ggle" or even "I loveggle" if removing duplicate white space Thanks CC (6 Replies)
Discussion started by: ccp
6 Replies

5. Shell Programming and Scripting

Remove duplicate lines

Hi, I have a huge file which is about 50GB. There are many lines. The file format likes 21 rs885550 0 9887804 C C T C C C C C C C 21 rs210498 0 9928860 0 0 C C 0 0 0 0 0 0 21 rs303304 0 9941889 A A A A A A A A A A 22 rs303304 0 9941890 0 A A A A A A A A A The question is that there are a few... (4 Replies)
Discussion started by: zhshqzyc
4 Replies

6. Shell Programming and Scripting

How to remove duplicate ID's?

HI I have file contains 1000'f of duplicate id's with (upper and lower first character) as below i/p: a411532A411532a508661A508661c411532C411532 Requirement: But i need to ignore lowercase id's and need only below id's o/p: A411532 A508661 C411532 (9 Replies)
Discussion started by: buzzme
9 Replies

7. Shell Programming and Scripting

How to Remove duplicate value from file?

if different branch code is available for same BIC code and one of the branch code is XXX.only one row will be stored and with branch code as XXX .rest of the rows for the BIC code will not be stored. for example if $7 is BIC code and $8 is branch code INPUT file are following... (9 Replies)
Discussion started by: mohan sharma
9 Replies

8. Shell Programming and Scripting

Remove duplicate

Hi , I have a pipe seperated file repo.psv where i need to remove duplicates based on the 1st column only. Can anyone help with a Unix script ? Input: 15277105||Common Stick|ESHR||Common Stock|CYRO AB 15277105||Common Stick|ESHR||Common Stock|CYRO AB 16111278||Common Stick|ESHR||Common... (12 Replies)
Discussion started by: samrat dutta
12 Replies

9. UNIX for Dummies Questions & Answers

Remove duplicate

Hi, How can I replace || with space and then remove duplicate from following text? T111||T222||T444||T222||T555 Thanks in advance (10 Replies)
Discussion started by: tinku981
10 Replies

10. Shell Programming and Scripting

How to find a phrase and pull all lines that follow until the phrase occurs again?

I want to burst a report by using the page number value in the report header. Each section starts with *PAGE NO:* 1 Each section might have several pages, but the next section always starts back at 1. So I want to find the "*PAGE NO:* 1" value and pull all lines that follow until "*PAGE NO:* 1"... (4 Replies)
Discussion started by: Scottie1954
4 Replies
IP-NTABLE(8)							       Linux							      IP-NTABLE(8)

NAME
ip-ntable - neighbour table configuration SYNOPSIS
ip [ OPTIONS ] address { COMMAND | help } ip ntable change name NAME [ dev DEV ] PARMS PARMS := { thresh1 VAL | thresh2 VAL | thresh3 VAL | gc_int MSEC | base_reachable MSEC | retrans MSEC | gc_stale MSEC | delay_probe MSEC | queue LEN | app_probs VAL | ucast_probes VAL | mcast_probes VAL | anycast_delay MSEC | proxy_delay MSEC | proxy_queue LEN | locktime MSEC } ip ntable show [ dev DEV ] [ name NAME ] DESCRIPTION
ip ntable controls the parameters for the neighbour tables. ip ntable show - list the ip neighbour tables This commands displays neighbour table parameters and statistics. dev DEV only list the table attached to this device. name NAME only lists the table with the given name. ip ntable change - modify table parameter This command allows modifying table parameters such as timers and queue lengths. name NAME the name of the table to modify. dev DEV the name of the device to modify the table values. EXAMPLES
ip ntable show dev eth0 Shows the neighbour table (IPv4 ARP and IPv6 ndisc) parameters on device eth0. ip ntable change name arp_cache queue 8 dev eth0 Changes the number of packets queued while address is being resolved from the default value (3) to 8 packets. SEE ALSO
ip(8) AUTHOR
Manpage by Stephen Hemminger iproute2 20 Dec 2011 IP-NTABLE(8)
All times are GMT -4. The time now is 08:10 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy