Sponsored Content
Top Forums Shell Programming and Scripting Delete repeated word in text file Post 302301148 by Whiteboard on Thursday 26th of March 2009 04:00:58 AM
Old 03-26-2009
Quote:
Originally Posted by vincyoxy
Whiteboard ans is worked.
But I duno why Yogesh ans cant worked.
anyway, Thks for ur help =)
Its working fine for me...
Code:
$ cat file
BLUE
YELLOW
RED
VIOLET
RED
RED
BLUE
WHITE
YELLOW
BLACK
 
$ awk '!x[$0]++' file
BLUE
YELLOW
RED
VIOLET
WHITE
BLACK

Are you getting any errors??? post your output
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Can a shell script pull the first word (or nth word) off each line of a text file?

Greetings. I am struggling with a shell script to make my life simpler, with a number of practical ways in which it could be used. I want to take a standard text file, and pull the 'n'th word from each line such as the first word from a text file. I'm struggling to see how each line can be... (5 Replies)
Discussion started by: tricky
5 Replies

2. UNIX for Dummies Questions & Answers

how to find a word repeated in a file

Hi everyone, I have a file in which a word is repeated more than one time and I want to know how many times it is repeated. ex: if i repeated word 'guru' in 10 lines I can get the o/p as: cat filename | grep -c 'guru'. How ever if the word is repeated more than one time, then how can I... (4 Replies)
Discussion started by: gurukottur
4 Replies

3. Shell Programming and Scripting

Delete repeated rows from a file

Hi everybody: Could anybody tell me how I can delete repeated rows from a file?, this is, for exemple I have a file like this: 0.490 958.73 281.85 6.67985 0.002481 0.490 954.833 283.991 8.73019 0.002471 0.590 950.504 286.241 6.61451 0.002461 0.690 939.323 286.112 6.16451 0.00246 0.790... (8 Replies)
Discussion started by: tonet
8 Replies

4. Shell Programming and Scripting

How to delete a word from a file?

Hi All, I want to delete a word from file. How to do that. I have file that contains the following Information. EntityName:alba00r1.mis.amat.com OverallStatus:Minor IfName:Gi1/0 EntityName:alba00r1.mis.amat.com ] OverallStatus:Normal IfName:Se0/0/0... (4 Replies)
Discussion started by: ntgobinath
4 Replies

5. UNIX for Dummies Questions & Answers

Delete repeated nos in a file

Hi, I need to delete repeated nos in a file and finally list the count. Can some one assist me? file: 12345 12345 56345 12345 23896 Output needed: 12345 56345 23896 Total count:3 Thanks (2 Replies)
Discussion started by: gini
2 Replies

6. Shell Programming and Scripting

Extract multiple repeated data from a text file

Hi, I need to extract data from a text file in which data has a pattern. I need to extract all repeated pattern and then save it to different files. example: input is: ST*867*000352214 BPT*00*1000352214*090311 SE*1*1 ST*867*000352215 BPT*00*1000352214*090311 SE*1*2 ... (5 Replies)
Discussion started by: apjneeraj
5 Replies

7. Shell Programming and Scripting

Delete everything after/before a word in a file

I'm looking for a command that will read a file listing information and delete everything after a certain word is found. I also may need to search the file and delete everything before a certain word. The file would contains fields of information like below repeating for the entire file; Name... (5 Replies)
Discussion started by: daveisme
5 Replies

8. Shell Programming and Scripting

How to delete the last word in a file?

Hi All, I have a file with the data as below. In this i want to delete the last word. Could you pls help me. $INSTALL_HOME/lib/fm_voucher_pol.so $INSTALL_HOME/source/sys/fm_apn_pol/fm_apn_pol_device_set_state.c In the above two lines i want to delete fm_voucher_pol.so and... (5 Replies)
Discussion started by: girish.raos
5 Replies

9. Shell Programming and Scripting

How to find repeated string in a text file

I have a text file where I need to find the string = ST*850* This string is repetaed several times in the file, so I need to know how many times it appears in the file, this is the text files: ISA*00* *00* *08*925485USNR *ZZ*IMSALADDERSP... (13 Replies)
Discussion started by: cucosss
13 Replies

10. Shell Programming and Scripting

Find repeated word and take sum of the second field to it ,for all the repeated words in awk

Hi below is the input file, i need to find repeated words and sum up the values of it which is second field from the repeated work.Im trying but getting no where close to it.Kindly give me a hint on how to go about it Input fruits,apple,20,fruits,mango,20,veg,carrot,12,veg,raddish,30... (11 Replies)
Discussion started by: 100bees
11 Replies
DHEXRC(5)						      BSD File Formats Manual							 DHEXRC(5)

NAME
dhexrc -- Configuration File for dhex DESCRIPTION
dhexrc is the configuration file that specifies the colorscheme and the key translation tab for dhex(1), Upon starting the program, it is being read and parsed. It is being written and/or created after invoking the keyboard setup. EXAMPLE A typical .dhexrc file looks like this: '#DHEXCOLORSCHEME' '#VERSION 0' '#possible colors are: BLACK,RED,GREEN,YELLOW,BLUE,MAGENTA,CYAN,WHITE' '#possible extra flags are: UNDERLINE,REVERSE,BLINK,DIM,BOLD' 'BRACKETS: FG=BLACK,BG=BLACK,BOLD' 'HEXFIELD: FG=WHITE,BG=BLACK' 'INPUT: FG=BLACK,BG=WHITE' 'CURSOR: FG=WHITE,BG=BLACK' 'TEXT: FG=WHITE,BG=BLACK,BOLD' 'MENU_NORMAL: FG=CYAN,BG=BLACK' 'MENU_HIGHLIGHT: FG=BLACK,BG=CYAN' 'MENU_HOTKEY: FG=YELLOW,BG=BLACK,BOLD' 'MENU_HOTKEY_HI: FG=YELLOW,BG=CYAN,BOLD' 'FRAME: FG=BLUE,BG=BLACK,BOLD' 'NORMAL_DIFF: FG=YELLOW,BG=BLACK' 'CURSOR_DIFF: FG=YELLOW,BG=WHITE,BOLD' 'HEADLINE: FG=BLUE,BG=BLACK,BOLD' 'HEADER: FG=BLACK,BG=CYAN' 'KEYF1:1b 5b 31 31 7e' 'KEYF2:1b 5b 31 32 7e' 'KEYF3:1b 5b 31 33 7e' 'KEYF4:1b 5b 31 34 7e' 'KEYF5:1b 5b 31 35 7e' 'KEYF6:1b 5b 31 37 7e' 'KEYF7:1b 5b 31 38 7e' 'KEYF8:1b 5b 31 39 7e' 'KEYF9:1b 5b 32 30 7e' 'KEYF10:1b 5b 32 31 7e' 'KEYESC:1b' 'KEYBACKSPACE:08' 'KEYDEL:7f' 'KEYENTER:0a' 'KEYTAB:09' 'KEYUP:1b 5b 41' 'KEYDOWN:1b 5b 42' 'KEYRIGHT:1b 5b 43' 'KEYLEFT:1b 5b 44' 'KEYPGUP:1b 5b 35 7e' 'KEYPGDOWN:1b 5b 36 7e' 'KEYHOME:1b 5b 37 7e' 'KEYEND:1b 5b 38 7e' OPTIONS
In the example above, the dhexrc file has three distinct sections: A comment section, a color section and a key conversion tab section. Comments Comments are indicated with a '#' character. Everything afterwards in a line is being ignored when parsing the file Color section There are 14 color groups. Each of the color group has a foreground color, a background color and some extra flags, coming from ncurses. The foreground color is being defined by FG= while the background color is being defined by BG=. They and the extra flags are being separated by ','. Possible colors are BLACK, GREEN, RED, YELLOW, BROWN, BLUE, MAGENTA, WHITE, and exclusively as foreground colors LIGHTBLACK, LIGHTGREEN, LIGHTRED, LIGHTYELLOW, LIGHTBROWN, LIGHTBLUE, LIGHTMAGENTA and LIGHTWHITE. Valid extra flags are UNDERLINE, REVERSE, BLINK, DIM and BOLD. The color pairs are as followed: BRACKETS: This specifies the color for the brackets around text fields. HEXFIELD: This specifies the color in which the file's content is being shown. INPUT: When entering text, it is in this color. CURSOR: The cursor in the hex field has this color. TEXT: This color is for informative text as well as for text fields which are not taking input yet. MENU_NORMAL: Menu items which are not selected belong into this color group. MENU_HIGHLIGHT: The selected menu item gets this special color. MENU_HOTKEY: Hotkeys for menu items are visually distinct from the rest of the text because they have this color. MENU_HOTKEY_HI: If the actual menu item has a hotkey, it is shown in this color. FRAME: Some screens have frames. Those frames have this color. NORMAL_DIFF: Differences in the file's content (either because of changes or because dhex is running in diff mode) are indicated by this color. CURSOR_DIFF: If the cursor is on one of those differences, it will have this color. HEADLINE: On top of the screen, there is a headline. Which is shown in this color. HEADER: In the headline, there are brackets. Within those brackets is the header. It tells you what the window is all about. Key conversion tab section When pressing a "standard" key, something which can be mapped directly to an ascii character, only this character will end up in ncurses' buffer. However, pressing special keys like (for example) F1 or ALT+6 will produce longer sequences. Mapping those sequences back to a spe- cific key is the job of the key conversion tab. (I was dissatisfied how ncurses handled this on its own). The sequences are called (in order) KEYF1, KEYF2, KEYF3, KEYF4, KEYF5, KEYF6, KEYF7, KEYF8, KEYF9, KEYF10, KEYESC, KEYBACKSPACE, KEYDEL, KEYENTER, KEYTAB, KEYUP, KEYDOWN, KEYRIGHT, KEYLEFT, KEYPGUP, KEYPGDOWN, KEYHOME and KEYEND. Sequences itself are a string of lower case hex-values, each two nibbles long. Currently, there is no way of adding an alternative sequence to the same key. It is possible that the sequence made up of hex values does not REALLY belong to the key. (For example if F2 was pressed in the setup program when F1 was prompted). However, when this sequence ends up in the ncurses buffer, it is being interpreted as if that key was pressed. BUGS
Report bugs to <dettus@dettus.net>. Make sure to include DHEX somewhere in the subject. AUTHOR
Written by Thomas Dettbarn SEE ALSO
dhex(1), dhex_markers(5), dhex_searchlog(5) BSD
May 12, 2012 BSD
All times are GMT -4. The time now is 01:08 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy