Sponsored Content
Special Forums Windows & DOS: Issues & Discussions Remove duplicate lines from text files. Post 302910963 by rbatte1 on Tuesday 29th of July 2014 09:31:36 AM
Old 07-29-2014
Well in unix-land:-
Code:
grep -vf fail.txt colours.txt   > output.txt
grep -vf colours.txt fail.txt  >> output.txt

I think that you can get a grep for DOS by searching on-line. Maybe Windows Grep: Grep for Windows will suit, but use your favourite search engine with the keywords DOS & GREP.


Robin
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to remove duplicate lines

I have following file content (3 fields each line): 23 888 10.0.0.1 dfh 787 10.0.0.2 dssf dgfas 10.0.0.3 dsgas dg 10.0.0.4 df dasa 10.0.0.5 df dag 10.0.0.5 dfd dfdas 10.0.0.5 dfd dfd 10.0.0.6 daf nfd 10.0.0.6 ... as can be seen, that the third field is ip address and sorted. but... (3 Replies)
Discussion started by: fredao
3 Replies

2. Shell Programming and Scripting

remove all duplicate lines from all files in one folder

Hi, is it possible to remove all duplicate lines from all txt files in a specific folder? This is too hard for me maybe someone could help. lets say we have an amount of textfiles 1 or 2 or 3 or... maximum 50 each textfile has lines with text. I want all lines of all textfiles... (8 Replies)
Discussion started by: lowmaster
8 Replies

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

4. Shell Programming and Scripting

perl/shell need help to remove duplicate lines from files

Dear All, I have multiple files having number of records, consist of more than 10 columns some column values are duplicate and i want to remove these duplicate values from these files. Duplicate values may come in different files.... all files laying in single directory.. Need help to... (3 Replies)
Discussion started by: arvindng
3 Replies

5. Shell Programming and Scripting

Remove duplicate lines

Hi, I have a huge file which is about 50GB. There are many lines. The file format likes 21 rs885550 0 9887804 C C T C C C C C C C 21 rs210498 0 9928860 0 0 C C 0 0 0 0 0 0 21 rs303304 0 9941889 A A A A A A A A A A 22 rs303304 0 9941890 0 A A A A A A A A A The question is that there are a few... (4 Replies)
Discussion started by: zhshqzyc
4 Replies

6. Shell Programming and Scripting

[uniq + awk?] How to remove duplicate blocks of lines in files?

Hello again, I am wanting to remove all duplicate blocks of XML code in a file. This is an example: input: <string-array name="threeItems"> <item>item1</item> <item>item2</item> <item>item3</item> </string-array> <string-array name="twoItems"> <item>item1</item> <item>item2</item>... (19 Replies)
Discussion started by: raidzero
19 Replies

7. Shell Programming and Scripting

How do I remove the duplicate lines in this file?

Hey guys, need some help to fix this script. I am trying to remove all the duplicate lines in this file. I wrote the following script, but does not work. What is the problem? The output file should only contain five lines: Later! (5 Replies)
Discussion started by: Ernst
5 Replies

8. UNIX for Dummies Questions & Answers

Remove Duplicate Lines

Hi I need this output. Thanks. Input: TAZ YET FOO FOO VAK TAZ BAR Output: YET VAK BAR (10 Replies)
Discussion started by: tara123
10 Replies

9. Shell Programming and Scripting

Remove duplicate lines from a file

Hi, I have a csv file which contains some millions of lines in it. The first line(Header) repeats at every 50000th line. I want to remove all the duplicate headers from the second occurance(should not remove the first line). I don't want to use any pattern from the Header as I have some... (7 Replies)
Discussion started by: sudhakar T
7 Replies

10. Shell Programming and Scripting

How to remove duplicate lines?

Hi All, I am storing the result in the variable result_text using the below code. result_text=$(printf "$result_text\t\n$name") The result_text is having the below text. Which is having duplicate lines. file and time for the interval 03:30 - 03:45 file and time for the interval 03:30 - 03:45 ... (4 Replies)
Discussion started by: nalu
4 Replies
selinux_raw_context_to_color(3) 			     Library Functions Manual				   selinux_raw_context_to_color(3)

NAME
selinux_raw_context_to_color - Return RGB color string for an SELinux security context. SYNOPSIS
#include <selinux/selinux.h> int selinux_raw_context_to_color(security_context_t raw, char **color_str); DESCRIPTION
selinux_raw_context_to_color returns a color_str associated to the raw context raw provided that the mcstransd(8) daemon is running, the policy is an MLS type policy (MCS or MLS) and there is a color configuration file secolor.conf(5) (see the FILES section). The color_str string is a space separated list of eight hexadecimal RGB triples, each prefixed by a hash character (#). These represent the user:role:type:range components of the foreground and background colors. An example string is shown in the EXAMPLE section. The returned color_str string must be freed with free(3). If a color has not been configured for a specific user, role, type and/or range component of context raw, then selinux_raw_context_to_color will select the color returned in color_str in order of precedence as follows: role, type, range user, type, range user, role, range user, role, type If there are no entries in the secolor.conf file for any of the components of context raw (or the file is not present), then the default string returned in color_str is: ----- user ---- ---- role ---- ---- type ---- ---- range ---- #000000 #ffffff #000000 #ffffff #000000 #ffffff #000000 #ffffff RETURN VALUE
On success, zero is returned. On failure, -1 is returned with errno set appropriately. ERRORS
ENOENT If the mcstransd(8) daemon is not running. FILES
selinux_raw_context_to_color obtains the translated entry from the active policy secolor.conf(5) file as returned by selinux_col- ors_path(3). The file format is described in secolor.conf(5). NOTES
1. The primary use of selinux_raw_context_to_color is to return a color that corresponds to a range, that can then be used to highlight information at different MLS levels. 2. The mcstransd(8) daemon process security level must dominate the raw security level passed to it by the selinux_raw_context_to_color function. If not, the range color selected will be as defined by the order of precedence. EXAMPLE
selinux_raw_context_to_color returns the foreground and background colors of the context string components (user:role:type:range) as RGB triples as follows: user : role : type : range fg bg : fg bg : fg bg : fg bg #000000 #ffffff #ffffff #000000 #d2b48c #ffa500 #000000 #008000 black white : white black : tan orange : black green SEE ALSO
selinux(8), selinux_colors_path(3), mcstransd(8), secolor.conf(5), selinux_raw_to_trans_context(3), selinux_trans_to_raw_context(3), free(3) SELinux API documentation 08 April 2011 selinux_raw_context_to_color(3)
All times are GMT -4. The time now is 02:10 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy