Delete lines in file containing duplicate strings, keeping longer strings Post: 302556116

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep and delete lines except the lines with strings

Hi I am writing a script which should read a file and search for certain strings 'approved' or 'removed' and retain only those lines that contain the above strings. Ex: file name 'test' test: approved package waiting for approval package disapproved package removed package approved...

2. UNIX for Dummies Questions & Answers

Delete lines with duplicate strings based on date

Hey all, a relative bash/script newbie trying solve a problem. I've got a text file with lots of lines that I've been able to clean up and format with awk/sed/cut, but now I'd like to remove the lines with duplicate usernames based on time stamp. Here's what the data looks like 2007-11-03...

3. UNIX for Dummies Questions & Answers

Delete strings in file1 based on the list of strings in file2

Hello guys, should be a very easy questn for you: I need to delete strings in file1 based on the list of strings in file2. like file2: word1_word2_ word3_word5_ word3_word4_ word6_word7_ file1: word1_word2_otherwords..,word3_word5_others...

4. Shell Programming and Scripting

Delete lines starting with these strings

Platform : RHEL 5.8 I have text file called myapplication.log . In this file, I have around 800 lines which start with the followng three strings PWRBRKER-3493 PWRBRKER-7834 SCHEDULER-ERROR How can I delete these lines in one go ?

5. Shell Programming and Scripting

Getting lines between two strings with duplicate set of data

if I have the following lines in a file app.log some lines here <AAAA> abc <id>123456789</id> ddd </AAAA>some lines here too <BBBB> abc <id>123456789</id> ddd </BBBB>some lines here too <AAAA> xyz <id>987654321</id> ssss </AAAA>some lines here again... How do I get the...

6. Shell Programming and Scripting

Delete duplicate strings in a line

Hi, i need help to remove duplicates in my file. The problem is i need to delete one duplicate for each line only. the input file as follows and it is not tab delimited:- The output need to remove 2nd word (in red) that duplicate with 1st word (in blue). Other duplicates should remained...

7. UNIX for Dummies Questions & Answers

Replace some strings keeping others

I want to replace strings in test2 according to test1 table. In doing so, I`m losing records that I dont need to replace, please suggest modifications. what i have $ cat > test1 a b c d 　 $ cat > test2 a a a d d 　 what i tried $ awk ' BEGIN {FS=OFS=" "} FNR==NR{a=$2;next}...

8. Shell Programming and Scripting

Remove lines containing 2 or more duplicate strings

Within my text file i have several thousand lines of text with some lines containing duplicate strings/words. I would like to entirely remove those lines which contain the duplicate strings. Eg; One and a Two Unix.com is the Best This as a Line Line Example duplicate sentence with the word...

9. UNIX for Beginners Questions & Answers

How to pass strings from a list of strings from another file and create multiple files?

Hello Everyone , Iam a newbie to shell programming and iam reaching out if anyone can help in this :- I have two files 1) Insert.txt 2) partition_list.txt insert.txt looks like this :- insert into emp1 partition (partition_name) (a1, b2, c4, s6, d8) select a1, b2, c4,

10. UNIX for Beginners Questions & Answers

Use strings from nth field from one file to match strings in entire line in another file, awk

I cannot seem to get what should be a simple awk one-liner to work correctly and cannot figure out why. I would like to use patterns from a specific field in one file as regex to search for matching strings in the entire line ($0) of another file. I would like to output the lines of File2 which...

LEARN ABOUT CENTOS

sgpio

sgpio(1)							   USER COMMANDS							  sgpio(1)

NAME

       sgpio - captive backplane LED control utility

SYNOPSIS

       sgpio [-h] [-V] [[-d|--disk <device>[,<device>...]] | [-p|--port <port>[,<port>...]]] [-s|--status <status>] [-f|--freq <frequency>]

DESCRIPTION

       Serial General Purpose Input Output (SGPIO) is a communication method used between a main board and a variety of internal and external hard
       disk drive bay enclosures.  This utility can be used to control LEDs in an enclosure.  For more information about SGPIO, please consult the
       SFF-8485 Specification.

OPTIONS

       -h, --help
	      displays a short help text

       -V, --version
	      displays the utility and AHCI SGPIO specification

       -d, --disk
	      disk name of LED location.  Names are sda,sdb,sdc,... Multiple names can be provided in a comma-delimited list.

       -p, --port
	      SATA  port  number  of  LED location, can be used if a disk name is no longer valid. 0,1,2,3,... Multiple ports can be provided in a
	      comma-delimited list.

       -s, --status
	      status of the LED to set.  LED status is: locate, fault, rebuild, off

       -f, --freq
	      Set the frequency at which the LED should blink (in Hz). Frequency should be an integer between 1 and 10.

EXAMPLES

       Set the locate LED on SDA with an Intel Intelligent backplane:
	      sgpio -d sda -s locate

       Set the locate LED on SDA to flash at 3 Hz for non-intelligent backplanes:
	      sgpio -d sda -s locate -f 3

       Set SATA port 2 with fault at a 3 Hz flash rate:
	      sgpio -p 2 -s fault -f 3

       Set disks sda through sdf to fault:
	      sgpio -d sda,sdb,sdc,sdd,sde,sdf -s fault

EXIT STATUS

       sgpio should return zero when successful.  It will return with a non-zero value if there was a failure.

AUTHOR

       Eric R. Hall <Eric.R.Hall@intel.com>

version 0.3							   December 2007							  sgpio(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Grep and delete lines except the lines with strings

Discussion started by: vj8436

2. UNIX for Dummies Questions & Answers

Delete lines with duplicate strings based on date

Discussion started by: mattv

3. UNIX for Dummies Questions & Answers

Delete strings in file1 based on the list of strings in file2

Discussion started by: roussine

4. Shell Programming and Scripting

Delete lines starting with these strings

Discussion started by: omega3