Removing duplicated lines?? Post: 302599249

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicated lines without sort

Hi Just wondering whether or not I can remove duplicated lines without sort For example, I use the command who, which shows users who are logging on. In some cases, it shows duplicated lines of users who are logging on more than one terminal. Normally, I would do who | cut -d" " -f1 |...

2. Shell Programming and Scripting

Help removing lines with duplicated columns

Hi Guys... Please Could you help me with the following ? aaaa bbbb cccc sdsd aaaa bbbb cccc qwer as you can see, the 2 lines are matched in three fields... how can I delete this pupicate ? I mean to delete the second one if 3 fields were duplicated ? Thanks

3. UNIX for Dummies Questions & Answers

duplicated lines not recognized by sort and uniq

Hello all, I've got a strange behaviour of sort and uniq commands: they do not recognise apparently duplicated lines in a file (already sorted). The lines are identical by eye, but they must differ in smth, because when they are put in two files, those have slightly different size. What can make...

4. Shell Programming and Scripting

awk to count duplicated lines

We have an input file as follows: 2010-09-15-12.41.15 2010-09-15-12.41.15 2010-09-15-12.41.24 2010-09-15-12.41.24 2010-09-15-12.41.24 2010-09-15-12.41.24 2010-09-15-12.41.25 2010-09-15-12.41.26 2010-09-15-12.41.26 2010-09-15-12.41.26 2010-09-15-12.41.26 2010-09-15-12.41.26...

5. Shell Programming and Scripting

awk to insert duplicated lines

Dear All, Suppose I have a file: 1 1 1 1 2 2 2 2 3 3 3 3I want to insert new line under each old line so that the file would become: 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 3 3 3 3 3 3 3 3How can this be accomplished using awk (or sed)?

6. Shell Programming and Scripting

How to remove duplicated lines?

Hi, if i have a file like this: Query=1 a a b c c c d Query=2 b b b c c e . . .

7. Shell Programming and Scripting

Removing duplicated first field rows

Hello, I am trying to eliminate rows where the first field is duplicated, leaving the row where the last field is "NET". Data file: 345234|22.34|LST 546543|55.33|LST 793929|98.23|LST 793929|64.69|NET 149593|49.22|LST Desired output: 345234|22.34|LST 546543|55.33|LST...

8. UNIX for Dummies Questions & Answers

Removing PATTERN from txt without removing lines and general text formatting

Hi Everybody! First post! Totally noobie. I'm using the terminal to read a poorly formatted book. The text file contains, in the middle of paragraphs, hyphenation to split words that are supposed to be on multiple pages. It looks ve -- ry much like this. I was hoping to use grep -v " -- "...

9. Shell Programming and Scripting

Deleting lines containing duplicated strings

Dear all, I always appreciate your help. I would like to delete lines containing duplicated strings in the second column. test.txt 658 invert_d2e_q_reg_0_/Qalu_ecl_zlow_e 0.825692 659 invert_d2e_q_reg_0_/Qalu_byp_rd_data_e 0.825692 660 invert_d2e_q_reg_0_/Qalu_byp_rd_data_e 0.825692...

LEARN ABOUT DEBIAN

cfenvgraph

cfengine(8)						      System Manager's Manual						       cfengine(8)

NAME

       cfengine - network configuration engine

SYNOPSIS

       /usr/sbin/cfenvgraph [options]

COMMAND LINE OPTIONS

       --help

       --file Override default input database

       --erasehistory
	      Erase machine-learned history of named traces. Comma separated list (no spaces)

       --outputdir
	      override name of output directory

       --titles
	      Generate titles in output data files for traces

       --timestamps
	      Add time stamps to output directory

       --resolution
	      Maximum output resolution (default is smoothed over each hour).

       --separate
	      Plot separate output files for each trace.

       --no-error-bars
	      Do not add uncertainty margins to output.

       --no-scaling
	      Do not renormalize graphs for convenient representation

       --now  Show data for last four hours only in high resolution.

       --verbose

DESCRIPTION

       cfengine  is  a	language  based  system  specifically designed for testing and configuring unix-like systems attached to a TCP/IP network.
       Cfenvd is part of the anomaly detection subsystem for cfagent.

       cfenvgraph is a research tool for extracting graphs of the learned history of system performance from  the  learned  database.	Users  are
       referred to the web page

       http://www.cfengine.org/confdir/cfenvgraph.html

       for an explanation of this graphical tool.

AUTHOR

       Mark Burgess, Oslo University College

INFORMATION

       http://www.cfengine.org

							       Maintenance Commands						       cfengine(8)