Removing duplicated lines?? Post: 302600988

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicated lines without sort

Hi Just wondering whether or not I can remove duplicated lines without sort For example, I use the command who, which shows users who are logging on. In some cases, it shows duplicated lines of users who are logging on more than one terminal. Normally, I would do who | cut -d" " -f1 |...

2. Shell Programming and Scripting

Help removing lines with duplicated columns

Hi Guys... Please Could you help me with the following ? aaaa bbbb cccc sdsd aaaa bbbb cccc qwer as you can see, the 2 lines are matched in three fields... how can I delete this pupicate ? I mean to delete the second one if 3 fields were duplicated ? Thanks

3. UNIX for Dummies Questions & Answers

duplicated lines not recognized by sort and uniq

Hello all, I've got a strange behaviour of sort and uniq commands: they do not recognise apparently duplicated lines in a file (already sorted). The lines are identical by eye, but they must differ in smth, because when they are put in two files, those have slightly different size. What can make...

4. Shell Programming and Scripting

awk to count duplicated lines

We have an input file as follows: 2010-09-15-12.41.15 2010-09-15-12.41.15 2010-09-15-12.41.24 2010-09-15-12.41.24 2010-09-15-12.41.24 2010-09-15-12.41.24 2010-09-15-12.41.25 2010-09-15-12.41.26 2010-09-15-12.41.26 2010-09-15-12.41.26 2010-09-15-12.41.26 2010-09-15-12.41.26...

5. Shell Programming and Scripting

awk to insert duplicated lines

Dear All, Suppose I have a file: 1 1 1 1 2 2 2 2 3 3 3 3I want to insert new line under each old line so that the file would become: 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 3 3 3 3 3 3 3 3How can this be accomplished using awk (or sed)?

6. Shell Programming and Scripting

How to remove duplicated lines?

Hi, if i have a file like this: Query=1 a a b c c c d Query=2 b b b c c e . . .

7. Shell Programming and Scripting

Removing duplicated first field rows

Hello, I am trying to eliminate rows where the first field is duplicated, leaving the row where the last field is "NET". Data file: 345234|22.34|LST 546543|55.33|LST 793929|98.23|LST 793929|64.69|NET 149593|49.22|LST Desired output: 345234|22.34|LST 546543|55.33|LST...

8. UNIX for Dummies Questions & Answers

Removing PATTERN from txt without removing lines and general text formatting

Hi Everybody! First post! Totally noobie. I'm using the terminal to read a poorly formatted book. The text file contains, in the middle of paragraphs, hyphenation to split words that are supposed to be on multiple pages. It looks ve -- ry much like this. I was hoping to use grep -v " -- "...

9. Shell Programming and Scripting

Deleting lines containing duplicated strings

Dear all, I always appreciate your help. I would like to delete lines containing duplicated strings in the second column. test.txt 658 invert_d2e_q_reg_0_/Qalu_ecl_zlow_e 0.825692 659 invert_d2e_q_reg_0_/Qalu_byp_rd_data_e 0.825692 660 invert_d2e_q_reg_0_/Qalu_byp_rd_data_e 0.825692...

LEARN ABOUT DEBIAN

fatsort

fatsort(1)						      General Commands Manual							fatsort(1)

NAME

       FATSort - FAT filesystem sorting utility

SYNOPSIS

       fatsort [options] device

DESCRIPTION

       FATsort sorts directory structures of FAT filesystems.  Many MP3 hardware players don't sort files automatically but play them in the order
       they were transmitted to the device. FATSort can help here.

OPTIONS

       -c     This option causes FATSort to ignore the case of filenames (e.g. 'example.mp3' is equal to 'EXAMPLE.MP3').

       -f     Force sorting even if the device is mounted or if FATSort cannot determine if the device is mounted.

       -h     Shows some help information.

       -i     Prints some file system information of the specified device.

       -l     FATSort will not sort directory structures, but just print the current order.

       -o type
	      This options specifies how FATSort will sort files and directories.  type can be 'd' for directories  before  files  (which  is  the
	      default), 'f' for files before directories, or 'a' for no differentiation between files and directories.

       -n     Uses natural order to sort directory structures instead of  alphanumeric order.  For example, an alphanumeric order would be
		     file123.mp3
		     file21.mp3
		     file3.mp3
	      and the corresponding natural order would be
		     file3.mp3
		     file21.mp3
		     file123.mp3.

       -q     FATSort will work quietly without printing additional information messages.

       -r     Sorts the directories in reverse order (Z-A).

       -R     Sorts the directories in random order.

       -v     Shows version information only.

       The following options can be specified multiple times:

       -d directory
	      Sort directory only

       -D directory
	      Sort directory and all subdirectories

       -x directory
	      Don't sort directory

       -X directory
	      Don't sort directory and all subdirectories

       -I prefix
	      Ignore  filename	prefix	prefix	during sorting. For example, passing option -I "the " tells FATSort to sort 'The Beatles.mp3' like
	      'Beatles.mp3'.

EXAMPLES

       Sort FAT filesystem on an USB stick:
	      fatsort /dev/sda1

       Sort FAT filesystem in a file:
	      fatsort /home/user/fat16_fs.img

       Sort directory /dir1 and all subdirectories except /dir1/dirA:
	      fatsort /dev/sda1 -D /dir1 -x /dir1/dirA

       Ignore prefixes 'a ' and 'the ' during sorting:
	      fatsort /dev/sda1 -I "a " -I "the "

AUTHOR

       Boris Leidner <fatsort(at)formenos.de>

SEE ALSO

       mount(8) fsck(8)

NOTES

       FAT12 is not supported yet.

REPORT BUGS

       Please report bugs to fatsort(at)formenos.de. Thanks.

FATSort 0.9.15							       2011								fatsort(1)