Counting The Number Of Duplicate Lines In a File Post: 38040

10 More Discussions You Might Find Interesting

1. Linux

counting the number of lines

Hello, I have afile which begins with a few urls on multiple lines and then there is listing of some information on separate lines. The listing begins with the word Name on a given line followed by teh actual list. I want to count the number of lines in this file after the line having...

2. Shell Programming and Scripting

Counting Number of times a File is accessed

Hi, I need to count the number of times a script is accessed from within the script. Is it possible ? Example: I have a script called lo.sh and i execute the script for the first time, then the counter variable declared inside the lo.sh should increment by 1. For every execution the...

3. Shell Programming and Scripting

awk - Counting number of similar lines

Hi All I have the input file OMAK_11. OMAK 000002EXCLUDE 1341 OMAK 000002EXCLUDE 1341 OMAK 000002EXCLUDE 1341 OMAK 000003EXCLUDE 1341 OMAK 000003EXCLUDE 1341 OMAK 000003EXCLUDE ...

4. Shell Programming and Scripting

counting the number of lines - again

Hi all, I use bash shell and I have a problem with wc. I would like to determine the number of lines in a file so I do wc -l filename but I don't want to get the filename again I just would like to have the number of lines and use it in a variable. Can anybody help? Thank you,

5. Shell Programming and Scripting

Counting duplicate entries in a file using awk

Hi, I have a very big (with around 1 million entries) txt file with IPv4 addresses in the standard format, i.e. a.b.c.d The file looks like 10.1.1.1 10.1.1.1 10.1.1.1 10.1.2.4 10.1.2.4 12.1.5.6 . . . . and so on.... There are duplicate/multiple entries for some IP...

6. Shell Programming and Scripting

Counting number of files that contain words stored in another file

Hi All, I have written a script on this but it does not do the requisite job. My requirement is this: 1. I have two kinds of files each with different extensions. One set of files are *.dat (6000 unique DAT files all in one directory) and another set *.dic files (6000 unique DIC files in...

7. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to...

8. Shell Programming and Scripting

Running sed and counting number of lines processed

/bin/sed -n ';4757335,$ p' | wc -l /bin/sed -n ';4757335,$ p' | egrep "Failed" | egrep -c "PM late arrrival" how can i combine the above two sed commands into one? i want to count the number of lines between the specified line number and the end of the file. AND and i want to count how many...

9. Shell Programming and Scripting

Eliminating duplicate lines via specified number of digits

Hello, This is similar to a previous post, where I was trying to eliminate lines where column #1 is duplicated. If it is a duplicate, the line with the greater value in column #2 should be deleted. In this new case, I need to test duplication with the first three digits in column #1 (ignoring the...

10. Shell Programming and Scripting

[Solved] Counting The Number of Lines Between Values with Multiple Variables

Hey everyone, I have a bunch of lines with values in field 4 that I am interested in. If these values are between 1 and 3 I want it to count all these values to all be counted together and then have the computer print out LOW and the number of lines with those values in between 1 and 3,...

LEARN ABOUT OPENSOLARIS

gnomevfs-cat

gnomevfs-cat(1) 						   User Commands						   gnomevfs-cat(1)

NAME

       gnomevfs-cat - print a file to standard output using the VFS system

SYNOPSIS

       gnomevfs-cat URI

DESCRIPTION

       gnomevfs-cat is obsolete.  It has been superseded by gvfs-cat.  See gvfs-cat(1).

       gnomevfs-cat prints a file to standard output using the virtual file system to access the file via a URI.

OPERANDS

       The following operands are supported:

       URI	       Specifies the file location in standard URI format.

EXAMPLES

       Example 1: Cat a File From a Web Server

       example% gnomevfs-cat http://www.sun.com

       Example 2: Cat a Local File

       example% gnomevfs-cat file:///home/user/README.txt

ENVIRONMENT VARIABLES

       See environ(5) for descriptions of the following environment variables: NLSPATH.

EXIT STATUS

       The exit value 0 is returned regardless of success or failure.

FILES

       The following files are used by this application:

       /usr/bin/gnomevfs-cat   Executable to print a file to standard output using the VFS system

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWgnome-vfs		   |
       +-----------------------------+-----------------------------+
       |Interface stability	     |Obsolete Volatile 	   |
       +-----------------------------+-----------------------------+

SEE ALSO

       gnomevfs-copy(1), gnomevfs-info(1), gnomevfs-ls(1), gnomevfs-mkdir(1), gvfs-cat(1), attributes(5), environ(5)

NOTES

       Written by Stephen Browne, Sun Microsystems Inc., 2004.

SunOS 5.11							    14 May 2008 						   gnomevfs-cat(1)

10 More Discussions You Might Find Interesting

1. Linux

counting the number of lines

Discussion started by: nayeemmz

2. Shell Programming and Scripting

Counting Number of times a File is accessed

Discussion started by: pathanjalireddy

3. Shell Programming and Scripting

awk - Counting number of similar lines

Discussion started by: dhanamurthy

4. Shell Programming and Scripting

counting the number of lines - again

Discussion started by: f_o_555