Removing Duplicate Rows in a file

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Get duplicate rows from a csv file

How can i get the duplicates rows from a file using unix, for example i have data like a,1 b,2 c,3 d,4 a,1 c,3 e,5 i want output to be like a,1 c,3

2. Shell Programming and Scripting

Removing duplicate terms in a file

Hi everybody I have a .txt file that contains some assembly code for optimizing it i need to remove some replicated parts. for example I have:e_li r0,-1 e_li r25,-1 e_lis r25,0000 add r31, r31 ,r0 e_li r28,-1 e_lis r28,0000 add r31, r31 ,r0 e_li r28,-1 ...

3. UNIX for Dummies Questions & Answers

Removing duplicate rows & selecting only latest date

Gurus, From a file I need to remove duplicate rows based on the first column data but also we need to consider a date column where we need to keep the latest date (13th column). Ex: Input File: Output File: I know how to take out the duplicates but I couldn't figure out...

4. Shell Programming and Scripting

Duplicate rows in a text file

notes: i am using cygwin and notepad++ only for checking this and my OS is XP. #!/bin/bash typeset -i totalvalue=(wc -w /cygdrive/c/cygwinfiles/database.txt) typeset -i totallines=(wc -l /cygdrive/c/cygwinfiles/database.txt) typeset -i columnlines=`expr $totalvalue / $totallines` awk -F' ' -v...

5. HP-UX

How to get Duplicate rows in a file

Hi all, I have written one shell script. The output file of this script is having sql output. In that file, I want to extract the rows which are having multiple entries(duplicate rows). For example, the output file will be like the following way. ...

6. UNIX for Dummies Questions & Answers

Remove duplicate rows of a file based on a value of a column

Hi, I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g. COL1 COL2 COL3 A 1234 1234 B 3k32 2322 C Xk32 TTT A NEW XX22 B 3k32 ...

7. Shell Programming and Scripting

removing the duplicate lines in a file

Hi, I need to concatenate three files in to one destination file.In this if some duplicate data occurs it should be deleted. eg: file1: ----- data1 value1 data2 value2 data3 value3 file2: ----- data1 value1 data4 value4 data5 value5 file3: ----- data1 value1 data4 value4

8. Shell Programming and Scripting

how to delete duplicate rows in a file

I have a file content like below. "0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","","" "0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","","" "0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""...

9. Shell Programming and Scripting

duplicate rows in a file

hi all can anyone please let me know if there is a way to find out duplicate rows in a file. i have a file that has hundreds of numbers(all in next row). i want to find out the numbers that are repeted in the file. eg. 123434 534 5575 4746767 347624 5575 i want 5575 please help

10. UNIX for Dummies Questions & Answers

removing duplicate lines from a file

Hi, I am trying to remove duplicate lines from a file. For example the contents of example.txt is: this is a test 2342 this is a test 34343 this is a test 43434 and i want to remove the "this is a test" lines only and end up with the numbers in the file, that is, end up with: 2342...

LEARN ABOUT PHP

sqlsrv_num_rows

SQLSRV_NUM_ROWS(3)														SQLSRV_NUM_ROWS(3)

sqlsrv_num_rows - Retrieves the number of rows in a result set

SYNOPSIS

       mixed sqlsrv_num_rows (resource	$stmt)

DESCRIPTION

	Retrieves the number of rows in a result set. This function requires that the statment resource be created with a static or keyset cursor.
       For more information, see sqlsrv_query(3), sqlsrv_prepare(3), or Specifying a Cursor Type and Selecting Rows in the Microsoft SQLSRV  docu-
       mentation.

PARAMETERS

	      o $stmt
		-  The	statement  for	which the row count is returned. The statment resource must be created with a static or keyset cursor. For
		more information, see sqlsrv_query(3), sqlsrv_prepare(3), or Specifying a Cursor Type and Selecting Rows in the  Microsoft  SQLSRV
		documentation.

RETURN VALUES

	Returns  the  number  of  rows retrieved on success and FALSE if an error occurred. If a forward cursor (the default) or dynamic cursor is
       used, FALSE is returned.

EXAMPLES

       Example #1

	      sqlsrv_num_rows(3) example

	      <?php
	      $server = "serverNamesqlexpress";
	      $connectionInfo = array( "Database"=>"dbName", "UID"=>"username", "PWD"=>"password" );
	      $conn = sqlsrv_connect( $server, $connectionInfo );

	      $sql = "SELECT * FROM Table_1";
	      $params = array();
	      $options =  array( "Scrollable" => SQLSRV_CURSOR_KEYSET );
	      $stmt = sqlsrv_query( $conn, $sql , $params, $options );

	      $row_count = sqlsrv_num_rows( $stmt );

	      if ($row_count === false)
		 echo "Error in retrieveing row count.";
	      else
		 echo $row_count;
	      ?>

SEE ALSO

       sqlsrv_has_rows(3), sqlsrv_rows_affected(3).

PHP Documentation Group 													SQLSRV_NUM_ROWS(3)

Shell Programming and Scripting