Duplicate line removal matching some columns only Post: 302782977

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Sort, duplicate removal - Query

Hi All, I have a problem with the sort and duplicate filter command I am using in one of my scripts. I have a '|' delimited file and want to sort and remove duplicates on the 1,2,15 fields. These fields constitute the primary key of the table I will be loading the data into. But I see that some...

2. UNIX for Dummies Questions & Answers

exclude columns with a matching line pattern

Hi , I have 5 columns total and am wanting to search lines in columns 3-5 and basically grep -v patterns that match 'BBB_0123' 'BVG_0895' 'BSD_0987' Does anyone know how to do this? I tried combining grep -v with grep -e but, it didn't work. Thanks!

3. Shell Programming and Scripting

Removal of Duplicate Entries from the file

I have a file which consists of 1000 entries. Out of 1000 entries i have 500 Duplicate Entires. I want to remove the first Duplicate Entry (i,e entire Line) in the File. The example of the File is shown below: 8244100010143276|MARISOL CARO||MORALES|HSD768|CARR 430 KM 1.7 ...

4. Shell Programming and Scripting

using command line arguments as columns for pattern matching using awk

Hi, I wish to use a column, as inputted by a user from command line, for pattern matching. awk file: { if($1 ~ /^8/) { print $0> "temp2.csv" } } something like this, but i want '$1' to be any column as selected by the user from command line. ...

5. Shell Programming and Scripting

Column Search and Line Removal

Hello Gurus, I need to remove lines within a file if it contains specific criteria. Here is what I am trying to resolve: Users of AppRuntime: (Total of 10 licenses issued; Total of 6 licenses in use) buih02 dsktp501 AppGui 1 (compute_lic/27006 3122), start Mon 2/22 7:58 dingj1...

6. Shell Programming and Scripting

Remove duplicate lines (the first matching line by field criteria)

Hello to all, I have this file 2002 1 23 0 0 2435.60 131.70 5.60 20.99 0.89 0.00 285.80 2303.90 2002 1 23 15 0 2436.60 132.90 6.45 21.19 1.03 0.00 285.80 2303.70 2002 1 23 ...

7. UNIX for Advanced & Expert Users

Duplicate removal

I have an input file of 5GB which contains duplicate records and have to remove duplicate records by retaing first instance of that record . Based on 5 fields the duplicates has to be removed . Kindly request to help me in writing a Unix Script. Thanks Asim

8. Shell Programming and Scripting

awk to copy previous line matching a particular columns

Hello Help, 2356798 7689867 999 000 123678 20385907 9797 666 17978975 87468976 968978 98798 I am trying to have out put which actually look for the third column value of 9797 and then it insert line there after with first, second column value exactly as the previous line and replace the third...

9. Shell Programming and Scripting

Honey, I broke awk! (duplicate line removal in 30M line 3.7GB csv file)

I have a script that builds a database ~30 million lines, ~3.7 GB .cvs file. After multiple optimzations It takes about 62 min to bring in and parse all the files and used to take 10 min to remove duplicates until I was requested to add another column. I am using the highly optimized awk code: awk...

10. UNIX for Dummies Questions & Answers

Print only the duplicate line only with matching columns

Hi There, I have an I/P which looks like -- 1 2 3 4 5 1 2 3 4 6 4 7 8 9 9 5 6 7 8 9 I would like O/P to be --- 1 2 3 4 5 1 2 3 4 6 So, printing only the consecutive lines where $1,$2,$3,$4 are matching. Is there any command to do this or small awk script? Thanks,

LEARN ABOUT MINIX

scsi_setup_cdb

scsi_setup_cdb(9F)					   Kernel Functions for Drivers 					scsi_setup_cdb(9F)

NAME

       scsi_setup_cdb - setup SCSI command descriptor block (CDB)

SYNOPSIS

       int scsi_setup_cdb(union scsi_cdb *cdbp, uchar_t cmd, uint_t addr, uint_t cnt, uint_t othr_cdb_data);

INTERFACE LEVEL

       Solaris DDI specific (Solaris DDI).

PARAMETERS

       cdbp	       Pointer to command descriptor block.

       cmd	       The first byte of the SCSI group 0, 1, 2, 4, or 5 CDB.

       addr	       Pointer to the location of the data.

       cnt	       Data  transfer  length  in  units  defined by the SCSI device type. For sequential devices cnt is the number of bytes.  For
		       block devices, cnt is the number of blocks.

       othr_cdb_data   Additional CDB data.

DESCRIPTION

       scsi_setup_cdb() function initializes a group 0, 1, 2, 4, or 5 type of command descriptor block pointed to by  cdbp using  cmd, addr,  cnt,
       othr_cdb_data.

       addr  should  be  set to 0 for commands having no addressing information (for example, group 0 READ command for sequential access devices).
       othr_cdb_data should be additional CDB data for Group 4 commands; otherwise, it should be set to 0.

       scsi_setup_cdb() function does not set the LUN bits in CDB[1] as the  makecom(9F) functions do.	Also, the fixed bit for sequential  access
       device commands is not set.

RETURN VALUES

       scsi_setup_cdb() returns:

       1	Upon success.

       0	Upon failure.

CONTEXT

       These functions can be called from a user or interrupt context.

SEE ALSO

       makecom(9F), scsi_pkt(9S)

       Writing Device Drivers

       American National Standard Small Computer System Interface-2 (SCSI-2)

       American National Standard SCSI-3 Primary Commands (SPC)

SunOS 5.10							    23 Jun 1997 						scsi_setup_cdb(9F)