Grep to find matching patern and return unique values Post: 302802307

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Grep to find matching patern and return unique values Post 302802307 by Siva SQL on Friday 3rd of May 2013 09:06:04 AM

05-03-2013

Registered User

Quote:

Originally Posted by BhushanPathak

You have a file "saw_batch_drive_cmd", from which you want to get unique directories. Will the file contents be always similar to the sample one you have posted?

Try the following commands on the file -

Code:

cat saw_batch_drive_cmd | grep "/app/oracle" | cut -d"/" -f 1-5 | uniq | sed "s/^\#//"
/app/oracle/build_lib/pkg320.0_20120927
/app/oracle/build_lib/pkg320.0_20121004_prof
/app/oracle/build_lib/pkg320.0_20121004
/app/oracle/build_lib/pkg320.0_20121011
/app/oracle/build_lib/pkg330.0_20121011
/app/oracle/build_lib/pkg330.0_20121018

Let me know if this is what you were looking for.

Thanks
Bhushan Pathak

Thanks Bhushan Pathak Smilie

Please explain me what is that sed part of the command do.

---------- Post updated at 06:36 PM ---------- Previous update was at 06:23 PM ----------

Quote:

Originally Posted by vidyadhar85

No need to cat a file for grep thats useless use of cat Smilie

try below

Code:

 
awk -F"/" '/oracle/{A[$5]=$1"/"$2"/"$3"/"$4"/"$5}END{for(i in A){sub("#","",A[i]);print A[i]}}' filename

The command is very useful.

I would really appreciate, if you can expain this command as how it works.

Siva SQL

View Public Profile for Siva SQL

Find all posts by Siva SQL

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Need to find only unique values for a given tag across the files

Need to find only unique values for a given tag across the files: For eg: Test1: <Tag1>aaa</Tag1> <Tag2>bbb</Tag2> <Tag3>ccc</Tag3> Test2: <Tag1>aaa</Tag1> <Tag2>ddd</Tag2> <Tag3>eee</Tag3> Test3: <Tag1>aaa</Tag1> <Tag2>ddd</Tag2> <Tag3>eee</Tag3> Test4:

2. Shell Programming and Scripting

return a list of unique values of a column from csv format file

Hi all, I have a huge csv file with the following format of data, Num SNPs, 549997 Total SNPs,555352 Num Samples, 157 SNP, SampleID, Allele1, Allele2 A001,AB1,A,A A002,AB1,A,A A003,AB1,A,A ... ... ... I would like to write out a list of unique SNP (column 1). Could you...

3. UNIX and Linux Applications

grep file to find unique instances of username

hello - A SystemOut.log file has recurring entries that follow this format: Principal: auth9.nick.al.gov:389/USERNAME Over the course of a day thousands of lines similar to this are produced, with each username represented hundreds of times. I need to create a new file that shows...

4. Shell Programming and Scripting

Grep with regulare expression to find carrige return

Gurus, I have a files from where lines are like following <ns0:ccid>123456789</ns0:ccid> <ns0:ccid>1234 56789</ns0:ccid> I would like to grep any number which will be as below (with carrige return): As 123456789 any number so I have to use the regular expression <ns0:ccid>1234...

5. Shell Programming and Scripting

Find and count unique date values in a file based on position

Hello, I need some sort of way to extract every date contained in a file, and count how many of those dates there are. Here are the specifics: The date format I'm looking for is mm/dd/yyyy I only need to look after line 45 in the file (that's where the data begins) The columns of...

6. UNIX for Dummies Questions & Answers

Grep to find lines matching given patern in a file

When I try with patern matching in a file with below code works cat scj_drive_commands | egrep '/app/oracle/build_lib/pkg32|/app/oracle/build_lib/pkg33' But when I have code with patern searching using of below does not work ! cat scj_drive_commands | egrep...

7. Shell Programming and Scripting

How to find sum of any 'n' number of values from file matching target value?

I have a simple text file having payment amount value on each line. At the end of day 'n' number of payments created difference in amount that I need to match from this file. I have information about how many payments created difference and difference amount. Please help me to build shell...

8. Shell Programming and Scripting

Using grep and a parameter file to return unique values

Hello Everyone! I have updated the first post so that my intentions are easier to understand, and also attached sample files (post #18). I have over 500 text files in a directory. Over 1 GB of data. The data in those files is organised in lines: My intention is to return one line per...

9. Shell Programming and Scripting

How to merge two files with unique values matching.?

I have one script as below: #!/bin/ksh Outputfile1="/home/OutputFile1.xls" Outputfile2="/home/OutputFile2.xls" InputFile1="/home/InputFile1.sql" InputFile2="/home/InputFile2.sql" echo "Select hobby, class, subject, sports, rollNumber from Student_Table" >> InputFile1 echo "Select rollNumber...

10. UNIX for Beginners Questions & Answers

Find unique values but only in column 1

Hi All, Does anyone have any suggestions/examples of how i could show only lines where the first field is not duplicated. If the first field is listed more than once it shouldnt be shown even if the other columns make it unique. Example file : 876,RIBDA,EC2 876,RIBDH,EX7 877,RIBDF,E28...

LEARN ABOUT REDHAT

tk_getuid

Tk_GetUid(3)						       Tk Library Procedures						      Tk_GetUid(3)

__________________________________________________________________________________________________________________________________________________

NAME

       Tk_GetUid, Tk_Uid - convert from string to unique identifier

SYNOPSIS

       #include <tk.h>

       Tk_Uid
       Tk_GetUid(string)

ARGUMENTS

       char *string (in)			 String for which the corresponding unique identifier is desired.
_________________________________________________________________

DESCRIPTION

       Tk_GetUid  returns  the	unique identifier corresponding to string.  Unique identifiers are similar to atoms in Lisp, and are used in Tk to
       speed up comparisons and searches.  A unique identifier (type Tk_Uid) is a string pointer and may be used anywhere that a variable of  type
       "char  *"  could  be  used.   However, there is guaranteed to be exactly one unique identifier for any given string value.  If Tk_GetUid is
       called twice, once with string a and once with string b, and if a and b have the same string value (strcmp(a, b) == 0), then Tk_GetUid will
       return  exactly	the  same Tk_Uid value for each call (Tk_GetUid(a) == Tk_GetUid(b)).  This means that variables of type Tk_Uid may be com-
       pared directly (x == y) without having to call strcmp.  In addition, the return value from Tk_GetUid will have the same string value as its
       argument (strcmp(Tk_GetUid(a), a) == 0).

KEYWORDS

       atom, unique identifier

Tk																      Tk_GetUid(3)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Need to find only unique values for a given tag across the files

Discussion started by: sudheshnaiyer

2. Shell Programming and Scripting

return a list of unique values of a column from csv format file

Discussion started by: phoeberunner

3. UNIX and Linux Applications

grep file to find unique instances of username

Discussion started by: 1075FJ40

4. Shell Programming and Scripting

Grep with regulare expression to find carrige return

Discussion started by: thepurple