Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Awk question.

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Awk question.
# 1  
Old 07-09-2012
Awk question.
Hi,
I have 2 csv comma separated files with the following fields.

File 1 :
BDUSERID
BDUSERNAME
BDACCESS

File 2 :
BBUSERID
BBKEYWORD
BBACCESS

I need to compare teo files in such a way that if fields BBUSERID and BDUSERID match then display BDUSERNAME and all other fields from
File 2.

If they do not match , the field BBUSERID from File 2 should be listed with spaces in BDUSERNAME field.


I tried awk a couple of ways for doing this, but wrong results.


Method 1 tried :
Code:
awk 'FNR==NR{a[$2]=$0;next} $2 in a{print a[$2]}' file1 file2  > file3

Code:
awk -F , -v f1=usrsu.txt -v f2=sovsu.txt '
    BEGIN {
        col = 1                     
        while( (getline<f1) > 0 )
        {
            f12 = $(col);
            if( (getline <f2) > 0 && $(col) == f12 )
                print;
        }
    }
' >file-3

Sample data of files :

File 1 :
Code:
ab0184,Alvin Brown,2
ab0933,Angela Boido,1
ab1280,Annmarie Blanchard,1
ab1434,Angela Butler,2
ab1778,Alan Bairley,2
ab2307,Arielle Ballard,1
ab2327,Aaron Berry,1
ac0299,Aimee Corcoran,2
ac1957,Anna Cerio,1
ac3197,Amy Conwell,1
ac3829,Adrienne Coleman,3
ac9106,Anne-Marie Cardillo,1
ac9111,Andrew Cournoyer,1
ad0391,Adam Davis,2
ad1819,Andrea Dolo,1
ad8286,Andrea Doria,1
ad9091,Alin D'Arrigo,1

File 2 :
Code:
aa2154,Anne Agen,COLOR,0
aa2154,Anne Agen,LTPRT,2
aa2154,Anne Agen,MEMBR,2
aa2154,Anne Agen,PARAM,0
aa2154,Anne Agen,PRINT,3
aa2154,Anne Agen,PROCP,1
aa2154,Anne Agen,PROVC,1
aa2154,Anne Agen,SOVER,1
aa2154,Anne Agen,USERF,1
ab0184,Alvin Brown,COLOR,0
ab0184,Alvin Brown,SOVER,1
ab0184,Alvin Brown,USERF,1
ab0933,Angela Boido,AUTH,1
ab0933,Angela Boido,COLOR,0
ab0933,Angela Boido,CREDL,1
ab0933,Angela Boido,INCLM,1
ab0933,Angela Boido,LTEMP,1
ab0933,Angela Boido,MEMBR,1
ab0933,Angela Boido,OPCLM,1
ab0933,Angela Boido,PROVC,1
ab0933,Angela Boido,PROVF,1
ab0933,Angela Boido,PROVP,1
ab0933,Angela Boido,SOVER,1
ab0933,Angela Boido,USERF,1
ab1280,Annmarie Blanchard,COLOR,0
ab1280,Annmarie Blanchard,PARAM,0
ab1280,Annmarie Blanchard,SOVER,1
ab1280,Annmarie Blanchard,USERF,1
ab1434,Angela Butler,AUTHS,2
ab1434,Angela Butler,COLOR,0
ab1434,Angela Butler,INCLM,1
ab1434,Angela Butler,INTAC,2
ab1434,Angela Butler,OPCLM,1
ab1434,Angela Butler,PAINT,3
ab1434,Angela Butler,PROCD,1

# 2  
Old 07-09-2012
Like this?

Code:
awk -F, 'FNR==NR{a[$1]=$2;next} {$1 in a?$0=a[$1]FS$0:$0=" "FS$0}1' file1 file2

# 3  
Old 07-09-2012
Not sure if I got it right:
Code:
awk -F, 'NR==FNR{_[$1]=$2; next} _[$1] {line=$2 OFS $1; for( i=3; i<=NF; i++){line?line=line FS $i : line=$i}; print line; line=""; next} {print $2}' OFS=, f1 f2
Anne Agen
Anne Agen
Anne Agen
Anne Agen
Anne Agen
Anne Agen
Anne Agen
Anne Agen
Anne Agen
Alvin Brown,ab0184,COLOR,0
Alvin Brown,ab0184,SOVER,1
Alvin Brown,ab0184,USERF,1
Angela Boido,ab0933,AUTH,1
Angela Boido,ab0933,COLOR,0
Angela Boido,ab0933,CREDL,1
Angela Boido,ab0933,INCLM,1
Angela Boido,ab0933,LTEMP,1
Angela Boido,ab0933,MEMBR,1
Angela Boido,ab0933,OPCLM,1
Angela Boido,ab0933,PROVC,1
Angela Boido,ab0933,PROVF,1
Angela Boido,ab0933,PROVP,1
Angela Boido,ab0933,SOVER,1
Angela Boido,ab0933,USERF,1
Annmarie Blanchard,ab1280,COLOR,0
Annmarie Blanchard,ab1280,PARAM,0
Annmarie Blanchard,ab1280,SOVER,1
Annmarie Blanchard,ab1280,USERF,1
Angela Butler,ab1434,AUTHS,2
Angela Butler,ab1434,COLOR,0
Angela Butler,ab1434,INCLM,1
Angela Butler,ab1434,INTAC,2
Angela Butler,ab1434,OPCLM,1
Angela Butler,ab1434,PAINT,3
Angela Butler,ab1434,PROCD,1

Edit: Slight correction so that BDUSERNAME is supplied from f1.
Last edited by zaxxon; 07-09-2012 at 10:07 AM.. Reason: correction
# 4  
Old 07-09-2012
For some reason, the username field comes in as 1st and 3rd field (duplicated).

Here's the sample output file.If you notice entry for at9601, the username field is empty since at9601 entry is found in file 2 , but not in file 1.

Code:
USERID    USERNAME    SCREEN    OVERALL ACCESS LEVEL
at3624    Annette Tuccelli    INCLM    1
at3624    Annette Tuccelli    OPCLM    1
at3624    Annette Tuccelli    PROCD    1
at3624    Annette Tuccelli    PROVC    1
at3624    Annette Tuccelli    SOVER    1
at3624    Annette Tuccelli    USERF    1
at3624    Annette Tuccelli    VENDR    1
at9601                                AUTHQ    1
at9601                               COLOR    0
at9601                               INCLM    1
at9601                               MEMB    2
at9601                               OPCLM    1
at9601                               PROCD    1
at9601                               PROCP    1
at9601                               PROVC    1
at9601                               SOVER    1
at9601                               USERF    1
at9601                              VENDR    1
atp01    Automated Process    CREDL    1
atp01    Automated Process    FDATA    0
atp01    Automated Process    PROVA    1
atp01    Automated Process    PROVC    2

# 5  
Old 07-09-2012
Which code did you try? When you wrote what you want to have displayed, you didn't mention explicit the USERID but in your output it is displayed.. ?

Edit:
Nevermind, I saw you wrote all fields from f2 should follow. Altered my code.

Another edit:
It might be good to post a list, that resembles what you expect as output, not a another reprocessed output.
Last edited by zaxxon; 07-09-2012 at 10:17 AM..
# 6  
Old 07-09-2012
Hi Zaxxon!
It's pretty close ! This is what I get when I run your code.
Code:
Andrea Miara,am1900,PAINT,1
Andrea Miara,am1900,PROCD,1
Andrea Miara,am1900,PROVC,1
Andrea Miara,am1900,SOVER,1
Andrea Miara,am1900,USERF,1
Andrea Miara,am1900,VENDR,1
Allison Maganzini,am2682,AUTHQ,1
Allison Maganzini,am2682,COLOR,0
Allison Maganzini,am2682,INCLM,1
Allison Maganzini,am2682,OPCLM,1
Allison Maganzini,am2682,PARAM,0
Allison Maganzini,am2682,PROCD,1
Allison Maganzini,am2682,PROVC,1
Allison Maganzini,am2682,SOVER,1
Allison Maganzini,am2682,USERF,1
Allison Maganzini,am2682,VENDR,1

What should be done to get userid "am2682" as the first field.
# 7  
Old 07-09-2012
Bug try this .....
Code:
while read line
do
des=`echo $line | awk -F "," '{ print $1 }' | sed 's/ /__/g'`
name=`echo $line | awk -F "," '{ print $2 }' | sed 's/ /__/g'`
cat file_2 | sed 's/ /__/g' | grep "$des" | awk -v NA=$name  '{ if ( length $0 > 10 ) print NA, $0 }' | sed 's/__/ /g'
done<file_1
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk question : system output to awk variable.

Hi Experts, I am trying to get system output to capture inside awk , but not working: Please advise if this is possible : I am trying something like this but not working, the output is coming wrong: echo "" | awk '{d=system ("date") ; print "Current date is:" , d }' Thanks, (5 Replies)
Discussion started by: rveri
5 Replies

2. Homework & Coursework Questions

awk question.

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: im using ls -l | xargs | awk '{what ever files here}' im trying to get something that looks like this... (7 Replies)
Discussion started by: rontopia
7 Replies

3. UNIX for Dummies Questions & Answers

Basic awk question...getting awk to act on $1 of the command itself

I have a script problem that I am not able to solve due my very limited understanding of unix/awk. This is the contents of test.sh awk '{print $1}' From the prompt if I enter: ./test.sh Hello World I would expect to see "Hello" but all I get is a blank line. Only then if I enter "Hello... (2 Replies)
Discussion started by: JasonHamm
2 Replies

4. UNIX for Dummies Questions & Answers

awk question

Can anyone help with this this one liner: nawk -v RS='' '$1=$1' InputFile What I have in the file: 0.0013985457223116 -0.0002338180925628 0.0 0.0003709430584958 -0.0005763523138347 0.0 And the output I want: 0.0013985457223116 -0.0002338180925628 0.0 0.0003709430584958... (1 Reply)
Discussion started by: mookie123
1 Replies

5. UNIX for Dummies Questions & Answers

awk question

Hi, in the following script, what does " a=$0} END " mean ? do we need that ? Thanks awk '{a=$0} END {for (i=NR; i>=1; i--) print a}' file (3 Replies)
Discussion started by: james94538
3 Replies

6. Shell Programming and Scripting

Awk Question

How I can rid of the following presentation du -sk /u*/oradata/TEST/*.dbf |awk '{print total+=$1} 1.28003e+06 4.35109e+06 4.36134e+06 4.4535e+06 5.47752e+06 5.48777e+06 7.52554e+06 7.73036e+06 9.06158e+06 :confused: thank you (3 Replies)
Discussion started by: zam
3 Replies

7. Shell Programming and Scripting

awk question

I am trying to read through a file, gather the states in that file and change it from an abbreviation to the ful text. Can anyone provide some assistance. Thanks!! (4 Replies)
Discussion started by: cnitadesigner
4 Replies

8. Shell Programming and Scripting

awk .. question?

i have a little awk script that I use looks this: awk '{if (FNR==1){print FILENAME; print $0}else print $0}' file1...file2....fi... > bundled. i have completely forgotten how to unbundle this. I have tried several different approaches and still can not remember how to unbundle the file bundled.... (2 Replies)
Discussion started by: moxxx68
2 Replies

9. Shell Programming and Scripting

One more awk question!

Hello, I have the following command that does 2 searches. awk '{if ($0 ~ /STRING1/) {c++} }{if ( c == 2 ) {sub(/STRING1/,"NEWSTRING") } } { print }' FILE How do I search up after the first search? thanks (4 Replies)
Discussion started by: ctcuser
4 Replies

10. Shell Programming and Scripting

awk question

I have the following error: ls -lt | awk 'BEGIN NR > 1 { print $2, $9 }' Syntax Error The source line is 1. The error context is BEGIN >>> NR <<< > 1 { print $2, $9 } awk: 0602-500 Quitting The source line is 1. What I want to do is ls a directory, skip the first... (3 Replies)
Discussion started by: lesstjm
3 Replies
Login or Register to Ask a Question