Shell Script using awk


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Shell Script using awk
# 1  
Old 06-11-2008
Shell Script using awk

File1



9000|9000|WW|1|1|SL|472|472|LC|2272|1072|MTY

9000|9000|WW|1|1|SL|470|470|MC|1270|1172|MPVT

9000|9000|WW|1|1|SL|472|472|LC|1072|1672|MBD

9000|9000|WW|1|1|SL|473|473|LF|1173|1173|MTY





File2

DPT.1072 CP~ Apr 1514283.914

DPT.1172 CP~ Apr 967882.506

DPT.1672 CP~ Apr 545199.000

DPT.1772 CP~ Apr 912656.817







Compare the column 11 of file 1 with the 1st column of file2. The 1st column of file2 contains a prefix dpt. also. We need to compare file2 with file1 and in the output we should get all the values from file2 that are present in file1. We should not remove dpt. from the output. It will always be 8 characters in 1st column of file2 (e.g DPT.1072).



The output should be:



DPT.1072 CP~ Apr 1514283.914

DPT.1172 CP~ Apr 967882.506

DPT.1672 CP~ Apr 545199.000



I am thankful for your help.
# 2  
Old 06-11-2008
perhaps like this:

awk -F "|" '{print $11}' testing|xargs -i grep {} testing1|awk '{print$1}' testing1

testing is inputfile1 testing1 is comparation file

thanks
# 3  
Old 06-11-2008
if you want all the output from file2
awk -F "|" '{print $11}' testing|xargs -i grep {} testing1|awk '{print$0}' testing1
# 4  
Old 06-12-2008
Thanks for your reply. I will try this. Only thing I am not sure is the prefix DPT. in file2. We want to compare two files after removing prefix DPT. but we do NOT want to remove DPT. from the output. Means in the comparsion command only we need to compare without DPT.---------May be at the time of comparsion something like substr(col1 of file2, 4,8)...........

Thanks Much.
# 5  
Old 06-12-2008
Code:
awk -F"|" 'FNR==NR {a[$11]++; next} a[substr($0, 5, 4)] {print}' file1 file2

awk -F"|" field separator

FNR==NR {a[$11]++; next} buid an array with 11th field of file1 and give value 1 (default value 0+1) to it.

a[substr($0, 5, 4)] {print} if a[nnnn] is TRUE (1)---> print line from file2
# 6  
Old 06-12-2008
Thank-You. It worked fine.
# 7  
Old 06-16-2008
hi can you say me what xargs is all about...


thanks
krips.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to call and sort awk script and output

I'm trying to create a shell script that takes a awk script that I wrote and a filename as an argument. I was able to get that done but I'm having trouble figuring out how to keep the header of the output at the top but sort the rest of the rows alphabetically. This is what I have now but it is... (1 Reply)
Discussion started by: Eric7giants
1 Replies

2. UNIX for Dummies Questions & Answers

Passing shell script parameter value to awk command in side the script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff |... (1 Reply)
Discussion started by: Sarita Behera
1 Replies

3. Shell Programming and Scripting

Unable to pass shell script variable to awk command in same shell script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk... (2 Replies)
Discussion started by: Ashunayak
2 Replies

4. Post Here to Contact Site Administrators and Moderators

Unable to pass shell script parameter value to awk command in side the same script

Variable I have in my shell script diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk -F'~' ''$2 == "$id"' {print $0}' > $new I could see value of $id is not passing to the awk... (0 Replies)
Discussion started by: Ashunayak
0 Replies

5. Shell Programming and Scripting

Calling shell script within awk script throws error

I am getting the following error while passing parameter to a shell script called within awk script. Any idea what's causing this issue and how to ix it ? Thanks sh: -c: line 0: syntax error near unexpected token `newline' sh: -c: line 0: `./billdatecalc.sh ... (10 Replies)
Discussion started by: Sudhakar333
10 Replies

6. Shell Programming and Scripting

Call shell script function from awk script

hi everyone i am trying to do this bash> cat abc.sh deepak() { echo Deepak } deepak bash>./abc.sh Deepak so it is giving me write simply i created a func and it worked now i modified it like this way bash> cat abc.sh (2 Replies)
Discussion started by: aishsimplesweet
2 Replies

7. Shell Programming and Scripting

want to pass parameters to awk script from shell script

Hello, I have this awk script that I want to execute by passing parameters through a shell script. I'm a little confused. This awk script removes duplicates from an input file. Ok, so I have a .sh file called rem_dups.sh #!/usr/bin/sh... (4 Replies)
Discussion started by: script_op2a
4 Replies

8. Shell Programming and Scripting

create a shell script that calls another script and and an awk script

Hi guys I have a shell script that executes sql statemets and sends the output to a file.the script takes in parameters executes sql and sends the result to an output file. #!/bin/sh echo " $2 $3 $4 $5 $6 $7 isql -w400 -U$2 -S$5 -P$3 << xxx use $4 go print"**Changes to the table... (0 Replies)
Discussion started by: magikminox
0 Replies

9. UNIX for Advanced & Expert Users

AWK instead of Shell script

I've a list file, which has some file names. ex: list file "list_file" will have data_file1.txt data_file2.txt data_file3.txt : : data_filen.txt Above files will have the below layout: Header1 Header2 *TM* Data record 1 Datarecord 2 Datarecord n *TM* (19 Replies)
Discussion started by: Lokesha
19 Replies

10. Shell Programming and Scripting

using shell script or awk......

suppose my one file has >1|lol|hai i am cdfd dafvshbejndjnudbnjdbyebjcb bdhbdjndjndmdkmdkldhddjndj dbdhbndjndjmdklm sjskndknsknsknks sbsjksnknsknknklsl >2|lol|hai ia m cdfd123 jbsjbjbjbjbjbjbjbjbjbj jkbkkkkkkkkkkkkk khkkkkkkkkkkkkk scbjbjbakbqlblabkla >3lol|hai ia m cdfd3435... (2 Replies)
Discussion started by: cdfd123
2 Replies
Login or Register to Ask a Question