using awk in a script..


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting using awk in a script..
# 1  
Old 06-24-2008
using awk in a script..

hello there.
I have a script that loads data files into ORACLE tables.
I had to then add an awk line to take any zeros out of any fields prior to load which works perfectly well on its own but I need to know how to corrrctly put it into the script. eg.

#echo " "
#echo "Checking $datafile for zeros and null them where found.."
#echo " "
# if test -r $datafile
test -r $datafile
#then
newdatafile=`nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}}1' $datafile`
chmod 777 $newdatafile;
echo " "
echo " Modified Datafile is now:= $newdatafile"
# else
# echo " "
# echo "**** `..there was an error modifying the $datafile2 datafile..."
# echo " "
echo "**** datafile = " $newdatafile
#cat " "
#exit 1

..as you can see I have the datafile [which works fine when there are no zeros in the file being loaded], I pass it through the awk script but this is where I need help. I need to know how I rename the datafile to a new name/variable name which can then be used to load into ORACLE further down the script.

thanks for looking..
Steven
# 2  
Old 06-24-2008
If I understand the question you need to redirect the output of the awk program to another file:

Code:
 nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}}1' $datafile > new_file

Regards
# 3  
Old 06-24-2008
yes I think you understand right its just I'm not using it correctly. When I do that, then try and call the 'newfile' later down the script it doesnt recognise it as the midified version of the original file and therefore does not load it in.

Im doing:

nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}}1' $datafile > newdatafile;
echo " Modified Datafile is now:= $newdatafile"

(the line above is blank in the log file)
...then, when trying to loadinto ORACLE..

echo "Running SQL Loader now..."
echo "**** `date +%H:%M:%S` - Loading file: $newdatafile into <table name> "

sqlldr userid=$user_id \
control=$SU_TOP/ctl/CARPARK.ctl \
log=$APPLCSF/log/CARPARK.log \
bad=$APPLCSF/log/CARPARK.bad \
data=$newdatafile \
errors=1000

LRM-00116: syntax error at 'errors' following '=' .. is shown as there's no data file..

much appreciate all comments..
Steven
# 4  
Old 06-24-2008
Is the format of the newdatafile the same as the original file?
Do you have fields in your table that don't accept empty values?

I hope someone who's familiar with this stuff can give you the right solution.

Regards
# 5  
Old 06-24-2008
Yes, the format of the newdatafile IS the same as the original - all Ive done is nulled a few comma-separated fields in the file.
Also, as I created the table where the file is being loaded into I made sure that EVERY field accepts null values.

Thanks for the comments - have I got this in the right forum do you think?

Steven
# 6  
Old 06-24-2008
well, inadvertantly unix.com forum still found the answer!

Whilst reading others' posts I found when using my nawk command instead of the '1' at the end of the find and replace line, Ive used 'print' which works great!

eg.

was:- nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}}1' SLsTester_DataFile.csv > SLsOUtputFile.csv;

and now this works:

nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}} {print}' $datafile > newoutputfile.csv;
newdatafile=newoutputfile.csv;
# echo " "
echo " Modified Datafile is now:= $newdatafile"....

thanks to Franklin52 for suggestions and all for looking...
# 7  
Old 06-24-2008
This 2 commands should give the same output:Smilie

Code:
nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}}1'

nawk 'BEGIN{FS=OFS=","}{for(i=1;i<=NF;i++){if($i=="0"){$i=""}}}{print}'

Regards
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to call and sort awk script and output

I'm trying to create a shell script that takes a awk script that I wrote and a filename as an argument. I was able to get that done but I'm having trouble figuring out how to keep the header of the output at the top but sort the rest of the rows alphabetically. This is what I have now but it is... (1 Reply)
Discussion started by: Eric7giants
1 Replies

2. Shell Programming and Scripting

awk script to call another script based on second column entry

Hi I have a text file (Input.txt) with two column entries separated by tab as given below: aaa str1 bbb str2 cccccc str3 dddd str4 eee str3 ssss str2 sdf str3 hhh str1 fff str2 ccc str3 ..... ..... ..... (1 Reply)
Discussion started by: my_Perl
1 Replies

3. UNIX for Dummies Questions & Answers

Passing shell script parameter value to awk command in side the script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff |... (1 Reply)
Discussion started by: Sarita Behera
1 Replies

4. Post Here to Contact Site Administrators and Moderators

Unable to pass shell script parameter value to awk command in side the same script

Variable I have in my shell script diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk -F'~' ''$2 == "$id"' {print $0}' > $new I could see value of $id is not passing to the awk... (0 Replies)
Discussion started by: Ashunayak
0 Replies

5. Shell Programming and Scripting

Calling shell script within awk script throws error

I am getting the following error while passing parameter to a shell script called within awk script. Any idea what's causing this issue and how to ix it ? Thanks sh: -c: line 0: syntax error near unexpected token `newline' sh: -c: line 0: `./billdatecalc.sh ... (10 Replies)
Discussion started by: Sudhakar333
10 Replies

6. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

7. Shell Programming and Scripting

Help: How to convert this bash+awk script in awk script only?

This is the final first release of the dynamic menu generator for pekwm (WM). #!/bin/bash function param_val { awk "/^${1}=/{gsub(/^${1}="'/,""); print; exit}' $2 } echo "Dynamic {" for CF in `ls -c1 /usr/share/applications/*.desktop` do name=$(param_val Name $CF) ... (3 Replies)
Discussion started by: alexscript
3 Replies

8. Shell Programming and Scripting

Call shell script function from awk script

hi everyone i am trying to do this bash> cat abc.sh deepak() { echo Deepak } deepak bash>./abc.sh Deepak so it is giving me write simply i created a func and it worked now i modified it like this way bash> cat abc.sh (2 Replies)
Discussion started by: aishsimplesweet
2 Replies

9. Shell Programming and Scripting

want to pass parameters to awk script from shell script

Hello, I have this awk script that I want to execute by passing parameters through a shell script. I'm a little confused. This awk script removes duplicates from an input file. Ok, so I have a .sh file called rem_dups.sh #!/usr/bin/sh... (4 Replies)
Discussion started by: script_op2a
4 Replies

10. Shell Programming and Scripting

create a shell script that calls another script and and an awk script

Hi guys I have a shell script that executes sql statemets and sends the output to a file.the script takes in parameters executes sql and sends the result to an output file. #!/bin/sh echo " $2 $3 $4 $5 $6 $7 isql -w400 -U$2 -S$5 -P$3 << xxx use $4 go print"**Changes to the table... (0 Replies)
Discussion started by: magikminox
0 Replies
Login or Register to Ask a Question