Visit Our UNIX and Linux User Community


awk file to read values from Db2 table replacing hard coded values


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk file to read values from Db2 table replacing hard coded values
# 1  
Old 05-15-2014
awk file to read values from Db2 table replacing hard coded values

Hi,
I want to replace a chain of if-else statement in an old AWK file with values from Db2 table or CSV file. The part of code is below...
Code:
 if (start_new_rec=="true"){
    exclude_user="false";
    user=toupper($6);
    match(user, "XXXXX.[1,2,3]");
    if (RSTART ==2 ) {
        exclude_user="true";
    }

    else {
        match(user, "YYYY[AAAA,BBBB,CCCC]");
        if (RSTART ==2 ) {
            exclude_user="true";
        }
        else {

            match(user, "ZZZ[AAAA,BBBB,CCCC]");
            if (RSTART ==2 ) {
                exclude_user="true";
            }

May be I'm looking to populate an array and loop through it.Is is even possible ? any help is greatly appreciated.

Thanks
# 2  
Old 05-20-2014
Seeing from the response I think its more complicated than I thought.To make it simple can we program an .awk file to read a one column CSV file and loop through it?
# 3  
Old 05-20-2014
I really did not understand your query, please show input and desired output with brief description.
# 4  
Old 05-20-2014
Quote:
Originally Posted by Akshay Hegde
I really did not understand your query, please show input and desired output with brief description.
Sorry for not being clear in my question.

The input file will look like this, name it input.txt
Code:
a1,b1,c1,d1,e1
a2,b2,c2,d2,e2
a3,b3,c3,d3,e3

The file that contains list to compare will look like below, name it compare.txt
Code:
c2,
c5,
c20,


The awk file should compare column 3 in input.txt with compare.txt and delete rows that is in the list.

In the example above, since c2 is there in the list the row containing c2 should be deleted.
The final output is
=======================================================================
Code:
a1,b1,c1,d1,e1
a3,b3,c3,d3,e3

=======================================================================

The input.txt will contain around 10 million records and compare.txt will have around 100 entries.

Hope I made it clear.

Thanks,

Last edited by Franklin52; 05-21-2014 at 09:39 AM.. Reason: Please use code tags
# 5  
Old 05-20-2014
Code:
$ awk -F, 'FNR==NR{A[$1];next}!($3 in A)' compare.txt input.txt

# 6  
Old 05-20-2014
Quote:
Originally Posted by Akshay Hegde
Code:
$ awk -F, 'FNR==NR{A[$1];next}!($3 in A)' compare.txt input.txt

Thanks Akshay for the prompt reply but I'm getting an error as below(The name of the KSh file is remove_admin.ksh) ...

remove_admin.ksh[6]: $: not found.


Code:
#!/usr/bin/ksh
inputfile="/home/xxxx/input.csv"
comparefile="/home/xxxx/compare.csv"
touch $inputfile
touch $comparefile
$ awk -F, 'FNR==NR{A[$1];next}!($3 in A)' $comparefile $inputfile

# 7  
Old 05-20-2014
The $ is a shell prompt for illustrative purposes, not actual shell code, remove it from the front of awk.

Previous Thread | Next Thread
Test Your Knowledge in Computers #299
Difficulty: Easy
Novell bought the SUSE (then SuSE) brands and trademarks in 2003.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read values from second file in awk

Hello Friends, I have written a script like the following, which finds some logs and fetchs some desired rows and then calculate average processing time of a spesific application. if then echo echo "----- There are three arguments which is expected to run this script! ... (5 Replies)
Discussion started by: EAGLА
5 Replies

2. Shell Programming and Scripting

Read record from the text file contain multiple separated values & assign those values to variables

I have a file containing multiple values, some of them are pipe separated which are to be read as separate values and some of them are single value all are these need to store in variables. I need to read this file which is an input to my script Config.txt file name, first path, second... (7 Replies)
Discussion started by: ketanraut
7 Replies

3. Shell Programming and Scripting

Query the table and return values to shell script and search result values from another files.

Hi, I need a shell script, which would search the result values from another files. 1)execute " select column1 from table_name" query on the table. 2)Based on the result, need to be grep from .wft files. could please explain about this.Below is the way i am using. #!/bin/sh... (4 Replies)
Discussion started by: Rami Reddy
4 Replies

4. Shell Programming and Scripting

Read parameter file in a shell script to unload a DB2 Table???

Hi , I Have following requirement: DB2 Sql query to pass from a parameter file for example, I would create a parameter file with (SELECT column 1, column 2 FROM Table name) then job would read it and create a file with the contents named table.txt How to write/modify below ksh script to... (10 Replies)
Discussion started by: developer.dwh9
10 Replies

5. Shell Programming and Scripting

Replacing values in a file based on values in another file

Hi I have 2 files:- 1. List of files which consists of names of some output files. 2. A delimited file; delimted by "|" I want to replace the value of the $23 (23rd column) in the delimited file with name in the first file. It is always position to position. Meaning first row of the first... (5 Replies)
Discussion started by: pparthiv
5 Replies

6. Shell Programming and Scripting

select values from db1 table and insert into table of DB2

Hi I am having three oracle databases running in three different machine. their ip address is different. from one of the DB am able to access both the databases.(means am able to select values and insert values in to tables individually.) I need to fetch some data from DB1 table(say DB1 ip is... (2 Replies)
Discussion started by: aemunathan
2 Replies

7. Shell Programming and Scripting

AWK: read values from file1; search for values in file2

I have read another post about this issue and am wondering how to adapt it to my own, much simpler, issue. I have a file of user IDs like so: 333333 321321 546465 ...etc I need to take each number and use it to print records wherein the 5th field matches the user ID pulled from the... (2 Replies)
Discussion started by: Bubnoff
2 Replies

8. Shell Programming and Scripting

Reading values from a file using DB2 SQL

I have some alphbetical codes in that (1 Reply)
Discussion started by: kavithakuttyk
1 Replies

9. Shell Programming and Scripting

Replacing File values

Currently I am using the tr command in 3 scenarios for a ksh script. 1) Replacing any spaces in the file with a ~ tr ' ' '~' <$orignalFile> $newFile 2) After certain processing is done at the end of the scirpt i convert the Tilde back to spaces tr ' ' '~' <$newFile> $newFile2 3) Last... (4 Replies)
Discussion started by: hgjdv
4 Replies

10. UNIX for Advanced & Expert Users

Converting Binary decimal coded values to Ascii Values

Hi All, Is there any command which can convert binary decimal coded values to ascii values... i have bcd values like below оооооооооооо0о-- -v - Pls suggest a way to convert this. Thanks, Deepti.Gaur (3 Replies)
Discussion started by: gaur.deepti
3 Replies

Featured Tech Videos