Shell Programming and Scripting

Hi,

I have some 2000 names in a table like below.

Code:

Java
Oracle/SQL
ANSI SQL
SQL,DWH,DB
DB&Java

And by using for loop in my code i am able to get a single word but if there is any special character or space then it is considering as a next line.

I have to execute the below queries in looping.

Code:

course=select course from table group by 1 order by 1;

Code:

create table table2 as
select * from table where course=$course;
Query3
Query4...

Above set of queries used to execute with different course each time.

I tried using while loop with no luck and unsure what exactly is missing in my code.

Thanks.

I would perhaps be able to tell you that, provided i could see it. As it is my crystal ball is currently in repair and i cannot see the code on your computer from here.

I can still tell you how to write a while-loop, though, because it should provide exactly what you want:

Code:

....
InFile="/path/to/your/inputfile"
line=""

while read line ; do
     echo "the line read: $line"
done < "$InFile"

This will read the content of the (text-)file "/path/to/your/inputfile" and output it line by line with a prefixed text of "the line read: ". The content of the line in question is in the variable "line" which you can use to base your own code on.

Notice that this will fail if the file is DOS-style formatted (that is, has CR/LF-line separators instead of the UNIX-style newline characters).

If the file contains things you want to filter out before processing it (like i.e. shell-style comments) you can use a filter to pipe into the while-loop like this (replace "<b>" and "<t>" with literal blank/tab characters, the sed-command removes leading/trailing whitespace, comments and empty lines):

Code:

....
InFile="/path/to/your/inputfile"
line=""

sed 's/#.*//;s/^[<b><t>]*//;s[<b><t>]*$//;/^$/d' "$InFile" |\
while read line ; do
     echo "the line read: $line"
done

I hope this helps.

bakunin

Thanks for the quick response!

I am using netezza sql query like below, and the table contains some 2k records in it.
I want to read the result record by record and pass it in the next set of sql steps.

Code:

course=select course from table group by 1 order by 1;
N=0
for course in `nzsql -host -d db -Atc "course=select course from table group by 1 order by 1;"` ; do
   
      test[$N]="$course"
      echo "$N = $course"     #to confirm the entry
       
  let "N= $N + 1"
create table table2 as
select * from table where course=$course;
One more query here..Query2
Query3

when i use the above for loop it is reading the string line by line but if i have space or special characters between the string then it is considering as next line.
table contains the data like below.

Code:

Java
Oracle/SQL
ANSI SQL
SQL,DWH,DB
DB&Java

Above piece of code is taking the first line Java but when coming to the next line, it is splitting and taking the first word in $course.

Your code sample seems to mix sql and shell code and thus doesn't make sense to me, but that may be my fault. Did you consider deploying bakunin's proposal, i.e. replacing your for loop with a while read loop? As the for construct splits arguments on spaces (although not on "/")

Thanks Rudic and Bakunin for your inputs!

Actually i am able to read it from file but unable to get it from the query result.

Did you consider piping the query results into a while read ... loop? Alternatively, recent shells (your version of which you fail to mention) offer "process substitution" which is another mechanism to feed a command's / process' output into the stdin of other commands.

Tried the below code but it couldn't worked fro me.

Code:

IFS=''
while read course
do
echo $course
done < <(course=`nzsql -host -d db -Atc "select course from table group by 1 order by 1;"`)

For now, i have created a a file from query result and reading from the file.

And i have 2k course names in the table/file, so i have to schedule it in batch wise like 100 courses at a time for the execution on my database.I never tried this before and would it be possible for you to suggest a way how to schedule this requirement as batch jobs