Read a CSV file and generate SQL output


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Read a CSV file and generate SQL output
# 8  
Old 06-08-2011
hello!, but there is a requirement to do it with shell scripts, so that we have our own environment set up to execute it in appworx... it will be scheduled everymonth and this script will be executed automatically.

Also, what Anchal has almost solved the purpose. my only question is instead of going it by column alone, i would like to make it go by row also...
# 9  
Old 06-08-2011
Would you please explain with an example and expected output (queries).
# 10  
Old 06-08-2011
For this input:
Code:
1000,Y,$2 ,10000,Students Plan
1001,M,$2 ,10001,Professional Plan
1002,M,$3 ,10002,Talk 199
1003,Y,$5 ,10003,Simple 30
1004,M,$3 ,10004,Flat 300

The insert is:
Code:
insert into elements values (1000, 'Y',10000);
insert into descriptions values (10000,'Students Plan');  

insert into elements values (1001, 'M',10001);
insert into descriptions values (10001,'Professional Plan');
.......

but i would like it coming this way:
Code:
insert into elements values (1000, 'Y',10000);
insert into elements values (1001, 'M',10001);
.....
insert into descriptions values (10000,'Students Plan');  
insert into descriptions values (10001,'Professional Plan');
......

i mean, all inserts of 1 table should be accumulated together, instead of having it in mixture.

Thanks in advance....

Last edited by Franklin52; 06-09-2011 at 03:15 AM.. Reason: Please use code tags
# 11  
Old 06-08-2011
Piping output to sort should work for you..

.... | sort

i.e.
Code:
while IFS="," read c1 c2 c3 c4 c5
do
 echo "insert into table1 values ($c1,$c2,$c3,$c4,'$c5');"
done < csv_file | sort

# 12  
Old 06-15-2011
Friends, please help me with this: i have the following csv file:

Cat, 4
Cat, 4
Cat, 3
Rat, 4
Rat, 5
Cow,6

This csv file is parsed and found that it contains Cat, Rat, Cow in it. now i have to check if it contains 3 different values, if so i have to perform an action.

if it contains, just Cat and Rat, i have to perform a different action;

or if it contains just Rat and Cow, i have to perform a different action.

but please note, i should check only the distinct values of them and store in a variable.
# 13  
Old 06-15-2011
Code:
 
awk -F"," -v v1="Cat" -v v2="Rat" -v v3="Cow" '{ a[$1]++ }
   END {
   if ( a[v1] >= 1 && a[v2] >= 1 && a[v3] >= 1 ) print "all";
   if ( a[v1] >= 1 && a[v2] >= 1 && a[v3] < 1 ) print "1 and 2";
   if ( a[v1] < 1  && a[v2] >= 1 && a[v3] >= 1 ) print "2 and 3";
   }' rem

# 14  
Old 06-15-2011
Thank you, but please to explain...
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Not able to write SQL query output in to .csv file with shell script.

I am trying to write SQL query output into a .csv file. But in the output columns are displaying in different lines instead of coming in one line. Main Code shell script: this is my code: #!/bin/bash file="db_detail.txt" . $file rm /batch/corpplan/bin/dan.csv... (6 Replies)
Discussion started by: sandeepgoli53
6 Replies

2. Shell Programming and Scripting

ksh - Read input from file and output CSV i same row

Hello I have the following output and want the output to look: FROM: GigabitEthernet0/0 is up, line protocol is up 1 input errors, 0 CRC, 0 frame, 1 overrun, 0 ignored 275 output errors, 0 collisions, 3 interface resets GigabitEthernet0/1 is up, line protocol is up 0... (4 Replies)
Discussion started by: JayJay2018
4 Replies

3. Shell Programming and Scripting

Script to generate Excel file or to SQL output data to Excel format/tabular format

Hi , i am generating some data by firing sql query with connecting to the database by my solaris box. The below one should be the header line of my excel ,here its coming in separate row. TO_CHAR(C. CURR_EMP_NO ---------- --------------- LST_NM... (6 Replies)
Discussion started by: dani1234
6 Replies

4. Shell Programming and Scripting

Convert sql output to csv file via bash tools

hi Can anybody help me with converting such structure into csv file for windows : BAT_ID ID_num CVS_LINE A_SEG SKILL_TO A_CUSTOMER_TYPE --------- ---------- --------------------------------- ---------- ------------------ ----------- 14-MAY-11 777752 ... (4 Replies)
Discussion started by: kvok
4 Replies

5. Shell Programming and Scripting

to read a CSV file and generate SQL output

Friends, This is what I need: I will pass a CSV file as an input, and I want my shell to be reading that CSV file, and based on the parameters it should generate SQLs and write those SQL in a different file in the same location. I'm new to Shell scripting. I'm currently working on a... (1 Reply)
Discussion started by: Ram.Math
1 Replies

6. Shell Programming and Scripting

generate PDF document on UNIX (not with GUI) from SQL*Plus output

Hi I wish to generate from CSV output of SQL*Plus a PDF. I use a Solaris 10 box. Which Open Source software can do that on CLI? (4 Replies)
Discussion started by: slashdotweenie
4 Replies

7. Shell Programming and Scripting

formatting into CSV format of SQL session output

I am getting a no of fields from a SQL session (e.g. select a,b,c from table). How do I convert the output values into CSV format . The output should be like this 'a','b','c', (4 Replies)
Discussion started by: mady135
4 Replies

8. Shell Programming and Scripting

SQL Script's output to a CSV file

I need to call and execute an SQL script within a KSH script and get the output/extracted data into a CSV file. Is there any way to get the out put in a CSV file other than spooling ? I tried spooling. Problem is if there is any wrning/comment/Error they all will be spooled into the csv file. I... (4 Replies)
Discussion started by: Sriranga
4 Replies

9. Shell Programming and Scripting

How to use sql data file in unix csv file as input to an sql query from shell

Hi , I used the below script to get the sql data into csv file using unix scripting. I m getting the output into an output file but the output file is not displayed in a separe columns . #!/bin/ksh export FILE_PATH=/maav/home/xyz/abc/ rm $FILE_PATH/sample.csv sqlplus -s... (2 Replies)
Discussion started by: Nareshp
2 Replies

10. Shell Programming and Scripting

need help in Parsing a CSV file and generate a new output file

Hi Scripting Gurus, I am trying to parse a csv file and generate a new output file. The input file will be a variable length in turns of rows and columns. output file will have 8 columns. we have three columns from the header for each set. just to give little bit more clarification each row... (15 Replies)
Discussion started by: vkr
15 Replies
Login or Register to Ask a Question