Inserting records from flat file to db table


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Inserting records from flat file to db table
# 1  
Old 12-27-2006
Inserting records from flat file to db table

I have 20000 numbers present in a file in each line like

25663,
65465,
74579,
56446,
..
..

I have created a table in db with single number column in it.

create table testhari (no number(9));

I want to insert all these numbers into that table. how can i do it?

can anybody please help..

Please don't suggest to loop 20000 times and connect to db each time using sql plus.. using "while read line do .. done"
# 2  
Old 12-27-2006
Quote:
Please don't suggest to loop 20000 times and connect to db each time using sql plus.. using "while read line do .. done"
Whats wrong with the while read line ?!? Smilie Smilie
Anyway, since you mention sqlplus im guessing you work with oracle database which is good since it has feature designed for that kind of task 'sqlldr'
Code:
sqlldr yourdbacctname control=input.ctl log=haritest.log

the content of input.ctl
Code:
load data 
infile thefilewithno 
into table testhari (no)

# 3  
Old 12-27-2006
use sqlldr

what database you are using?

use sqlldr.

Eg:

LOAD DATA INFILE * APPEND INTO TABLE <<Tablename>> FIELDS TERMINATED BY "," TRAILING NULLCOLS
(<<fieldname>> INTEGER EXTERNAL)

make it as file.ctl

and then use sqlldr like this

${ORACLE_HOME}/bin/sqlldr userid=${USERPASS} control=<<path>>/file.ctl log=<<path>>/<<filename>>.log data=<<path>>/<<20000filename>> errors=1000 &
# 4  
Old 12-27-2006
Quote:
Originally Posted by cskumar
what database you are using?

use sqlldr.

Eg:

LOAD DATA INFILE * APPEND INTO TABLE <<Tablename>> FIELDS TERMINATED BY "," TRAILING NULLCOLS
(<<fieldname>> INTEGER EXTERNAL)

make it as file.ctl

and then use sqlldr like this

${ORACLE_HOME}/bin/sqlldr userid=${USERPASS} control=<<path>>/file.ctl log=<<path>>/<<filename>>.log data=<<path>>/<<20000filename>> errors=1000 &



Worked pretty good.. thanks a lot Mr.kumar

Sorry, i ve not mentioned my database ie ORACLE.

Problem with while read line is
For me, connecting to db each time is very expensive using sqlplus.. And i can't even imagine it for 20000 times.. Anyways.. thanx a lot for sqlldr option
# 5  
Old 12-27-2006
MySQL Welcome -Free utility.

I also like to share one freeware for loading excel data into oracle.(Oracle 9i+)
Download the exe from http://www.oraxcel.com

As your data is comma separated u can open it excel
and can play with the data.

I hope this might be a very good link.

Smilie


Regards,
cskumar.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Error inserting a clob file into DB table

Hi all, I am reading control file log from my server and putting it to a variable for j in $(cat $dirname/ctl_file.log) do if then Y=${#fileclob_ctl_file} if then fileclob_ctl_file=$j else fileclob_ctl_file="${fileclob_ctl_file},${j}" fi fi ... (5 Replies)
Discussion started by: Pratiksha Mehra
5 Replies

2. Shell Programming and Scripting

URGENT HELP!!! Extracting db table into flat file

Hi All, I am writing a shell script to extract oracle table into a pipe dilemited flat file. Below is my code and I have attached two files that I have abled to generate so far. 1. Table.txt ==> database extract file 2. flat.txt ==> pipe delimited after some manipulation of the original db... (0 Replies)
Discussion started by: express14
0 Replies

3. UNIX for Dummies Questions & Answers

Inserting a sequential number into a field on a flat file

I have a csv flatfile with a few million rows. I need to replace a field (field number is 85) in the file with a sequential number. As an example, let's assume there are only 4 fields in the file: A,A,,32 A,A,,27 A,B,,43 C,C,,354 If I wanted to amend the 3rd field in this way my... (2 Replies)
Discussion started by: BristolSmithy
2 Replies

4. Shell Programming and Scripting

Remove somewhat Duplicate records from a flat file

I have a flat file that contains records similar to the following two lines; 1984/11/08 7 700000 123456789 2 1984/11/08 1941/05/19 7 700000 123456789 2 The 123456789 2 represents an account number, this is how I identify the duplicate record. The ### signs represent... (4 Replies)
Discussion started by: jolney
4 Replies

5. Shell Programming and Scripting

Load data to flat file from table.

Hi all, I need to know how to copy data from a table say ABC to a flat file say XYZ.dat in unix, Please leave ur comments and the fastest way to do so, I need to load the table records into flat file. Regards Ann (4 Replies)
Discussion started by: Haque123
4 Replies

6. Shell Programming and Scripting

How do I load records from table to a flat file!

Hi All, I need to load records from oracle table XYZ to a flat file say ABC.dat. could any one tell me how do i do this in UNXI, Regards Ann (1 Reply)
Discussion started by: Haque123
1 Replies

7. Shell Programming and Scripting

inserting data into a table from a flat file

Hi, I want to insert data into a table from a flat file, the file is having around 25 columns and some 10,000 records. The columns values are seperated by a space. Thanks (1 Reply)
Discussion started by: ss_ss
1 Replies

8. Shell Programming and Scripting

Sorting the records in the Flat file

Hi all, I am using this command "sort -d -u -k1 IMSTEST.74E -o tmp.txt" to the records in the flat. Can any tell me how to sort the file except first line in the file For ex: i/p First line: DXYZ Second line : jumy third : cmhk fourth : andy Output should... (5 Replies)
Discussion started by: sudhir_barker
5 Replies

9. Shell Programming and Scripting

How to delimit a flat file with records with SED

Hi gurus, hoping someone can help with a sed line that can do the following... I have a flat file with about 1000 records, but in order to import into openoffice spreadsheet, I need to create a delimited file. I'd like to do 2 things with the SED command: 1- add a pipe character "|" at the end... (4 Replies)
Discussion started by: RogCor
4 Replies

10. Shell Programming and Scripting

Inserting Values From A File Into A Table

Guys, I want to insert some values from a log file into a temporary table. the values in the log file looks like this SV_NAME CC_NAME CP_DISP_RUN_STATE ------- ------------------- ----------------- sble01 ALLTEL WorkMon24Hrs Running I want to enter the... (2 Replies)
Discussion started by: ragha81
2 Replies
Login or Register to Ask a Question