05-03-2014
Parallel sqlldr to load data.
I am using SQLLDR to load data in DB.For parallel loading I'm using nohup command.
The requirement is:
I have different files within a directories.
Ex: 1) Dir/folder_A/AE.txt
2) Dir/folder_A/DM.txt
3) Dir/folder_B/CM.txt
I need to loop through directories and load the data parallelly in Database table.
The problem is: if the file is being loaded I need to check if another file from same directory is still loading then this new file should wait for previous to complete load else this new file will start loading data parallely.
ex : if AE.txt is already loading and DM.txt comes then it should check if DM.txt is also from folder_A,if yes then check if AE.txt is still loading the data ,if yes then wait for it to finish else load DM.txt,when other file CM.txt comes in since it is in folder_B it can start loading data no matter DM.txt is still l loading or not.
Please help!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hi all
need your help.
I am wrting a script that will load data into the table.
then on another load will append the data into the existing table.
Regards
Ankit (1 Reply)
Discussion started by: ankitgupta
1 Replies
2. Shell Programming and Scripting
I'm new in Unix shell scripting and i need someone to help me to make Script that run all time watching my directory that files uploaded to it via FTP (/mydir/incoming_files), if any files exists in it then (if many files exists, then sort files and load them ascending) it‘ll checks the size of the... (1 Reply)
Discussion started by: m_fighter
1 Replies
3. Shell Programming and Scripting
Hi all,
How to load variable value into Oracle table? I have created a file validation shell script. After the validation completes, i need to update a Oracle table with the variable value...
Can someone help me how to do it? I have searched, but not able to get answer.
i have 4... (1 Reply)
Discussion started by: Amit.Sagpariya
1 Replies
4. Shell Programming and Scripting
Hi all,
How to load variable value into Oracle table? I have created a file validation shell script. After the validation completes, i need to update a Oracle table with the variable value...
Can someone help me how to do it? I have searched, but not able to get answer.
i have 4 variables... (2 Replies)
Discussion started by: Amit.Sagpariya
2 Replies
5. Shell Programming and Scripting
Hi all,
I need to know how to copy data from a table say ABC to a flat file say XYZ.dat in unix,
Please leave ur comments and the fastest way to do so,
I need to load the table records into flat file.
Regards
Ann (4 Replies)
Discussion started by: Haque123
4 Replies
6. Shell Programming and Scripting
I have a csv file in a folder that is roughly 500,000 rows long.
Rather than using PHP, I would like to use SH to run a MYSQL LOAD DATA command to load the data in, as I think it would be much faster and would not cause any memory problems associated with PHP.
But the problem is, I am not... (18 Replies)
Discussion started by: worchyld
18 Replies
7. Shell Programming and Scripting
Hello all,
I know this is Unix forum, but i also know that there are some experts here who can help me out with this situation;
I am loading a data file into oracle table using Perl script by calling sqlldr script.
It does not do anything, and no data is getting loaded.
Any help,... (2 Replies)
Discussion started by: msrahman
2 Replies
8. Shell Programming and Scripting
Hi All,
I am trying to capture the data in linux .While doing load test.
is there's any sample script please help me.
Linux test4 2.6.18-308.8.1.el5 #1 SMP Fri May 4 16:43:02 EDT 2012 x86_64 x86_64 x86_64 GNU/Linux
Thanks, (5 Replies)
Discussion started by: sam1226
5 Replies
9. UNIX for Dummies Questions & Answers
Hi,
i have some data in a temporary file in Unix (the data is taken from the result of an SQL query). Now i want to dump that data into an excel sheet. How to do that. Someone please advise. Thanks
Regards,
Vinit (3 Replies)
Discussion started by: vinit raj
3 Replies
10. Shell Programming and Scripting
Hi ,
I am using below control file
LOAD DATA
APPEND
INTO TABLE LSHADMIN.EG
TRAILING NULLCOLS
(
STUDY CHAR
)
and the text file to load data is
CACZ885M2301
When I run below command:
sqlldr userid=apps/apps control=/home/appsuser/dataload/ctl_file.ctl... (3 Replies)
Discussion started by: Pratiksha Mehra
3 Replies
LEARN ABOUT REDHAT
mac2unix
dos2unix(1) General Commands Manual dos2unix(1)
NAME
dos2unix - DOS/MAC to UNIX text file format converter
SYNOPSYS
dos2unix [options] [-c convmode] [-o file ...] [-n infile outfile ...]
Options:
[-hkqV] [--help] [--keepdate] [--quiet] [--version]
DESCRIPTION
This manual page documents dos2unix, the program that converts plain text files in DOS/MAC format to UNIX format.
OPTIONS
The following options are available:
-h --help
Print online help.
-k --keepdate
Keep the date stamp of output file same as input file.
-q --quiet
Quiet mode. Suppress all warning and messages.
-V --version
Prints version information.
-c --convmode convmode
Sets conversion mode. Simulates dos2unix under SunOS.
-o --oldfile file ...
Old file mode. Convert the file and write output to it. The program default to run in this mode. Wildcard names may be used.
-n --newfile infile outfile ...
New file mode. Convert the infile and write output to outfile. File names must be given in pairs and wildcard names should NOT be
used or you WILL lost your files.
EXAMPLES
Get input from stdin and write output to stdout.
dos2unix
Convert and replace a.txt. Convert and replace b.txt.
dos2unix a.txt b.txt
dos2unix -o a.txt b.txt
Convert and replace a.txt in ASCII conversion mode. Convert and replace b.txt in ISO conversion mode. Convert c.txt from Mac to Unix
ascii format.
dos2unix a.txt -c iso b.txt
dos2unix -c ascii a.txt -c iso b.txt
dos2unix -c mac a.txt b.txt
Convert and replace a.txt while keeping original date stamp.
dos2unix -k a.txt
dos2unix -k -o a.txt
Convert a.txt and write to e.txt.
dos2unix -n a.txt e.txt
Convert a.txt and write to e.txt, keep date stamp of e.txt same as a.txt.
dos2unix -k -n a.txt e.txt
Convert and replace a.txt. Convert b.txt and write to e.txt.
dos2unix a.txt -n b.txt e.txt
dos2unix -o a.txt -n b.txt e.txt
Convert c.txt and write to e.txt. Convert and replace a.txt. Convert and replace b.txt. Convert d.txt and write to f.txt.
dos2unix -n c.txt e.txt -o a.txt b.txt -n d.txt f.txt
DIAGNOSTICS
BUGS
The program does not work properly under MSDOS in stdio processing mode. If you know why is that so, please tell me.
AUTHORS
Benjamin Lin - <blin@socs.uts.edu.au>
Bernd Johannes Wuebben (mac2unix mode) <wuebben@kde.org>
MISCELLANY
Tested environment:
Linux 1.2.0 with GNU C 2.5.8
SunOS 4.1.3 with GNU C 2.6.3
MS-DOS 6.20 with Borland C++ 4.02
Suggestions and bug reports are welcome.
SEE ALSO
unix2dos(1) mac2unix(1)
1995.03.31 dos2unix v3.0 dos2unix(1)