There is no duplicate detection in sqlldr itself. It depends on constraints defined on the the table.
You will have to prepare your inputfile. You want to reject duplicate rows, duplicate equal the first two columns in separate rows are equal. If there are differences - missing column 3 - then prefer the row with three columns, otherwise just use the first of the duplicates. You have to sort in reverse order to guarantee that, in the case of duplicates, the row with data in column 3 comes first. Then eliminate duplicates.
This does that for you:
Code:
sort -r -o inputfile inputfile # keep the file intact to review data if there is a problem
awk '!arr[ $1 $2 ]++' inputfile > file_to_load_into_oracle # eliminate duplicates as defined by you
hi all
can anyone please let me know if there is a way to find out duplicate rows in a file. i have a file that has hundreds of numbers(all in next row).
i want to find out the numbers that are repeted in the file.
eg.
123434
534
5575
4746767
347624
5575
i want 5575
please help (3 Replies)
I have a file content like below.
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""... (5 Replies)
I have searched the internet for duplicate row extracting.
All I have seen is extracting good rows or eliminating duplicate rows.
How do I extract duplicate rows from a flat file in unix.
I'm using Korn shell on HP Unix.
For.eg.
FlatFile.txt
========
123:456:678
123:456:678
123:456:876... (5 Replies)
Hi all,
I have written one shell script. The output file of this script is having sql output.
In that file, I want to extract the rows which are having multiple entries(duplicate rows).
For example, the output file will be like the following way.
... (7 Replies)
Hi! I have a file as below:
line1
line2
line2
line3
line3
line3
line4
line4
line4
line4
I would like to extract duplicate lines (not unique, triplicate or quadruplicate lines). Output will be as below:
line2
line2
I would appreciate if anyone can help. Thanks. (4 Replies)
Dear Experts,
Kindly help me please,
I have a big file where there is duplicate values in col 11 till col 23, every 2 rows appers a new numbers, but in each row there is different coordinates x and y in col 57 till col 74.
Please i will like to get a single value and average of the x and y... (8 Replies)
I want to duplicate each row in my file
Egfile.txt
Name State Age
Jack NJ 34
John MA 23
Jessica FL 45
I want the code to produce this output
Name State Age
Jack NJ 34
Jack NJ 34
John MA 23
John MA 23
Jessica FL 45
Jessica FL 45 (6 Replies)
How can i get the duplicates rows from a file using unix, for example i have data like
a,1
b,2
c,3
d,4
a,1
c,3
e,5
i want output to be like
a,1
c,3 (4 Replies)
Discussion started by: ggupta
4 Replies
LEARN ABOUT LINUX
drop_table
DROP TABLE(7) SQL Commands DROP TABLE(7)NAME
DROP TABLE - remove a table
SYNOPSIS
DROP TABLE [ IF EXISTS ] name [, ...] [ CASCADE | RESTRICT ]
DESCRIPTION
DROP TABLE removes tables from the database. Only its owner can drop a table. To empty a table of rows without destroying the table, use
DELETE [delete(7)] or TRUNCATE [truncate(7)].
DROP TABLE always removes any indexes, rules, triggers, and constraints that exist for the target table. However, to drop a table that is
referenced by a view or a foreign-key constraint of another table, CASCADE must be specified. (CASCADE will remove a dependent view
entirely, but in the foreign-key case it will only remove the foreign-key constraint, not the other table entirely.)
PARAMETERS
IF EXISTS
Do not throw an error if the table does not exist. A notice is issued in this case.
name The name (optionally schema-qualified) of the table to drop.
CASCADE
Automatically drop objects that depend on the table (such as views).
RESTRICT
Refuse to drop the table if any objects depend on it. This is the default.
EXAMPLES
To destroy two tables, films and distributors:
DROP TABLE films, distributors;
COMPATIBILITY
This command conforms to the SQL standard, except that the standard only allows one table to be dropped per command, and apart from the IF
EXISTS option, which is a PostgreSQL extension.
SEE ALSO
ALTER TABLE [alter_table(7)], CREATE TABLE [create_table(7)]
SQL - Language Statements 2010-05-14 DROP TABLE(7)