10-30-2008
ksh scripting: Extract 1 most recent record for unique key
I'm loading multiple delimited files into an Oracle DB using sqlldr on Unix. I would like to get only the most recent record per each unique key. There may be multiple updates for each key, but I only want the most recent one.
There is a date column in my delimited files, so I'm using cat to combine multiple files into one file, then I sort that file in descending order by date, using the unix sort command.
When I load with sqlldr, I have a unique key restraint on my Oracle table, so I'm grabbing the first occurrence for each key (the most recent, since they're in *descending* order by date) and throwing away the rest (the earlier out-of-date ones), but it seems to me that it's very inefficient, and it creates a huge amount of "errors" in my sqlldr log file (I don't want to use the SILENT=errors option, or put my errors in /dev/null, since there may be genuine errors that I don't want to miss.)
Is there some way to get those "first" (most recent) occurrences using Unix scripting, instead of doing it in sqlldr?
Thanks,
OP
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Using SCO 5, Ksh here
I am trying to automate some process that i am doing manually.
During some point of time, I will have to press enter to clear away some messages.
This is how I do manually.
*one command*
r
r
r
r
r
I enter the command once, then press enter key 1 more... (6 Replies)
Discussion started by: khaos83_2000
6 Replies
2. Shell Programming and Scripting
input
a 1
a 2
a -1
b 1
b 2
b 3
output
a -1
b 1
Thanx
---------- Post updated at 09:42 PM ---------- Previous update was at 09:10 PM ----------
Ok I managed it (7 Replies)
Discussion started by: repinementer
7 Replies
3. Shell Programming and Scripting
I found some posts describing how to completely clean out a mailbox in Unix/Linux. But I want to keep the 50 most recent messages. Any ideas out there?
Thanks! (3 Replies)
Discussion started by: OPTIMUS_prime
3 Replies
4. Shell Programming and Scripting
Hi Everyone,
Using shell script i am getting final file as attached below. In this 4th column value should be unique using any sequence.
for instance I've 1_13020_SSGM which is appearing 6 times in file and i should change it like 1_13020_SSGM_1,1_13020_SSGM_2,....1_13020_SSGM_6.
Can someone... (4 Replies)
Discussion started by: gehlnar
4 Replies
5. Shell Programming and Scripting
On a very new (11.31) hpux machine, I can no longer execute shell fragements like:
if ; then
. .profile.foo
fi
and get "ksh: test: argument expected"
if I convert this to -d or -f as appropriate (which I've not had to do on older versions of hpux (11.23) nor any other unix platform... (9 Replies)
Discussion started by: Peeter Joot
9 Replies
6. Shell Programming and Scripting
Hi,
I think this is the toughest prob :wall: I have ever come across and I thankfully owe all of u for helping me cross this.
cat 1.txt
cat 2.txt
K now. This is what I am looking for.
Output.txt
Here is how my output has been generated.
First, the column one of each file... (6 Replies)
Discussion started by: jacobs.smith
6 Replies
7. Shell Programming and Scripting
Hi,
How to add trailer record at the end of the flat file in the unix ksh shell scripting
can you please let me know the procedure
Regards
Srikanth (3 Replies)
Discussion started by: srikanth_sagi
3 Replies
8. Shell Programming and Scripting
I have test.xml
<emp><id>101</id><name>AAA</name><date>06/06/14 1811</date></emp>
<Join><id>101</id><city>london</city><date>06/06/14 2011</date></join>
<Join><id>101</id><city>new york</city><date>06/06/14 1811</date></join>
<Join><id>101</id><city>sydney</city><date>06/06/14... (2 Replies)
Discussion started by: vsraju
2 Replies
9. Shell Programming and Scripting
Hello,
I have a sample file with the below contents :
Backup Oracle8_P112_PEGA_Archivedel Completed full 10/11/2015 03:50:06PM
Backup Oracle8_G567_PEGA_Archivedel Completed full 10/11/2015 01:15:56PM
Backup Oracle8_P112_PEGA_Archivedel Completed full ... (8 Replies)
Discussion started by: rahul2662
8 Replies
10. Shell Programming and Scripting
Hi,,
I have requirement that i need to get DISTINCT values from a table and if there are two records i need to update it to one record and then need to submit INSERT statements by using the updated value as a parameter. Here is the example follows..
SELECT DISTINCT ID FROM OFFER_GROUP WHERE... (1 Reply)
Discussion started by: Samah
1 Replies
suspend(1) User Commands suspend(1)
NAME
suspend - shell built-in function to halt the current shell
SYNOPSIS
sh
suspend
csh
suspend
ksh
suspend
DESCRIPTION
sh
Stops the execution of the current shell (but not if it is the login shell).
csh
Stop the shell in its tracks, much as if it had been sent a stop signal with ^Z. This is most often used to stop shells started by su.
ksh
Stops the execution of the current shell (but not if it is the login shell).
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWcsu |
+-----------------------------+-----------------------------+
SEE ALSO
csh(1), kill(1), ksh(1), sh(1), su(1M), attributes(5)
SunOS 5.10 15 Apr 1994 suspend(1)