Executable doesn't complete on large files


 
Thread Tools Search this Thread
Operating Systems AIX Executable doesn't complete on large files
# 1  
Old 10-16-2009
Question Executable doesn't complete on large files

Good morning,

I have an executable called DataExport (not that the name means much), but anyhow, it is a job that runs to call oracle stored procs which then export data out to a text file. Depending on which export is calling the DataExport, different stored procs are run. Exports 1, 2 and 3 all succeed in that the last thing DataExport does is once the file has completely come out of Oracle and is in the text file, the DataExport program moves the file to an Output folder.

The problem I am encountering is that Exports 4 & 5 produce very large files and take significantly longer (721499383 bytes in about 40 minutes compared with 75564 in about 2 minutes) and they don't ever get moved to the Output folder. I have put tracing into the executable to see what it is doing at the very end and there is nothing to indicate why it doesn't complete the job of moving the file to the Output folder. Here, for example, are the last four lines of the trace:

Code:
SVEInputTableClass::Setting field data. Getting next record
SVEInputTableClass::GetNextRecord. Getting next record
SVEInputTableClass::Setting field data. Getting next record
SVEInputTableClass::GetNextRecord. Getting next record

Prior to that are thousands of those exact same lines. So the question becomes, is there any setting in AIX that kills a pid or stops a pid if it hits a certain limit of memory or diskspace?
# 2  
Old 10-16-2009
Maybe the problem is Oracle. I would check there.
# 3  
Old 10-17-2009
Bug

yeah, I've asked the customer's DBA to check on that. Hopefully he will find something because I think the answer from an AIX forum is that there are no such limits except for the hard physical limits which in this case I know we are not hitting for disk space but I'm not 100% sure about memory.

---------- Post updated at 11:14 PM ---------- Previous update was at 05:26 PM ----------

I never got a reply from the DBA, however, I managed to figure something out - the program that calls the DataExport has two settings - Number of Records and Number of Loops which were respectively set at 100,000 and 100. This is how the datafiles ended up being so large, so I set the Number of Loops to 1 to limit the size of the file (increasing the number of files) and this is now working.

Though few of you replied, I am always grateful for the existence of unix.com.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

[Bash] passing variables to executable doesn't work

Bash version 4.4.20 / Ubuntu 16.0.4 Hello, I tried to write a script that gathers some data and passes them to an executable. The executed application answers with an error. The echo output in the script returns correct values. If I copy/paste the last echo command, it get's executed... (2 Replies)
Discussion started by: sushi2k7
2 Replies

2. Red Hat

ACLs - How can i create new executable files

Hello experts, I would like to know if is possible to create a default acl rule to a directory. in this directory all files created should have executable permissions by the group IT. i tried setfacl -m d:g:it:rwx /files tried to change the mask setfacl -m m::rwx /files but i still... (3 Replies)
Discussion started by: berveglieri
3 Replies

3. UNIX for Dummies Questions & Answers

Help with sorting executable files in shell

Hi!I'm new in this forum,also in shell scripting! :P I'd like to help me with an issue!the project wants to make a variable with a directory(any) and then print all executable files of this directory,sorted by size!Thank you! (8 Replies)
Discussion started by: strawhatluffy
8 Replies

4. UNIX for Dummies Questions & Answers

executable files

hello. My question, basically is: what is the definition of unix/linux exec files, or what makes a file executable? More specifically, must a unix source file that was compiled using gcc have exec permissions in order to be considered executable? Is it right to say that a unix/linux exec file... (1 Reply)
Discussion started by: nadavkri
1 Replies

5. UNIX for Dummies Questions & Answers

listing executable files in unix.

How to list out the files which are not accessed for the last n days? and How to list out all the executable files in a directory? can anyone help me on the above? Thanks in advance. (3 Replies)
Discussion started by: venkatesht
3 Replies

6. UNIX for Dummies Questions & Answers

BASH complete-filename & menu-complete together

Hi, Does anyone know how to make BASH provide a list of possible completions on the first tab, and then start cycling through the possibilites on the next tab? Right now this is what I have in my .bashrc: bind "set show-all-if-ambiguous on" bind \\C-o:menu-complete This allows... (0 Replies)
Discussion started by: Mithu
0 Replies

7. UNIX for Dummies Questions & Answers

Executable files

This question always confuses me :- Suppose I write a program and compile it on a machine with operating system A and processor B will the exe file run on a machine with operating system A2 but processor B operating system A but processor B2 operating system A2 and processor B2........ ... (9 Replies)
Discussion started by: nervous
9 Replies

8. UNIX for Dummies Questions & Answers

Finding executable files in all directories

This is probably very easy but I would like to know a way to list all my files in all my directories that are readable and executable to everyone. I was told to use find or ls and I tried some stuff but couldnt get it to work. I understand that its dangerous to have files with these permissions for... (4 Replies)
Discussion started by: CSGUY
4 Replies

9. OS X (Apple)

Cannot translate Unix executable files

Help!! I loaded OS X Panther on my Mac G4 and found that many files previously saved as txt files were inadventently converted to Unix executable files. When I try to read these in Word, the Word filters cannot recognize or translate the file properly. Does anyone know how to translate these files?... (1 Reply)
Discussion started by: Steven Greenber
1 Replies
Login or Register to Ask a Question