The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > OS Specific Forums > Linux
Google UNIX.COM


Linux RedHat, Ubuntu, SUSE, Fedora, Debian, Mandriva, Slackware, Gentoo linux, PCLinuxOS. All Linux questions here!

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Creating an sql statement from a file. Problem with ' hannem Shell Programming and Scripting 2 04-24-2008 05:26 AM
creating new files montana77 UNIX for Dummies Questions & Answers 4 04-12-2008 11:20 PM
Problem creating files greater than 2GB bobbyjohnz UNIX for Advanced & Expert Users 1 01-17-2007 09:19 AM
extract tar files without creating directory here2learn UNIX for Dummies Questions & Answers 4 10-02-2006 04:42 PM
Dynamically Creating and Printing to Files Laud12345 Shell Programming and Scripting 0 03-02-2005 10:07 AM

Reply
 
Submit Tools LinkBack Thread Tools Search this Thread Display Modes
  #1  
Old 11-06-2007
Registered User
 

Join Date: Jul 2007
Posts: 51
Problem with creating big files

Hi...
I have a very wired problem with my redhat4 update 4 server...
Every time i create a file bigger then my physical memory the server kills the process\session that creates the file, and in the "messages" file i see this error:
"Oct 21 15:22:22 optidev kernel: Out of Memory: Killed process 14300 (sshd)."
The problem occurs only when I'm creating the file on NFS file-system, on local file-system it's ok...

Any thoughts?

Thanks and sorry for my pour English.
Eliraz.
Reply With Quote
Forum Sponsor
  #2  
Old 11-06-2007
Registered User
 

Join Date: Jan 2007
Posts: 2,965
1. What program are you using to create the file?

2. Does the NFS server impose limits on user file space?
Reply With Quote
  #3  
Old 11-06-2007
blowtorch's Avatar
Supporter
 
Join Date: Dec 2004
Location: Singapore
Posts: 2,328
Also check if the filesystem exported from the NFS server can handle largefiles. You can do that by checking the filesystem like this:

mount | grep "/path_to_filesystem"

This will show the mount options. If largefiles isn't visible, there's your problem.
Reply With Quote
  #4  
Old 11-06-2007
Registered User
 

Join Date: Jul 2007
Posts: 51
Quote:
Originally Posted by porter View Post
1. What program are you using to create the file?

2. Does the NFS server impose limits on user file space?
1. basically I'm trying to create the file using sqlplus (it's an oracle data file), but i have tried also "dd" and it happened again...

2. the NFS server does not have any limits and the file-system is 100GB, also the process killing comes from the OS not from the NFS server...
Reply With Quote
  #5  
Old 11-06-2007
Registered User
 

Join Date: Jul 2007
Posts: 51
Quote:
Originally Posted by blowtorch View Post
Also check if the file-system exported from the NFS server can handle largefiles. You can do that by checking the file-system like this:

mount | grep "/path_to_filesystem"

This will show the mount options. If largefiles isn't visible, there's your problem.
this is what i get:
nfserver4:/fs_db_optidev on /db/optidev type NFS (rw,retry=1000,addr=10.57.8.189)

but "largefiles" is an option that handle files larger than 2GB... my file is reaching 4 GB (the size of physical memory) and then crashes, so i don't think this is the problem...
Reply With Quote
  #6  
Old 11-06-2007
s4g3's Avatar
Registered User
 

Join Date: Nov 2007
Location: India
Posts: 43
need to increase the swap size in the NFS server

Reason: NFS copies files from the client to the RAM to the FS in the server

Now if the RAM is out of space and the swap cannot store any more too, its an usual behavior to kill the process trying to write to it

~Sage
Reply With Quote
  #7  
Old 11-06-2007
Registered User
 

Join Date: Jul 2007
Posts: 51
Quote:
Originally Posted by s4g3 View Post
need to increase the swap size in the NFS server

Reason: NFS copies files from the client to the RAM to the FS in the server

Now if the RAM is out of space and the swap cannot store any more too, its an usual behavior to kill the process trying to write to it

~Sage
the NFS server is a celerra (EMC)... i don't think it's because of that... this machine is built for NFS serving of large files...
Reply With Quote
Google The UNIX and Linux Forums
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes




All times are GMT -7. The time now is 11:02 AM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited.
The UNIX and Linux Forums Content Copyright ©1993-2008. All Rights Reserved.Ad Management by RedTyger Visit The Complex Event Processing Blog

Content Relevant URLs by vBSEO 3.2.0