Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extremely slow file writing with many small files on mounted NAS
Top Forums UNIX for Dummies Questions & Answers Extremely slow file writing with many small files on mounted NAS Post 302946656 by hicksd8 on Thursday 11th of June 2015 05:03:26 AM
Old 06-11-2015
If these are normal hardware RAID controllers (or some software RAID controllers for that matter) you might be able to set the cache; to write-through, write-around and/or write-back.

If the RAID controller cache was set to write-through then the controller will await completion each I/O before proceeding. In the case of millions of small files that would be very painful. You wouldn't see the same degradation with large files because each I/O is bigger.

Search Google (and of course THIS FORUM) for the pro's and con's of these cache settings.
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

File writing is slow

Hello Guru, I am using a Pro*C program to prepare some reports usaually the report file size is greater than 1GB. But nowadays program is very slow. I found out the program is taking much time to write data to file ..... is there any unix related reason to be slow down, the file writting... (2 Replies)
Discussion started by: bhagyaraj.p
2 Replies

2. Shell Programming and Scripting

Need help writing a small script

Hi I am trying to do the following: run a command that looks at a binary file and formats it find the first line that has what I am looking for (there will be multiple) print the name of the file that has it So I am running this but ti's not working ls -ltr *20080612* | while read line... (3 Replies)
Discussion started by: llsmr777
3 Replies

3. Shell Programming and Scripting

Split a file into 16 small files

Hi I want to split a file that has 'n' number of records into 16 small files. Can some one suggest me how to do this using Unix script? Thanks rrkk (10 Replies)
Discussion started by: rrkks
10 Replies

4. Solaris

why telnet from PC to Solaris x86 is extremely slow?

I got the following info from this forum, in regards to configuring my Solaris x86 to link to the Net: # echo 192.168.0.1 > /etc/defaultrouter # route add default 192.168.0.1 # echo nameserver 192.168.0.1 >> /etc/resolv.conf # cp /etc/nsswitch.dns /etc/nsswitch.conf So I did... (1 Reply)
Discussion started by: newbie09
1 Replies

5. Red Hat

NFS writing so slow

Hi, I facing an NFS problem. I have machine1, which has diskA and diskB, and machine2, both are Mandriva 2009 Linux. When I am on machine2 and NFS mount both diskA and diskB of machine1. Writing to diskA is very fast, but writing to diskB is very slow. I tried different mount rsize and wsize... (2 Replies)
Discussion started by: hiepng
2 Replies

6. Red Hat

file writing over nfs very slow

Hi guys, I am trying something. I wrote a simple shell program to test something where continuous while loop writes on a file over the nfs. The time taken to write "hello" 3000 times take about 10 sec which is not right. Ideally it should take fraction of seconds. If I write on the local disk, it... (1 Reply)
Discussion started by: abhig
1 Replies

7. Shell Programming and Scripting

Check if NAS filesystem is mounted

Anyone know the best way to check and see if a NAS filesystem is mounted on a linux box. I have no idea where to start :wall:. (2 Replies)
Discussion started by: d3mon_spawn
2 Replies

8. Solaris

how to make nas share mounted in zones persistent across reboots?

there are few nas shares that would be mounted on the local zone. should i add an entry into the add an entry in zone.xml file so that it gets mounted automatically when the zone gets rebooted? or whats the correct way to get it mounted automatically when the zone reboots (2 Replies)
Discussion started by: chidori
2 Replies

9. Solaris

Chgrp failed on NAS mounted

Hi, I am facing chgrp issue for a directory on a NAS mounted partation. issue details : user1 belongs to two groups grp1(primary) and grp2(secondary) not able to change directory group to secondary. WORKING on /tmp #mkdir /tmp/a #ls -ld /tmp/a drwxr-xr-x 2 user1 grp1 117 Mar 24... (7 Replies)
Discussion started by: naveen.surisett
7 Replies

10. Red Hat

Related to "NAS" some file system (mounted volumes) were not writable

Dear friends, I have been facing an issue with one of my red hat unix machine, suddenly lost to switch sudo users. My all colleagues lost to switch to access sudo users. Then, we have realized its related to NAS issue which does not allowing to write the file. because of this we got so many... (1 Reply)
Discussion started by: Chand
1 Replies

LEARN ABOUT OSX

ataraid

ATARAID(4)						   BSD Kernel Interfaces Manual 						ATARAID(4)

NAME

     ataraid -- ATA software RAID support

SYNOPSIS

     device ata
     device ataraid

DESCRIPTION

     The ataraid driver provides support for so-called software RAID (sometimes referred to as fake RAID or pseudo RAID).

     When a controller that supports software RAID is instructed to create a RAID array, its BIOS writes data structures in a specific metadata
     format to the disks.  These data structures are picked up by the ataraid driver, so that FreeBSD can work with the array.	The ataraid driver
     has to understand the specific metadata format of a controller BIOS in order to support its RAID capabilities.

     Read-only support for a metadata format means that FreeBSD can use the given RAID array for normal read/write operations.	Creation and
     rebuild of such arrays has to be done from the controller BIOS.

     Read and write support for a metadata format means that FreeBSD can use the given RAID array for normal read/write operations.  Additionally,
     the atacontrol(8) utility can be used to create, rebuild, update and fail such RAID arrays.

     The ataraid driver can read the following metadata formats:

     o	 Adaptec HostRAID
     o	 Highpoint V2 RocketRAID
     o	 Highpoint V3 RocketRAID
     o	 Intel MatrixRAID
     o	 Integrated Technology Express (ITE)
     o	 JMicron
     o	 LSI Logic V2 MegaRAID
     o	 LSI Logic V3 MegaRAID
     o	 NVIDIA MediaShield
     o	 Promise FastTrak
     o	 Silicon Image Medley
     o	 Silicon Integrated Systems (SiS)
     o	 VIA Tech V-RAID
     o	 FreeBSD PseudoRAID

     The ataraid driver can write the following metadata formats:

     o	 Highpoint V2 RocketRAID
     o	 Intel MatrixRAID
     o	 JMicron
     o	 Promise FastTrak
     o	 Silicon Integrated Systems (SiS)
     o	 VIA Tech V-RAID
     o	 FreeBSD PseudoRAID

     It is also possible to use software RAID on controllers that do not have special software RAID capabilities.  See atacontrol(8) for details.

FILES

     /dev/ar*  ATA RAID device nodes

SEE ALSO

     ata(4), atacontrol(8)

CAVEATS

     RAID5 is not supported at this time.  Code exists, but it neither uses nor maintains parity information.

AUTHORS

     The ataraid driver was written by Soren Schmidt <sos@FreeBSD.org>.  This manual page was written by Christian Brueffer
     <brueffer@FreeBSD.org>.

BSD
								 February 17, 2006							       BSD
All times are GMT -4. The time now is 03:56 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy