Gfs2 vs xfs vs ext4 Post: 302371221

Sponsored Content

Special Forums Hardware Filesystems, Disks and Memory Gfs2 vs xfs vs ext4 Post 302371221 by reborg on Friday 13th of November 2009 04:27:50 PM

11-13-2009

Administrator Emeritus

Quote:

Originally Posted by king_hippo

We tested ext3 before, it can't handle our load

With what mount options? As corona688 said there are *VAST* differences between the default options and a workload tuned setup.

Secondly it is not at all clear from what you have said whether it is the file system or your storage configuration that is the problem, nor is it possible for anyone to give you a good recommendation based only on the size of the storage.

1. What type of storage are you using.
2. What type of disks
3. If using a controller based array, what you optimized for sequential or random operation.
4. Will you mirror on-host or using hardware RAID
4. What is your storage block size.
5. What is the average size of your writes
6. What is the breakdown of reads/writes
7. Is it really optimal to create a 12TB LUN and put all you eggs in one basket, could you achieve better results with more smaller luns.
8. Do you have file hotspots ( certain files heavily accessed )
9. How many files per directory do you have ( files includes sub-directories) in the largest directory.

For a quick overvirew of options search for a presentation called "Choosing and Tuning Linux File Systems" written by Val Henson from the Intel Linux group.

reborg

View Public Profile for reborg

Find all posts by reborg

8 More Discussions You Might Find Interesting

1. Solaris

Does Solaris support XFS filesytem?

Hi, Does solaris support the XFS file sytems? If so, how can I mount a shared directory from another machine (which is using XFS)? thanks

2. Filesystems, Disks and Memory

ext4 - ready for production system?

Gidday, Are you using ext4 for production system? Or is it better to opt for a more conservative strategy, like ext3 for instance? What are your experiences? Thanks in advance, Lo�c.

3. UNIX for Advanced & Expert Users

[XFS] How to use real-time subvolume

Hi! I created filesystem XFS on partition hda8 with subvolume real-time on partition hda5: mkfs.xfs -r rtdev=/dev/hda5 /dev/hda8 and i mounted it: mount -t xfs -o rtdev=/dev/hda5 /dev/hda8 /xfs But I don't know how can I use this partition hda5 with subvolume real-time. I don't know how to...

4. Linux

GFS2 needed or not?

Hey everyone. I am in the process of setting up an iSCSI SAN to function as a log storage device for a number of servers. All of the initiators see the volume, and originally I formatted it with ext3 and went on my merry way. However after some research I'm having concerns that I should nuke the...

5. SuSE

iscsi network share + xfs

Hello, we got a MD3000i used as a network share between two servers (say A and B). The problem we are facing is that file/directories created by server A are not visible on server B (and viceversa). It's not a problem with permission (chmod 777 doesn't help). The MD3000i was at first used ony...

6. Red Hat

XFS - Custom Kernel or Module?

Hey everyone. I am going to be using XFS for a project coming up. We're running RHEL 5.5. Simply typing modprobe xfs works just fine. The kernel module loads without any issue. Is there any issue with doing this and inserting "modprobe xfs" into /etc/rc.modules? Is there a major reason to...

7. Red Hat

Convert ext4 to ext3

Is there any way to conver ext4 to ext3 filesystem without formatting the partition/disk .. Had ext3 filesystem and had converted it to ext4 by issuing following command # tune2fs -O extents,uninit_bg,dir_index /dev/sda1 # fsck -pf /dev/sda1 # blkid /dev/sda1 /dev/sda1:...

8. UNIX for Advanced & Expert Users

VMWare,XFS and iSCSI issues!

I have a RHEL6 VM that requires the use of remote storage using iSCSI and XFS for the mount point. Here's the issue: With XFS you can't use the _netdev option for your mount point (pause for network) so my mount point doesn't mount properly because the network isn't up yet. I've moved the...

LEARN ABOUT OSX

cvaffinity

cvaffinity(1)                                                    cvaffinity(1)

NAME

       cvaffinity - Set an affinity type

SYNOPSIS

       cvaffinity -s <key> filename

       cvaffinity -l filename

       cvaffinity -d filename

DESCRIPTION

       cvaffinity  can  be used to set an affinity for a specific storage pool
       on a file or directory, or list the current affinity.  An  affinity  is
       created  in  a  storage  pool  through  the  volume  configuration (see
       cvfs_config(4).) It is a name, up to eight (8) characters, describing a
       special  media  type.  Use  cvadmin  (1)  to see what affinity sets are
       assigned to the configured storage pools.

       If the affinity does not exist for any of the storage pools,  then  the
       allocation  will  occur on the non-exclusive storage pool.  If there is
       no non-exclusive storage pool, an ENOSPC is returned.

USAGE

       -s     <key> is the Affinity Key to associate with the file  or  direc-
              tory  and  is  defined  as a 'MediaType' name in the file system
              configuration. Use the program 'cvadmin'  to  see  the  Affinity
              Keys  active  in  this file system.  For files with an Affinity,
              new blocks allocated to that file are placed on a  storage  pool
              with  the  specified Affinity.  For directories with an Affinity
              new files created in that directory inherit  the  Affinity  from
              the directory.

       -l     This  option  says  to  just list the affinity for the specified
              file and exit.

       -d     This option says to delete the affinity from the specified  file
              or directory, if one exists.

       <filename>
              Specifies  any  file  or directory on the targeted volume.  When
              the -k option (set session affinity) is specified, or  no  other
              option  is specified, the filename option is used as a read-only
              reference handle in order to access the volume.   When  the  -s,
              -d,  or  -l  options are used, the filename option specifies the
              file or directory operated on.

EXAMPLES

       List the affinity on the file /usr/clips/foo.

          rock # cvaffinity -l /usr/clips/foo

       Set this file or directory to use the storage pool that has  the  jmfn8
       affinity type.

          rock # cvaffinity -s jmfn8 /usr/clips/filename

       Remove  the  affinity  from  the  /usr/clips/mydir, if one is currently
       assigned.

          rock # cvaffinity -d /usr/clips/mydir

SEE ALSO

       cvfs_config(4), cvadmin(1)

Xsan File System                 December 2005                   cvaffinity(1)