Filesystem Benchmarks for HDDs and SSDs Post: 303045051

Sponsored Content

UNIX Standards and Benchmarks UNIX & LINUX Benchmarks (Version 3.11) Linux Benchmarks Filesystem Benchmarks for HDDs and SSDs Post 303045051 by stomp on Wednesday 11th of March 2020 08:14:13 AM

03-11-2020

Registered User

My test hardware is the following:

Code:

inxi -v2 -C -D -M -R

System:    Host: pvetest Kernel: 5.3.10-1-pve x86_64 bits: 64 Console: tty 1 Distro: Debian GNU/Linux 10 (buster) 
Machine:   Type: Desktop Mobo: Intel model: DQ67SW v: AAG12527-309 serial: BQSW133004FE BIOS: Intel 
           v: SWQ6710H.86A.0067.2014.0313.1347 date: 03/13/2014 
CPU:       Topology: Quad Core model: Intel Core i7-2600 bits: 64 type: MT MCP L2 cache: 8192 KiB 
           Speed: 1687 MHz min/max: 1600/3800 MHz Core speeds (MHz): 1: 2690 2: 3287 3: 3659 4: 3682 5: 1887 6: 3648 7: 3658 
           8: 2228 
Network:   Device-1: Intel 82579LM Gigabit Network driver: e1000e 
Drives:    Local Storage: total: 3.97 TiB used: 12.73 GiB (0.3%) 
           ID-1: /dev/sda model: N/A size: 930.99 GiB 
           ID-2: /dev/sdb model: 1 size: 930.99 GiB 
           ID-3: /dev/sdc model: 2 size: 930.99 GiB 
           ID-4: /dev/sdd model: 3 size: 930.99 GiB 
           ID-5: /dev/sde vendor: Intel model: SSDSC2MH120A2 size: 111.79 GiB 
           ID-6: /dev/sdf vendor: Samsung model: SSD 850 EVO M.2 250GB size: 232.89 GiB 
RAID:      Hardware-1: Intel SATA Controller [RAID mode] driver: ahci 
           Hardware-2: Adaptec AAC-RAID driver: aacraid

The hard disks are of type SAS and attached to the adaptec raid controller as single disks. One Intel SSD as OS-Filesystem. The other one is attached PCIe SSD-m.2 Adapter. An additional m.2 SSD will be attached for later tests with ssd caching.

For the tests I will make use of fio - flexible I/O tester - one of the currently most popular storage benchmarking tools.

My production scenario will be webhosting. So it will be 25% write and 75% read. I will test that probably later after the basic read/write tests.

At first I'm making sure the device names I use are fixed so my tests will not overwrite any of the wrong disks. This may happen under linux because there is no fixed device naming of storage devices. The ordering may be different at every reboot. And it actually is, as I have noticed.

So I'm checking the serial numbers and copy the device file names to unique names I will be using then.

What's regarding partitions: I try to avoid using them and use whole disks instead as it makes the procedere simpler.

The git repository for the scripts is here:

GitHub - megabert/storage-benchmarks: Storage Benchmark Scripts

The script for creating the device names is this:

storage-benchmarks/mk_dev_names at master . megabert/storage-benchmarks . GitHub

Last edited by stomp; 03-12-2020 at 06:52 AM..

stomp

View Public Profile for stomp

Find all posts by stomp

6 More Discussions You Might Find Interesting

1. UNIX Benchmarks

Instructions for UNIX Benchmarks

STEP 1: Get the source here: https://www.unix.com/source/bm.zip or https://www.unix.com/source/unix_linux_bench.tar.gz STEP 2: Unzip or Untar STEP 3: make STEP 4: Run STEP: 5: Please login to www.unix.com and post test results along with platform info to: Include (if you...

2. HP-UX

hdds physically

Hi, I've a HP-UX 10x running on HP9000 box and also I have 3 scsi hdd(9Gb), one of them is working. I need to check the other 2 hdd physically. Is there an utility to check them from unix or another way to do it? Thanks....

3. UNIX for Dummies Questions & Answers

hwo to find shared filesystem and local filesystem in AIX

Hi, I wanted to find out that in my database server which filesystems are shared storage and which filesystems are local. Like when I use df -k, it shows "filesystem" and "mounted on" but I want to know which one is shared and which one is local. Please tell me the commands which I can run...

4. Shell Programming and Scripting

Understanding Benchmarks

I need a little clarification in understanding why there would be a need for a benchmark file when used with a backup script. Logically thinking would tell me that the backups itself(backuptest.tgz) would have the time created and etc. So what would be the purpose of such a file: touch...

5. Solaris

SPARC T4-1/Solaris 11/Add 2 new HDDs in RAID 0 configuration

Hi, Couple of sentences for background: I'm a software developer, whose task was to create a server software for our customer. Software is ready for deployment and customer has a new T4-1 SPARC, but somehow it also became my task also to setup the server. I have managed to get the server is up...

6. AIX

IBM AIX 5.2 cloning Hdds

I have an old IBM Power 5 9111-520 that has data on it but the system is failing. I need to move it to a more reliable server. The current system has two drives and no raid. I would like to setup my "newer" system with raid and two partitions then clone my setup over. What is the best way to do...

LEARN ABOUT MOJAVE

ataraid

ATARAID(4)						   BSD Kernel Interfaces Manual 						ATARAID(4)

NAME

     ataraid -- ATA software RAID support

SYNOPSIS

     device ata
     device ataraid

DESCRIPTION

     The ataraid driver provides support for so-called software RAID (sometimes referred to as fake RAID or pseudo RAID).

     When a controller that supports software RAID is instructed to create a RAID array, its BIOS writes data structures in a specific metadata
     format to the disks.  These data structures are picked up by the ataraid driver, so that FreeBSD can work with the array.	The ataraid driver
     has to understand the specific metadata format of a controller BIOS in order to support its RAID capabilities.

     Read-only support for a metadata format means that FreeBSD can use the given RAID array for normal read/write operations.	Creation and
     rebuild of such arrays has to be done from the controller BIOS.

     Read and write support for a metadata format means that FreeBSD can use the given RAID array for normal read/write operations.  Additionally,
     the atacontrol(8) utility can be used to create, rebuild, update and fail such RAID arrays.

     The ataraid driver can read the following metadata formats:

     o	 Adaptec HostRAID
     o	 Highpoint V2 RocketRAID
     o	 Highpoint V3 RocketRAID
     o	 Intel MatrixRAID
     o	 Integrated Technology Express (ITE)
     o	 JMicron
     o	 LSI Logic V2 MegaRAID
     o	 LSI Logic V3 MegaRAID
     o	 NVIDIA MediaShield
     o	 Promise FastTrak
     o	 Silicon Image Medley
     o	 Silicon Integrated Systems (SiS)
     o	 VIA Tech V-RAID
     o	 FreeBSD PseudoRAID

     The ataraid driver can write the following metadata formats:

     o	 Highpoint V2 RocketRAID
     o	 Intel MatrixRAID
     o	 JMicron
     o	 Promise FastTrak
     o	 Silicon Integrated Systems (SiS)
     o	 VIA Tech V-RAID
     o	 FreeBSD PseudoRAID

     It is also possible to use software RAID on controllers that do not have special software RAID capabilities.  See atacontrol(8) for details.

FILES

     /dev/ar*  ATA RAID device nodes

SEE ALSO

     ata(4), atacontrol(8)

CAVEATS

     RAID5 is not supported at this time.  Code exists, but it neither uses nor maintains parity information.

AUTHORS

     The ataraid driver was written by Soren Schmidt <sos@FreeBSD.org>.  This manual page was written by Christian Brueffer
     <brueffer@FreeBSD.org>.

BSD
								 February 17, 2006							       BSD