Sponsored Content
Special Forums Hardware SAS or SSD for Ubuntu 14.04 and data analysis Post 302966368 by cmccabe on Thursday 11th of February 2016 09:00:36 AM
Old 02-11-2016
SAS or SSD for Ubuntu 14.04 and data analysis

I am in the process of building a workstation and have a question related to performance. I am a scientist who deals with big data (average file size 30-50gb). My OS is ubuntu 14.04 and so far I have a 128gb dual xeon E5-2630 with 6 cores each. I/O buffering is an issue so I am adding a 256/512? PCIe card and either 2 SSD or SAS drives for the OS and software. Since the PCIe will be separate its main purpose will be for file transfer, so would a SAS or SSD be a better fit for the OS? I am leaning towards SAS for the buffering issue, but wanted to ask more knowledgeable users. I forgot to mention that there will be a separate 1 or 2TB drive. Any recommendations for the size of the SAS or SSD? Thanks Smilie.
 

6 More Discussions You Might Find Interesting

1. UNIX and Linux Applications

help needed- data analysis-table-chart-2d plot software

Hi all, I posted the same message under 'Kaleidagraph like software for Ubuntu' thread. I guess there may not be many people familiar with Kaleidagraph. So I post my message under another subject name. I need a tool for Ubuntu 8.10, -which is quick and easy to learn and use (as I am... (1 Reply)
Discussion started by: apprentice
1 Replies

2. BSD

Using SSD in FreeBSD

Now that SSD drives are becoming mainstream, I had a few questions on installing a SSD drive in a FreeBSD environment. Can FreeBSD be made SSD aware, that is, somehow let FreeBSD know that reads and writes should be limited or deferred to extend the disk's life? Is there a setting for wear... (0 Replies)
Discussion started by: figaro
0 Replies

3. Red Hat

What is the best tools for performance data gathering and analysis?

Dear Guru, IHAC who complaint that his CentOS is getting performance issue. I have to help him out of there. Could you please tell me which tools is better to gathering the whole system performance data? -- CPU/Memory/IO(disk & Network)/swap I would like the tools could be... (6 Replies)
Discussion started by: devyfong
6 Replies

4. Shell Programming and Scripting

Help with analysis data based on particular column content

Input file: Total_counts 1306726155 100% Number_of_count_true 855020282 Number_of_count_true_1 160014283 Number_of_count_true_2 44002825 Number_of_count_true_3 18098424 Number_of_count_true_4 24693745 Number_of_count_false 115421870 Number_of_count_true 51048447 Total_number_of_false ... (2 Replies)
Discussion started by: perl_beginner
2 Replies

5. UNIX for Dummies Questions & Answers

Data analysis, Regular Expression - Unix

Hey every one! I have a dataset like this : 1 100 1 0 5 100 1 8 7 50 1 0 7 100 2 0 10 20 1 8 10 30 1 8 10 100 3 8 15 50 5 0 20 90 1 0 20 99 9 0 I wanna check if the 4th column is 0 or 8 If it's zero write the 1st column itself, if it's 8 write sum of 1st and second something... (2 Replies)
Discussion started by: @man
2 Replies

6. UNIX for Dummies Questions & Answers

What should I format my SSD with?

Hello All, I recently received a new SSD that I am going to use for the purpose of Booting Virtual Machines. I use VMWare Player to boot Windows Guest Operating Systems onto my Linux Laptop. I currently have a SSD drive that I use for this exact same purpose that is formatted as ext3 and I'm... (3 Replies)
Discussion started by: mrm5102
3 Replies
ARCMSR(4)						   BSD Kernel Interfaces Manual 						 ARCMSR(4)

NAME
arcmsr -- Areca Technology Corporation SATA/SAS RAID controller SYNOPSIS
arcmsr* at pci? dev ? function ? DESCRIPTION
The arcmsr driver provides support for the PCI-X and PCI Express RAID controllers from Areca Technology Corporation: - ARC-1110 PCI-X 4 Port SATA RAID Controller - ARC-1110ML PCI-X 4 Port SATA RAID Controller - ARC-1120 PCI-X 8 Port SATA RAID Controller - ARC-1120ML PCI-X 8 Port SATA RAID Controller - ARC-1130 PCI-X 12 Port SATA RAID Controller - ARC-1130ML PCI-X 12 Port SATA RAID Controller - ARC-1160 PCI-X 16 Port SATA RAID Controller - ARC-1160ML PCI-X 16 Port SATA RAID Controller - ARC-1170 PCI-X 24 Port SATA RAID Controller - ARC-1200 Rev A PCI Express 2 Port SATA RAID Controller - ARC-1202 PCI Express 2 Port SATA RAID Controller - ARC-1210 PCI Express 4 Port SATA RAID Controller - ARC-1220 PCI Express 8 Port SATA RAID Controller - ARC-1230 PCI Express 12 Port SATA RAID Controller - ARC-1230ML PCI Express 12 Port SATA RAID Controller - ARC-1231ML PCI Express 12 Port SATA RAID Controller - ARC-1260 PCI Express 16 Port SATA RAID Controller - ARC-1260ML PCI Express 16 Port SATA RAID Controller - ARC-1261ML PCI Express 16 Port SATA RAID Controller - ARC-1280 PCI Express 24 Port SATA RAID Controller - ARC-1280ML PCI Express 24 Port SATA RAID Controller - ARC-1680 PCI Express 8 Port SAS RAID Controller - ARC-1680LP PCI Express 8 Port SAS RAID Controller - ARC-1680i PCI Express 8 Port SAS RAID Controller - ARC-1680x PCI Express 8 Port SAS RAID Controller - ARC-1681 PCI-X 8 Port SAS RAID Controller These controllers support RAID levels 0, 1, 1E, 3, 5, 6, and JBOD using either SAS or SATA II drives. arcmsr supports management and monitoring of the controller through the bioctl(8) and envstat(8) commands. Please note, however, that to use some features that require special privileges, such as creating/removing hot-spares, pass-through disks or RAID volumes will require to have the password disabled in the firmware; otherwise a Permission denied error will be reported by bioctl(8). When a RAID 1 or 1+0 volume is created, either through the bioctl(8) command or controller's firmware, the volume won't be accessible until the initialization is done. A way to get access to the sd(4) device that corresponds to that volume without rebooting, is to issue the fol- lowing command (once the initialization is finished): $ scsictl scsibus0 scan any any The arcmsr driver will also report to the kernel log buffer any error that might appear when handling firmware commands, such as used by the bioctl(8) command. EVENTS
The arcmsr driver is able to send events to powerd(8) if a volume or any drive connected to the volume is not online. The state-changed event will be sent to the /etc/powerd/scripts/sensor_drive script when such condition happens. SEE ALSO
intro(4), pci(4), scsi(4), sd(4), bioctl(8), envstat(8), powerd(8), scsictl(8) HISTORY
The arcmsr driver first appeared in NetBSD 5.0. AUTHORS
The arcmsr driver was originally written for OpenBSD by David Gwynne. It was ported to NetBSD and extended by Juan Romero Pardines. BSD
March 3, 2008 BSD
All times are GMT -4. The time now is 10:34 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy