Sponsored Content
Special Forums UNIX and Linux Applications Virtualization and Cloud Computing How to grow an EBS Array at AWS Post 302539788 by Habitual on Monday 18th of July 2011 07:35:24 PM
Old 07-18-2011
Java How to grow an EBS Array at AWS

This process was collected by trial and error (mostly error) since most of the documents I found on the 'net were incomplete.

The cookbook/walkthrough on how to grow an Array on EBS at AWS...
Code:
# walkthrough by John Jones (jjones at cirrhus9 dot com)

umount /dev/md0
mdadm --stop /dev/md0
REM out the last line in /etc/fstab
# /dev/md0 /mnt/data-files xfs defaults 0 0
REM out the last line of /etc/mdadm/mdadm.conf
# ARRAY /dev/md0 level=raid0 num-devices=2 UUID=31a281bd:50deafca:edf6a245:a7933c25

Stop the instance.
Create new snapshot from existing volumes.
detach "current" sd[xx] volumes.
Create new volume from snapshots at higher capacity.
Attach to same /dev/sdX mount points while the instance is stopped.
Start the instance.
Assign EIP.
Login to the instance.
mdadm --create --verbose /dev/md0 --level=0 --raid-devices=2 /dev/sdb /dev/sdc
mdadm --examine --scan --config=/etc/mdadm/mdadm.conf >> /etc/mdadm/mdadm.conf
mkdir -v /mnt/data-files
Remove comment in /etc/fstab
/dev/md0 /mnt/data-files xfs defaults 0 0

# check the mount for errors:
xfs_check /dev/md0

# mount it
mount /dev/md0
/dev/md0               40G   49M   40G   1% /mnt/data-files

# Verify new capacity...
mdadm --detail /dev/md0 | grep "Array Size"
     Array Size : 83885952 (80.00 GiB 85.90 GB)

# grow the new volumes
xfs_growfs -d /dev/md0

df -h | tail -1
/dev/md0               80G   49M   80G   1% /mnt/data-files

# reboot
reboot

# verify larger capacity
df -h | tail -1
/dev/md0               80G   49M   80G   1% /mnt/data-files

# Verify contents came across
ls -1 /mnt/data-files/

# Done.
Cleanup/delete "old" volumes.

Enjoy!
 

8 More Discussions You Might Find Interesting

1. What is on Your Mind?

Where to grow up?

Hi, all! I've been working for one year as a Unix systems engineer(Solaris) in a large company. Two days ago I found, that I didn't exactly know where should I grow up? I can't drop this idea away and I'm still thinking about it. I'm trying to imagine myself in a next year. Available... (1 Reply)
Discussion started by: movx
1 Replies

2. UNIX for Advanced & Expert Users

find: 0652-019 The status on /interfaces/eu3/hmsl/EBS/20070722 is not valid.

I am getting this error when i issue find command. Any advice. Regards, Vishal (0 Replies)
Discussion started by: vishal_ranjan
0 Replies

3. UNIX and Linux Applications

Sun EBS Networker 7.3

I am having an issue with Sun EBS Networker 7.3, (64 bit) (Sun Hardware, Solaris 9) where it expects an Oracle DB (11.5.10 with 10g Database (10.2.0.2)) size of 4294967295 bytes. The DB's get backed up anyway, but it's only happening to certain DB's. The warning messages occur at random intervals... (4 Replies)
Discussion started by: djembeplayer
4 Replies

4. Virtualization and Cloud Computing

Computing in the Clouds with AWS

Tim Bass 07-25-2008 02:34 AM The admin*team at The UNIX Forums*have been considering moving the UNIX and*Linux*Forums to the clouds - the Amazon Web Services (AWS) cloud.* Amazon EC2 is one option to scale the forums, which is a*LAMP application.* Amazon EC2 allows*us to rent dedicated... (3 Replies)
Discussion started by: Linux Bot
3 Replies

5. Red Hat

Installing EBS 12.1.1 on RHEL 6.1 x86_64‏

i am in process to install R12.1.1 on RHEL 6.1. while installing pre-requisite on RHEL 6.1 i am facing following error : rpm -ivh xorg-x11-libs-compat-6.8.2-1.EL.33.0.1.i386.rpm error: Failed dependencies: libX11.so.6 is needed by xorg-x11-libs-compat-6.8.2-1.EL.33.0.1.i386 ... (3 Replies)
Discussion started by: rehantayyab82
3 Replies

6. UNIX and Linux Applications

Mod_proxy_html on Oracle EBS

Hi , I am trying to impliment mod_proxy and mod_proxy_html as a reverse proxy for oracle EBS. Everything is working fine except the submenu links (still pointing to the internal url) of the modules tree view. Please help me. Regards, Arumon (0 Replies)
Discussion started by: arumon
0 Replies

7. Shell Programming and Scripting

AWS Cloud EBS limit script!

Hi, I am trying to correct the following script to get total EBS usage from Amazon cloud. Can someone please help in correcting it. It appears that its not working properly. t=0; for i in `ec2-describe-volumes | grep VOLUME | grep standard | awk '{print $3}'`; do t=`expr $t + $i`; done;... (2 Replies)
Discussion started by: amar0000
2 Replies

8. Shell Programming and Scripting

AWS S3 with Bash Script

Hello All, I am trying few stuff on Amazon S3 move files to EC2 (Ubuntu Server) I am receiving daily 2 files in S# bucket XYZ_2015-02-26_ 200.csv ABC_2015-02-26_ 200.csv I want to move daily received files to local EC2(Ubuntu server) and rename files to XYZ_2015-02-26.csv... (3 Replies)
Discussion started by: krux_rap
3 Replies
MDADM.CONF(5)							File Formats Manual						     MDADM.CONF(5)

NAME
mdadm.conf - configuration for management of Software RAID with mdadm SYNOPSIS
/etc/mdadm.conf DESCRIPTION
mdadm is a tool for creating, managing, and monitoring RAID devices using the md driver in Linux. Some common tasks, such as assembling all arrays, can be simplified by describing the devices and arrays in this configuration file. SYNTAX The file should be seen as a collection of words separated by white space (space, tab, or newline). Any word that beings with a hash sign (#) starts a comment and that word together with the remainder of the line is ignored. Any line that starts with white space (space or tab) is treated as though it were a continuation of the previous line. Empty lines are ignored, but otherwise each (non continuation) line must start with a keyword as listed below. The keywords are case insensitive and can be abbreviated to 3 characters. The keywords are: DEVICE A device line lists the devices (whole devices or partitions) that might contain a component of an MD array. When looking for the components of an array, mdadm will scan these devices (or any devices listed on the command line). The device line may contain a number of different devices (separated by spaces) and each device name can contain wild cards as defined by glob(7). Also, there may be several device lines present in the file. Alternatively, a device line can contain either of both of the words containers and partitions. The word containers will cause mdadm to look for assembled CONTAINER arrays and included them as a source for assembling further arrays. The word partitions will cause mdadm to read /proc/partitions and include all devices and partitions found therein. mdadm does not use the names from /proc/partitions but only the major and minor device numbers. It scans /dev to find the name that matches the numbers. If no DEVICE line is present, then "DEVICE partitions containers" is assumed. For example: DEVICE /dev/hda* /dev/hdc* DEV /dev/sd* DEVICE /dev/disk/by-path/pci* DEVICE partitions ARRAY The ARRAY lines identify actual arrays. The second word on the line may be the name of the device where the array is normally assembled, such as /dev/md1 or /dev/md/backup. If the name does not start with a slash ('/'), it is treated as being in /dev/md/. Alternately the word <ignore> (complete with angle brackets) can be given in which case any array which matches the rest of the line will never be automatically assembled. If no device name is given, mdadm will use various heuristics to determine an appropriate name. Subsequent words identify the array, or identify the array as a member of a group. If multiple identities are given, then a compo- nent device must match ALL identities to be considered a match. Each identity word has a tag, and equals sign, and some value. The tags are: uuid= The value should be a 128 bit uuid in hexadecimal, with punctuation interspersed if desired. This must match the uuid stored in the superblock. name= The value should be a simple textual name as was given to mdadm when the array was created. This must match the name stored in the superblock on a device for that device to be included in the array. Not all superblock formats support names. super-minor= The value is an integer which indicates the minor number that was stored in the superblock when the array was created. When an array is created as /dev/mdX, then the minor number X is stored. devices= The value is a comma separated list of device names or device name patterns. Only devices with names which match one entry in the list will be used to assemble the array. Note that the devices listed there must also be listed on a DEVICE line. level= The value is a raid level. This is not normally used to identify an array, but is supported so that the output of mdadm --examine --scan can be use directly in the configuration file. num-devices= The value is the number of devices in a complete active array. As with level= this is mainly for compatibility with the output of mdadm --examine --scan. spares= The value is a number of spare devices to expect the array to have. The sole use of this keyword and value is as follows: mdadm --monitor will report an array if it is found to have fewer than this number of spares when --monitor starts or when --oneshot is used. spare-group= The value is a textual name for a group of arrays. All arrays with the same spare-group name are considered to be part of the same group. The significance of a group of arrays is that mdadm will, when monitoring the arrays, move a spare drive from one array in a group to another array in that group if the first array had a failed or missing drive but no spare. auto= This option is rarely needed with mdadm-3.0, particularly if use with the Linux kernel v2.6.28 or later. It tells mdadm whether to use partitionable array or non-partitionable arrays and, in the absence of udev, how many partition devices to create. From 2.6.28 all md array devices are partitionable, hence this option is not needed. The value of this option can be "yes" or "md" to indicate that a traditional, non-partitionable md array should be created, or "mdp", "part" or "partition" to indicate that a partitionable md array (only available in linux 2.6 and later) should be used. This later set can also have a number appended to indicate how many partitions to create device files for, e.g. auto=mdp5. The default is 4. bitmap= The option specifies a file in which a write-intent bitmap should be found. When assembling the array, mdadm will provide this file to the md driver as the bitmap file. This has the same function as the --bitmap-file option to --assemble. metadata= Specify the metadata format that the array has. This is mainly recognised for comparability with the output of mdadm -Es. container= Specify that this array is a member array of some container. The value given can be either a path name in /dev, or a UUID of the container array. member= Specify that this array is a member array of some container. Each type of container has some way to enumerate member arrays, often a simple sequence number. The value identifies which member of a container the array is. It will usually accompany a "container=" word. MAILADDR The mailaddr line gives an E-mail address that alerts should be sent to when mdadm is running in --monitor mode (and was given the --scan option). There should only be one MAILADDR line and it should have only one address. MAILFROM The mailfrom line (which can only be abbreviated to at least 5 characters) gives an address to appear in the "From" address for alert mails. This can be useful if you want to explicitly set a domain, as the default from address is "root" with no domain. All words on this line are catenated with spaces to form the address. Note that this value cannot be set via the mdadm commandline. It is only settable via the config file. PROGRAM The program line gives the name of a program to be run when mdadm --monitor detects potentially interesting events on any of the arrays that it is monitoring. This program gets run with two or three arguments, they being the Event, the md device, and possibly the related component device. There should only be one program line and it should be give only one program. CREATE The create line gives default values to be used when creating arrays and device entries for arrays. These include: owner= group= These can give user/group ids or names to use instead of system defaults (root/wheel or root/disk). mode= An octal file mode such as 0660 can be given to override the default of 0600. auto= This corresponds to the --auto flag to mdadm. Give yes, md, mdp, part -- possibly followed by a number of partitions -- to indicate how missing device entries should be created. metadata= The name of the metadata format to use if none is explicitly given. This can be useful to impose a system-wide default of ver- sion-1 superblocks. symlinks=no Normally when creating devices in /dev/md/ mdadm will create a matching symlink from /dev/ with a name starting md or md_. Give symlinks=no to suppress this symlink creation. HOMEHOST The homehost line gives a default value for the --homehost= option to mdadm. There should normally be only one other word on the line. It should either be a host name, or one of the special words <system> and <ignore>. If <system> is given, then the gethost- name(2) systemcall is used to get the host name. If <ignore> is given, then a flag is set so that when arrays are being auto-assembled the checking of the recorded homehost is dis- abled. If <ignore> is given it is also possible to give an explicit name which will be used when creating arrays. This is the only case when there can be more that one other word on the HOMEHOST line. When arrays are created, this host name will be stored in the metadata. When arrays are assembled using auto-assembly, arrays which do not record the correct homehost name in their metadata will be assembled using a "foreign" name. A "foreign" name alway ends with a digit string preceded by an underscore to differentiate it from any possible local name. e.g. /dev/md/1_1 or /dev/md/home_0. AUTO A list of names of metadata format can be given, each preceded by a plus or minus sign. Also the word all preceded by plus or minus is allowed and is usually last. When mdadm is auto-assembling an array, with via --assemble or --incremental and it finds metadata of a given type, it checks that metadata type against those listed in this line. The first match wins, where all matches anything. If a match is found that was preceded by a plus sign, the auto assembly is allowed. If the match was preceded by a minus sign, the auto assembly is disallowed. If no match is found, the auto assembly is allowed. This can be used to disable all auto-assembly (so that only arrays explicitly listed in mdadm.conf or on the command line are assem- bled), or to disable assembly of certain metadata types which might be handled by other software. The known metadata types are 0.90, 1.x, ddf, imsm. EXAMPLE
DEVICE /dev/sd[bcdjkl]1 DEVICE /dev/hda1 /dev/hdb1 # /dev/md0 is known by its UUID. ARRAY /dev/md0 UUID=3aaa0122:29827cfa:5331ad66:ca767371 # /dev/md1 contains all devices with a minor number of # 1 in the superblock. ARRAY /dev/md1 superminor=1 # /dev/md2 is made from precisely these two devices ARRAY /dev/md2 devices=/dev/hda1,/dev/hdb1 # /dev/md4 and /dev/md5 are a spare-group and spares # can be moved between them ARRAY /dev/md4 uuid=b23f3c6d:aec43a9f:fd65db85:369432df spare-group=group1 ARRAY /dev/md5 uuid=19464854:03f71b1b:e0df2edd:246cc977 spare-group=group1 # /dev/md/home is created if need to be a partitionable md array # any spare device number is allocated. ARRAY /dev/md/home UUID=9187a482:5dde19d9:eea3cc4a:d646ab8b auto=part MAILADDR root@mydomain.tld PROGRAM /usr/sbin/handle-mdadm-events CREATE group=system mode=0640 auto=part-8 HOMEHOST <system> AUTO +1.x -all SEE ALSO
mdadm(8), md(4). MDADM.CONF(5)
All times are GMT -4. The time now is 12:25 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy