HP (Hewlett-Packard) HP-UX 11i v3 manual

Ve r i t a s  V olume Manager 5.0 Administrator’ s Guide HP-UX 11i v3 First Edition Manufacturing P art Number: 5992-3942 May 2008[...]

2 Legal Notices © Copyrig ht 2008 H ewlett- P ackard Developme nt Compan y , L.P . Publicat io n Date: 2008 Confident ial computer softw are. V alid licens e from HP required for possessio n, use, or copying. Consist ent with FAR 12.211 and 12 .212, Commercial Computer Softw are, Computer Softw are Documentation, and T echnical Data for Commercial[...]

[...]

Contents Chapter 1 Understanding Veritas Volume Manager VxVM and the operating system ....................................................................... 19 How data is stored ........................................................... ............................. 19 How VxVM handles storage management .................................... ....[...]

6 Contents DCO volume versioning ............................................ .................................. 68 FastResync limitations ................................... ............................................ 74 Hot-relocation ............................ ..................................................................... ..... 75 Volu[...]

7 Contents Taking a disk offline ............................................................... ........................... 118 Renaming a disk ................................................... .............................................. 119 Reserving disks .................................................... .................................[...]

8 Contents Displaying the status of the DM P path restoration thread ................. 161 Displaying information about th e DMP error-handling thread ......... 162 Configuring array policy modules .......................................................... 162 Chapter 4 Creating and administering disk groups Specifying a disk group to commands ....[...]

9 Contents Creating subdisks ........................................................................................ ....... 215 Displaying subdisk information ..................................................... ................. 216 Moving subdisks ................................................................................ ................[...]

10 Contents Creating a concatenated-mirror volume ................................................ 249 Creating a volume with a vers ion 0 DCO volume ................... ...................... 250 Creating a volume with a vers ion 20 DCO volume .......................... ............. 252 Creating a volume with dirty region logging enabled ........[...]

11 Contents Adding a RAID-5 log using vxplex ...........................................................283 Removing a RAID-5 log .................................................. ........................... 284 Resizing a volume ................................................................... ........................... 284 Resizing volumes us[...]

12 Contents Adding a snapshot to a cascaded snapshot hierarchy ......................... 337 Refreshing an instant snapshot .......... .................................................... 337 Reattaching an instant snapshot ............................................................ 338 Reattaching a linked break-off snapshot volume ..............[...]

13 Contents Chapter 12 Administe ring hot-relo cation How hot-relocation works ..................................................... ........................... 380 Partial disk failure mail messages ...........................................................383 Complete disk failure mail messages ...................................................[...]

14 Contents Converting a disk group from shared to private ................................... 424 Moving objects between disk groups ...................................................... 424 Splitting disk groups ................................................. ................................ 424 Joining disk groups ............................[...]

15 Contents Running a rule ................................................................. ........................... 447 Identifying configuration problem s using Sto rage Expert ........ ................. 449 Recovery time .................................................................. ........................... 449 Disk groups ...........[...]

16 Contents Dirty region logging guidelines ............................................................ ... 515 Striping guidelines ............ ..................................................................... ... 515 RAID-5 guidelines .................................. .................................................... 516 Hot-relocation g[...]

Chap ter 1 Understanding Veritas Volume Manager Veritas TM Volume Manager (VxVM) by Syma ntec is a storage management subsystem that allows yo u to manage ph ysical disks as logical devices called volumes. A VxVM volume appears to applic ations and the operating system as a physical disk on which file systems, databases and other managed data objec[...]

18 Understanding Verita s Volume Manager ■ Volume snapshots ■ FastResync ■ Hot-relocation ■ Volume sets Further information on administering Veritas Volume Manager may be found in the following documents: ■ Veritas Storage Foundation Cross-Platfo rm Data Sharing Administra tor’s Guide Provides more information on using th e Cross-platfo[...]

19 Understanding Veritas Volume Manager VxVM and the ope rating system VxVM and the operating system VxVM operates as a subsystem between your operating system and your data management systems, such as file syst ems and database management systems. VxVM is tightly coupled with the operati ng system. Before a disk can be brought under VxVM control, [...]

20 Understanding Verita s Volume Manager How VxVM hand les storage management How VxVM handles storage management VxVM uses two types of objec ts to handle storage management: physical objects and virtual objects . ■ Physical objects—physical disks or other har dwar e with block and r aw oper ating sy stem device int erfaces that ar e used to s[...]

21 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt VxVM writes identification information on physical disks under VxVM control (VM disks). VxVM disks can be identified even after physical disk disconnection or system outages. VxVM can then re-form disk groups and logical objects to provide failure detection an d to speed [...]

22 Understanding Verita s Volume Manager How VxVM hand les storage management Figure 1-2 How VxVM presents the disks in a disk array as volumes to the operating system Multipathed disk arrays Some disk arrays provide multiple po rts to access their disk devices. These ports, coupled with the host bus adapto r (HBA) controller and any data bus or I/[...]

23 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt Device Discovery service enables you to add support dynamically for new disk arrays. This operation, which uses a faci lity called the Device Discovery Layer (DDL), is achieved without the need for a reboot. This means that you can dyn amically add a new disk array to a h[...]

24 Understanding Verita s Volume Manager How VxVM hand les storage management Figure 1-3 Example configuration for disk enclosures connected via a fibre channel hub or switch In such a configuration, enclosure-base d naming can be used to refer to each disk within an enclosure. For example, the device names for the disks in enclosure enc0 are named[...]

25 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt In High Availability (HA) configuratio ns, redundant-l oop access to storage can be implemented by connecting independent controllers on the host to separate hubs with independent paths to the enclosures as shown in Figure 1-4 . Figure 1-4 Example HA configurat ion using [...]

26 Understanding Verita s Volume Manager How VxVM hand les storage management See “ Disk device naming in VxVM ” on page 78 and “ Changing the disk-nam ing scheme ” on page 91 for details of the standa rd and the enclosure-based naming schemes, and how to switch between them. Virtual objects Virtual objects in VxVM include the following: ?[...]

27 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt ■ Subdisks ( each r epresent ing a specific region of a disk ) are c ombined to f orm plex es ■ V olumes are c omposed of one or more ple xes Figure 1-5 shows the connections between Veritas Volume Manager virtual objects and how they relate to physical disks. The dis[...]

28 Understanding Verita s Volume Manager How VxVM hand les storage management Veritas Volume Manager, such as data change objects (DCOs), and cache objects, to provide extended functionality. Thes e objects are discussed later in this chapter. Disk groups A disk gr oup is a collec tion of disks that share a common configurat ion, and which are mana[...]

29 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt Figure 1-6 VM disk example Subdisks A subdisk is a set of co ntiguous disk blocks. A block is a unit of space on the disk. VxVM allocates disk space using subdisks. A VM disk can be divided into one or more subdisks. Each subdisk represents a spec ific portion of a VM dis[...]

30 Understanding Verita s Volume Manager How VxVM hand les storage management Figure 1-8 Example of three subdisks assigned to one VM Disk Any VM disk space that is not part of a subdisk is free space. You can use free space to create new subdisks. VxVM release 3.0 or higher supports the concept of layered volumes in which subdisks can contain volu[...]

31 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt You can organize data on subdisks to form a plex by using the following methods: ■ conc atenation ■ striping (RAID-0) ■ mirr oring (R AID-1) ■ striping with parity (RAID-5) Concatenation, striping (RAID-0), mirroring (R AID-1) and RAID-5 are described in “ Volum[...]

32 Understanding Verita s Volume Manager How VxVM hand les storage management Note: You can use the Veritas Inte lligent Storage Provisio ning (ISP) feature to create and administer appl icatio n volumes. These vo lu mes are very simi lar to the traditional VxVM volume s that are described in th is chapter. However, there are significant difference[...]

33 Understanding Veritas Volume Manager How VxVM handl es storage manageme nt In Figure 1-11 a volume, vol06 , with two data plexes is mirro red . Each plex of the mirror contains a complete copy of the volu me data. Figure 1-11 Example of a volume with two plexes Volume vol06 has the following characteristics: ■ It c ontains two ple xes named vo[...]

34 Understanding Verita s Volume Manager V olu me layouts in VxV M Volume layouts in VxVM A VxVM virtual device is defined by a volum e. A volume has a layout defi ned by the association of a volume to one or more plexes, each of which map to subdisks. The volume presents a virtual devi ce interface that is exposed to other applications for data ac[...]

35 Understanding Veritas Volume Manager V olu me layouts in VxVM Layout methods Data in virtual objects is organized to create volumes by using the following layout methods: ■ Concatenation and spanning ■ Striping (RAID-0) ■ Mirroring (RAID-1) ■ Striping plus mirroring (mirrored-stripe or RAID-0+1) ■ Mirroring plus striping (striped-mirro[...]

36 Understanding Verita s Volume Manager V olu me layouts in VxV M Figure 1-12 Example of conca tenation You can use concatenation with multiple subdisks when there is insufficient contiguous space for the plex on any one disk. This form of concatenation can be used for load balancing between disks, and for head movement optimization on a particula[...]

37 Understanding Veritas Volume Manager V olu me layouts in VxVM Figure 1-13 Example of spanning Caution: Spanning a plex across multiple disks increases the chance that a disk failure results in failure of the assigned volume. Use mirroring or RAID-5 (both described later) to reduce th e risk that a single disk failure results in a volume failure.[...]

38 Understanding Verita s Volume Manager V olu me layouts in VxV M Striping (RAID-0) Note: You need a full license to use this feature. Striping (RAID-0) is useful if you need large amounts of data written to or read from physical disks, and performance is im portant. Striping is also helpful in balancing the I/O load from multi-user applications a[...]

39 Understanding Veritas Volume Manager V olu me layouts in VxVM Figure 1-14 Striping across three columns A stripe consists of the set of stripe units at the same positions across all columns. In the figure, stripe units 1, 2, and 3 constitute a single stripe. Viewed in sequence, the first stripe consists of: ■ stripe unit 1 in column 0 ■ stri[...]

40 Understanding Verita s Volume Manager V olu me layouts in VxV M Figure 1-15 shows a striped plex with three equ a l sized, single-subdisk columns. There is one column per physical disk. Th is example shows three subdisks that occupy all of the space on the VM disks. It is also possible for each subdisk in a striped plex to occupy only a portion [...]

41 Understanding Veritas Volume Manager V olu me layouts in VxVM Figure 1-16 Example of a striped pl ex with concatenated subdisks per column See “ Creating a striped volume ” on page 253 for information on how to create a striped volume. Subdisks Physical disks Column 2 Striped ple x Stripe units su2 su3 su5 su6 Column 0 de vname3 de vname2 de[...]

42 Understanding Verita s Volume Manager V olu me layouts in VxV M Mirroring (RAID-1) Note: You need a full license to use this fe ature with disks other than the r oot disk. Mirr oring uses multiple mirrors (plexes) to duplicate the information contained in a volume. In the event of a physical di sk failure, the plex on the failed disk becomes una[...]

43 Understanding Veritas Volume Manager V olu me layouts in VxVM Figure 1-17 Mirrored-stripe volume laid out on six di sks See “ Creating a mirrored-stripe volume ” on page 254 for information on how to create a mirrored-stripe volume. The layout type of the data plexes in a mirror can be concatenated or striped. Even if only one is striped, th[...]

44 Understanding Verita s Volume Manager V olu me layouts in VxV M Figure 1-18 Striped-mirror volume laid out on six disks See “ Creating a striped-mirror volume ” on page 254 for information on how to create a striped-mirrored volume. As shown in Figure 1-19 , the failure of a disk in a mirrored- stripe layout detaches an entire data plex, the[...]

45 Understanding Veritas Volume Manager V olu me layouts in VxVM Figure 1-19 How the failure of a single disk affects mirrored-s tripe and striped- mirror volumes Compared to mirrored-stripe volume s, striped-mirror volumes are more tolerant of disk failure, an d recovery time is shorter. If the layered volume concatenates inst ead of striping the [...]

46 Understanding Verita s Volume Manager V olu me layouts in VxV M Although both mirroring (R AID-1) and RAID-5 provide redundancy of data, they use different methods. Mirroring provide s data redundancy by maintaining multiple complete copies of the data in a volume. Data being writ ten to a mirrored volume is reflected in all copie s. If a portio[...]

47 Understanding Veritas Volume Manager V olu me layouts in VxVM parity stripe. Figure 1-21 shows the row and column arrangement of a traditional RAID-5 array. Figure 1-21 T raditional RAID-5 array This traditional array structure suppo rts growth by adding more rows per column. Striping is accompli shed by applying the firs t stripe ac ross the di[...]

48 Understanding Verita s Volume Manager V olu me layouts in VxV M Figure 1-22 V eritas V olume Manager RAID-5 array Note: Mirroring of RAID-5 volumes is not supported. See “ Creating a RAID-5 volume ” on page 256 for information on how to create a RAID-5 volume. Left-symmetric layout There are several layouts for da ta and parity that can be u[...]

49 Understanding Veritas Volume Manager V olu me layouts in VxVM Figure 1-23 Left-symmetric l ayout For each stripe, data is orga nized starting to the right of the parity stri pe unit. In the figure, data organization for the firs t stripe begins at P0 and continues to stripe units 0-3. Data organization for the second stripe begins at P1, then co[...]

50 Understanding Verita s Volume Manager V olu me layouts in VxV M Note: Failure of more than one column in a RAID-5 plex detaches the volume. The volume is no longer allowed to s atisf y read or write requests. Once the failed columns have been recovered, it may be necessary to recover user data from backups. RAID-5 logging Log g i n g is used to [...]

51 Understanding Veritas Volume Manager V olu me layouts in VxVM Logs are associated with a RAID-5 volum e by being attached as log plexes. More than one log plex can exist for each RAID -5 volume, in which case the log areas are mirrored. See “ Adding a RAID-5 log ” on page 283 for information on how to add a RAID-5 log to a RAID-5 volume. Lay[...]

52 Understanding Verita s Volume Manager V olu me layouts in VxV M Figure 1-25 Example of a striped-mirror la yered volume Figure 1-25 illustrates the structure of a typical layered volume. It shows subdisks with two columns, built on un derlying volumes with each volume internally mirrored. Th e volume and striped plex in the “Managed by User”[...]

53 Understanding Veritas Volume Manager V olu me layouts in VxVM plex (for example, resizing the volume, ch anging the column width, or adding a column). System administrators ca n manipulate the layered volume structure for troubleshooting or other operations (for example, to place data on specific disks). Layered volumes are used by Vx VM to perf[...]

54 Understanding Verita s Volume Manager Online rela yout Online relayout Note: You need a full license to use this feature. Online relayout allows you to convert between storage layouts in VxVM, with uninterrupted data acces s. Typically, you would do this to change the redundancy or performance characteristics of a volume. VxVM adds redundancy to[...]

55 Understanding Veritas Volume Manager Online relayout amount of temporary space that is requi red is usually 10% of the size of the volume, from a minimum of 50MB up to a maximum of 1GB. For volumes smaller than 50MB, the temporary space required is the same as the size of the volume. The following error message displays the number of blocks requ[...]

56 Understanding Verita s Volume Manager Online rela yout ( shown by the shaded ar ea) decr ease s the o ver all storag e space that the vo lu m e re q u i re s . Figure 1-27 Example of rela yout of a RAID -5 volume to a striped volume ■ Change a v olume to a RAID-5 v olume ( add parity ). See Figure 1-28 fo r a n ex ample. Note that adding par i[...]

57 Understanding Veritas Volume Manager Online relayout Figure 1-30 Example of increasi ng the stripe width for the colu mns in a volume For details of how to perform on line relayout operations, see “ Performing online relayout ” on page 294. For information about the relayout transformations that are possible, see “ Permitted relayout trans[...]

58 Understanding Verita s Volume Manager Online rela yout ■ The number of mirrors in a mirr or ed volume cannot be changed using re l a yo u t . ■ Only one r elayout may be applied to a v olume at a time. Transformation characteristics Transformation of data from one layout to anoth er involv es rearrangement of data in the existing layou t to [...]

59 Understanding Veritas Volume Manager V olume resynchronizatio n Volume resynchronization When storing data redundantly an d usin g mirrored or RAID-5 volumes, VxVM ensures that all copies of the data match exactly. However, under certain conditions (usually due to complete system failures), some redundant data on a volume can become inco nsisten[...]

60 Understanding Verita s Volume Manager Dirty region log ging Resynchronization of data in the volume is done in the background. This allows the volume to be availabl e for us e while recovery is taking place. The process of resynchronization can im pact system performance. The rec overy process reduces some of this impact by spreading the recover[...]

61 Understanding Veritas Volume Manager Dirty region log ging becomes the least recently accessed for writ es. This allows writes to the same region to be written immediately to disk if the region’s log bit is set to dirty. On restarting a system after a crash, Vx VM recovers only those regions of the volume that are marked as dirty in the dirty [...]

62 Understanding Verita s Volume Manager Dirty region log ging SmartSync recovery accelerator The SmartSync feature of Veritas Volume Manager increases the availability of mirrored volumes by only resynchronizing changed data. (The process of resynchronizing mirrored databases is also sometimes referred to as r esilvering .) SmartSync reduces the t[...]

63 Understanding Veritas Volume Manager V olu me snapshots Redo log volume configuration A re d o l o g is a log of changes to the database data. Because the database does not maintain changes t o the redo logs, it cannot provide information about which sections require resilvering. Redo logs a re also written sequentially, and since traditional di[...]

64 Understanding Verita s Volume Manager V olu me snapshots Figure 1-31 V olume snapsho t as a point-in-time image of a volume The traditional type of volume snapshot in VxVM is of the th ird-mirr or br eak-off type. This name comes from its implemen tation where a snapshot plex (or third mirror) is added to a mirrored volume. The contents of the s[...]

65 Understanding Veritas Volume Manager V olu me snapshots mirror snapshots such as immediate availability and easier configuration and administration. You can also use the th ird-mirror break-off usage model with full-sized snapshots, where this is necessa ry for write-intensive applications. For more information, see the following sections: ■ ?[...]

66 Understanding Verita s Volume Manager Fast Re sy nc FastResync Note: You need a Veritas FlashSnap or FastResync license to use this feature. The FastResync feature (previously ca lled Fast Mirror Resynchronization or FMR) performs quick and efficient resynch ronization of stale mirrors (a mirror that is not synchronized). This increases the effi[...]

67 Understanding Veritas Volume Manager FastResync snapshot is taken, it can be accessed in dependently of the volume from which it was taken. In a clustered VxVM environmen t with shared access to storage, i t is possible to eliminate the resource co ntention and perfor mance overhead of using a snapshot simply by accessing it from a different nod[...]

68 Understanding Verita s Volume Manager Fast Re sy nc Availability (HA) environment requires the full resynchroni zation of a mirror when it is reattached to its parent volume. How non-persistent F astResy nc works with snapshots The snapshot feature of Vx VM takes advantag e of Fast Resync change trac king to record updates to the orig inal volum[...]

69 Understanding Veritas Volume Manager FastResync V ersion 0 DCO volume la yout In VxVM releases 3.2 and 3.5, the DCO object only managed information about the FastResync maps. These maps track writes to the original volume and t o each of up to 32 snapshot volumes since the last snapshot operation. Each plex of the DCO volume on disk holds 33 map[...]

70 Understanding Verita s Volume Manager Fast Re sy nc (by default) are used either for tracking writes to snapshots, or as copymaps. The size of the DCO volume is determined by the size of the regions that are tracked, and by the number of per-volume maps. Both the region size and the number of per-volume maps in a DCO volu me may be configu red w[...]

71 Understanding Veritas Volume Manager FastResync Figure 1-32 Mirrored volume with persis tent F astResync enabled To create a traditional third-mirror snapshot or an instant (copy-on-write) snapshot, the vxassist snapstart or vxsnap make operation respectively is performed on the volume. This sets up a snapshot plex in the volume and associates a[...]

72 Understanding Verita s Volume Manager Fast Re sy nc Note: Space-optimized instant snapshots do not require additional full-sized plexes to be created. Instead, they us e a storage cache that typically requires only 10% of the storage that is required by full-sized snapshots. There is a trade- off in functionality in using space-optimized snapsho[...]

73 Understanding Veritas Volume Manager FastResync Note: The vxsnap reattach , dis and split operations are not supported for instant space-optimized snapshots. See “ Administering volume snapshots ” on page 303, and the vxsnap (1M) and vxassist (1M) manual pages for more information. Figure 1-34 Mirrored volume and snapshot vo lume after compl[...]

74 Understanding Verita s Volume Manager Fast Re sy nc different effects on the map that FastResync uses to track changes to the original volume: ■ F or a v ersion 20 DCO v olume, the size of the map is incre ased and the size of the re gion that is t r ack ed by ea ch bit in the map stays the same. ■ F or a ver sion 0 DCO v olume, the size of [...]

75 Understanding Veritas Volume Manager Hot-relocation association. H owe ver , in such a case, y ou can use the vxplex snapback command with the -f (for ce ) option t o perform the snapback. Note: This restriction only applies to tradit ional snapshots. It does not apply to instant snapshots. ■ Any oper ation that chang es the lay out of a repli[...]

76 Understanding Verita s Volume Manager V olu me sets and availability characterist ics of the underlying volumes. For example, file system metadata could be stored on volumes with higher redundancy, and user data on volumes with better performance. For more information about creating and administering volume sets, see “ Creating and administeri[...]

Chap ter 2 Administering disks This chapter describes the operations fo r managing disks us ed by the Veritas Volume Manager (VxVM). This includes placing disks under VxVM control, initializing disks, mirroring the root disk, and removing and replacing disks. Note: Most VxVM commands require superuser or equivalent pri vileges. Disks that are contr[...]

78 Administe ring disks Disk devices and /dev/rdisk directories. To maintain backwa rd compatibility, HP-UX also creates legacy devices in the /dev/dsk and /dev/rdsk directories. VxVM recreates disk devices for all path s in the operating system’s hardware device tree as metadevices ( DMP nodes ) in the /dev/vx/dmp and /dev/vx/rdmp directories. T[...]

79 Ad ministering d isks Disk devi ces The syntax of a legacy devi ce name is c # t # d # , where c# represents a controller on a host bus adapt er, t# is the target controller ID, and d# identifies a disk on the target controller. Fabric mode disk devices are na med as follows: ■ Disks in supported disk arr ay s are named using the enclosure nam[...]

80 Administe ring disks Disk devices Private and public disk regions Most VM disks have two regions: priva te region A small area where configuration information is stored. A disk header label, configuration records for VxVM objects (such as volumes, plexes and subdisks), and an intent log for the configuration database are sto red here. The defaul[...]

81 Ad ministering d isks Disk devi ces auto When the vxconfigd daemon is started, VxVM obtains a list of known disk device addresses from the operating system and configures disk access recor ds for them automatically. Auto-configured disks (with disk access type auto ) support the following disk formats: cdsdisk The disk is formatted as a Cro ss-p[...]

82 Administe ring disks Discovering and configuring newly added disk devices Discovering and configuring newly added disk devices When you physically connect new disks to a host or when you zone new fibre channel devices to a host, you can use the vxdctl enable command to rebuild the volume device node directories and to update t he DMP internal da[...]

83 Ad ministering d isks Discovering and configuring newly added disk devices Alternatively, you can specify a ! prefix ch aracter to indicate that you want to scan for all devices exce pt those that are listed: # vxdisk scandisks !device=c1t1d0,c2t2d0 You can also scan for devices that are co nnected (or not connected) to a list of logical or phys[...]

84 Administe ring disks Discovering and configuring newly added disk devices Adding support for a new disk array The following example illustrates how to add support for a new disk array named vrtsda to an HP-UX system using a vendor-supplied package on a mounted CD-ROM: # swinstall -s /cdrom vrtsda The new disk array does not need to be already co[...]

85 Ad ministering d isks Discovering and configuring newly added disk devices See “ Changing device naming for TPD-controlled enclosures ” on page 94 for information on how to chan ge the form of TPD device names that are displayed by VxVM. See “ Displaying information about TPD-controlled devices ” on page 143 for details of how to find ou[...]

86 Administe ring disks Discovering and configuring newly added disk devices This command displays the vendor ID ( VID ), product IDs ( PID s) for the arrays, array types (for example, A/A or A/P), and array names. The fo llowing is sample output. # vxddladm listsupport libname=libvxfujitsu.so ATTR_NAME ATTR_VALUE ==================================[...]

87 Ad ministering d isks Discovering and configuring newly added disk devices Listing suppo rted disks in the DISKS category To list disks that are supported in the DISKS (JBOD) category, use the following command: # vxddladm listjbod Adding unsupported disk ar rays to the DISKS category Disk arrays should be added as JBOD devi ces if no ASL is ava[...]

88 Administe ring disks Discovering and configuring newly added disk devices [length= serialno_length ] [policy=ap] where vendorid and pr oduc tid are the VID and PID values that you found from the previous step. For example, vendorid might be FUJITSU , IBM , or SEAGATE . For Fujitsu devices, you must also specify the number of characters in the se[...]

89 Ad ministering d isks Discovering and configuring newly added disk devices For more information, enter the command vxddladm help addjbod , or see the vxddladm (1M) and vxdmpadm (1M) manual pages. Removing disks from the DISK S categor y To remove disks from the DISKS (JBOD) category, use the vxddladm command with the rmjbod keyword. The followin[...]

90 Administe ring disks Placing disks under VxVM control ■ Enclosur e inf ormation is not av ailable t o V xVM. This can reduc e the av ailability of any disk gr oups that ar e cre ated using such dev ices. ■ EFI disks that ar e under the c ontrol of HP-UX nati ve multipathing c annot be initialized as f or eign disks. Y ou must migrate the s y[...]

91 Ad ministering d isks Changing the di sk -naming scheme ■ If the disk was pr eviously in use b y the L VM su bsy stem, you can pr eserve exist ing data while still let ting V xVM take c ontr ol of the disk. This is acc omplished using con ve rs io n . With c onver sion, the virtual lay out of the data is fully c onv erted to V xVM contr ol ( s[...]

92 Administe ring disks Changing the di sk -naming scheme Alternatively, you can change the nami ng scheme from the command line. The following commands select enclosure-based and operating system-based naming respectively: # vxddladm set namingscheme=ebn [ persistence= { yes | no }] # vxddladm set namingscheme=osn [ mode= { default | legacy | new [...]

93 Ad ministering d isks Changing the di sk -naming scheme # vxdmpadm getlungroup dmpnodename=disk25 VxVM vxdmpadm ERROR V-5-1-10910 Invalid da-name # vxdmpadm getlungroup dmpnodename=Disk_11 NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME =============================================================== Disk_11 ENABLED Disk 2 2 0 Disk To find out w[...]

94 Administe ring disks Changing the di sk -naming scheme Changing device naming for TPD-controlled enclosures Note: This feature is available only if the default disk-naming scheme is set to use operating system-based naming, and the T PD-controlled enclosure does not contain fabric disks. For disk enclosures that are controll ed by third-party dr[...]

95 Ad ministering d isks Changing the di sk -naming scheme ■ Persistent simple or nopriv disks in the boot disk group ■ Persistent simple or nopriv disks in non-boot disk groups These procedures use the vxdarestore utility to handle errors in persistent simple and nopriv disks that arise from changing to the enclosure-based naming scheme. You d[...]

96 Administe ring disks Installing and formatting disks 3 If yo u want to use enc losure-based naming, use vxdiskadm t o add a non-persist ent simple disk to the bootdg disk gr oup, chang e back to the enclosur e-based naming scheme, an d then run the followin g command: # /etc/vx/bin/vxdarestore Note: If not all the disks in bootdg go into the err[...]

97 Ad ministering d isks Displaying and ch anging defa ult disk layout attri butes Displaying and changing default disk layout attributes To display or change the default values fo r initializi ng disk s, select menu item 21 (Change/display the default disk layout) from the vxdiskadm main menu. For disk initialization, you can change the defa ult f[...]

98 Administe ring disks Adding a disk to VxVM disks available for use as replacement disks. More than one disk or pattern may be entered at the prompt. Here are some disk selection examples: all: all disks c3 c4t2: all disks on both controller 3 and controller 4, target 2 c3t4d2: a single disk (in the c#t#d# naming scheme) xyz_0: a single disk (in [...]

99 Ad ministering d isks Adding a disk to VxVM 3 T o continue with the oper ation, enter y ( or pr ess Return ) at the f ollowing pr ompt: Here are the disks selected. Output format: [Device] list of device names Continue operation? [y,n,q,?] (default: y) y 4 At the f ollowing pr ompt, specify the disk group t o which the disk should be added, or n[...]

100 Administe ring disks Adding a disk to VxVM A site tag is usually applied to disk arrays or enclosures, and is not required unless you want to use the Remote Mirror feature. If you enter y to choose to add a site tag, you are prompted to the site name at step 11 . 10 T o continue with the oper ation, enter y ( or pr ess Return ) at the follow in[...]

101 Administerin g disks Adding a disk to VxVM vxdiskadm then proceeds to add the disks. Adding disk device de vice name to disk group disk group name with disk name disk nam e . . . . Note: To bring LVM disks under VxVM control, use the Migration Utilities. See the Veritas Volume Manager Migration Guide for details. 15 At the f ollowing pr ompt, i[...]

102 Administe ring disks Rootab ility Note: If you are adding an uninitialized disk, warning and error messages are displayed on the console during the vxdiskadd command. Ignore these messages. These messages should not a ppear after the disk has been fully initialized; the vxdiskadd command displays a success message when the initialization comple[...]

103 Administerin g disks Rootability VxVM root disk volume restrictions Volumes on a bootable VxVM root disk have the following configuration restrictions: ■ All volumes on the r oot disk must be in the disk gr oup that you c hoose to be the bootdg disk gr oup. ■ The names of the v olumes with entries in the LIF LABEL rec ord must be standvol ,[...]

104 Administe ring disks Rootab ility Booting root volumes Note: At boot time, the system firmware pro vides you with a short time period during which you can manu ally override the automatic boot process and select an alternate boot device. For informatio n on how to boot your system from a device other than the primary or altern ate boot devices,[...]

105 Administerin g disks Rootability Note: The -b option to vxcp_lvmroot uses the setboot command to define c0t4d0 as the primary boot device. If this option is not specified, the primary boot device is not changed. If the destination VxVM root disk is n ot big enough to accommodate the contents of the LVM root disk, you can use the -R option to sp[...]

106 Administe ring disks Rootab ility Note: You may want to keep the LVM root disk in case you ever need a boot disk that does not depend on VxVM being present on the system. However, this may require that you update the contents of the LVM root disk in parallel with changes that you make to the VxVM root disk. See “ Creating an LVM root disk fro[...]

107 Administerin g disks Rootability Adding swap volumes to a VxVM rootable system T o add a swap volume to an HP-UX system with a VxVM root disk 1 Initializ e the disk that is to be used to hold the swap v olume (f or example, c2t5d0 ), and add it to the boot disk group with the disk media name “ swapdisk ”: # /etc/vx/bin/vxdisksetup -i c2t5d0[...]

108 Administe ring disks Dynamic LUN expans ion Removing a persistent dump volume Caution: The system will not boot correctly if you delete a dump volume without first removing it from the crash dump configuration. Use this procedure to remove a du mp volume from t he crash dump configuration. T o remove a persistent dump volume 1 Run the follow in[...]

109 Administerin g disks Dynamic LU N expansion Any volumes on the device should only be grown after the device itself has first been grown. Otherwise, storage other than the device may be used to grow the volumes, or the volume resize may fai l if no free storage is available. Resizing should only be performed on devices that preserve data. Consul[...]

110 Administe ring disks Removing disks Removing disks Note: You must disable a disk group as des cribed in “ Disabling a disk group ” on page 207 before you can remove the last disk in that group. Alternatively, you can destroy the disk group as described in “ Destroying a disk group ” on page 208. You can remove a disk f rom a system and [...]

111 Administerin g disks Removing disks Continue with operation? [y,n,q,?] (default: y) The vxdiskadm utility removes the disk from the disk group and displa ys the following success message: VxVM INFO V-5-2-268 Removal of disk mydg01 is complete. You can now remove the disk or leave it on your system as a replacement. 5 At the f ollowing pr ompt, [...]

112 Administe ring disks Removing a disk from V xVM control Removing a disk with no subdisks To remove a disk that contains no su bdisks from its disk group, run the vxdiskadm program and select item 2 (Remove a disk) from the main menu, and respond to the prompts as shown in this example to remove mydg02 : Enter disk name [<disk>,list,q,?] m[...]

113 Administerin g disks Removing and replacing disks T o replace a disk 1 Select menu item 3 (Remove a disk for replacement) from the vxdiskadm main menu. 2 At the f ollowing pr ompt, enter the name of the disk to be replac ed ( or enter list f or a list of disks ): Remove a disk for replacement Menu: VolumeManager/Disk/RemoveForReplace Use this m[...]

114 Administe ring disks Removing and replacing disks The following devices are available as replacements: c0t1d0 You can choose one of these disks now, to replace mydg02. Select “none” if you do not wish to select a replacement disk. Choose a device, or select “none” [<device>,none,q,?] (default: c0t1d0) Note: Do not choose the old d[...]

115 Administerin g disks Removing and replacing disks VxVM NOTICE V-5-2-158 Disk replacement completed successfully. 9 At the f ollowing pr ompt, indicate whether y ou want to remo ve another disk ( y ) or r eturn to the vxdiskadm main menu ( n ): Remove another disk? [y,n,q,?] (default: n) Note: If removing a disk causes one or more volumes to be [...]

116 Administe ring disks Removing and replacing disks c0t1d0 c1t1d0 You can choose one of these disks to replace mydg02. Choose "none" to initialize another disk to replace mydg02. Choose a device, or select "none" [<device>,none,q,?] (default: c0t1d0) 4 Depending on whether the r eplacement disk was pr eviously initializ [...]

117 Administerin g disks Enabling a disk 8 After using the vxdiskadm c ommand to r eplace one or mor e failed disks in a V xVM cluster , run the f ollowing c ommand on all the cluster nodes: # vxdctl enable Then run the following co mmand on the master node: # vxreattach -r accesname where accessname is the disk access name (such as c0t1d0 ). This [...]

118 Administe ring disks Ta k i n g a d i s k o f f l i n e vxdiskadm enables the specified device. 3 At the f ollowing pr ompt, indicate whether y ou want t o enable another device ( y ) or return t o the vxdiskadm main menu ( n ): Enable another device? [y,n,q,?] (default: n) Taking a disk offline There are instances when you must take a di sk of[...]

119 Administerin g disks Renaming a disk Renaming a disk If you do not specify a VM disk name, Vx VM gives the disk a default name when you add the disk to VxVM control. The VM disk name is used by VxVM to identify the location of the disk or t he disk type. To change the disk name to reflect a change of use or ownership, use the following command:[...]

120 Administe ring disks Displaying disk information The vxassist command overrides the reservatio n and creates a 20 megabyte volume on mydg0 3 . However, the command: # vxassist -g mydg make vol04 20m does not use mydg0 3 , even if there is no free space on any other disk. To turn off reservation of a di sk, use the following command: # vxedit [-[...]

121 Administerin g disks Displaying disk information Displaying disk information with vxdiskadm Displaying disk information shows you whic h disks are initialized, to which disk groups they belong, and the disk status. The list command displays device names for all recognized disks, the disk names, the disk group names as sociated with each disk, a[...]

122 Administe ring disks Controlling P owerfail Timeout Controlling Powerfail Timeout Powerfail Timeout is an attribute of a SCSI disk connected to an HP-UX host. This is used to detect and handle I/O on non-responding disks. See the pfto (7) man pag e. VxVM uses this mechanism in its Pow erfail Timeout (pfto) feature. You can specify a timeout val[...]

123 Administerin g disks Controllin g Powerfail Timeo ut Enabling or disabling PFTO To enable or disable PFTO on a disk, use the following command: $ vxdisk -g dg_name set disk_name pftostate={enabled|disabled} For example, to disable PF TO on the disk c5t0d6: $ vxdisk -g testdg set c5t0d6 pftostate=disabled To enable or disable PFTO on a disk grou[...]

124 Administe ring disks Controlling P owerfail Timeout[...]

Chap ter 3 Administering dynamic multipathing (DMP) The dynamic multipathing (DMP) featu re of Veritas Volume Manager (VxVM) provides greater availability, reliability and performance by using path failover and load balancing. This feature is avai lable for multiported disk arrays from various vendors. DMP coexists with the native mult ipathi ng in[...]

126 Administering dyn amic multipathing (DMP) How DMP works For Active/Passive arrays with L UN group failover (A/PG arrays), a group of LUNs that are connected through a controller is treated as a single failover entity. Unlike A/P arrays, failover occurs at the controller level, and not for individual LUNs. The primary and secondary controller ar[...]

127 Administe ring dynamic multipathing (DMP) How DMP works Figure 3-1 How DMP represents multi ple phys ical paths to a disk as one node As described in “ Enclosure-based naming ” on page 23, VxVM implements a disk device naming scheme that allows you to recognize to which array a disk belongs. Figure 3-2 , shows an example where two paths, c1[...]

128 Administering dyn amic multipathing (DMP) How DMP works See “ Changing the disk-naming scheme ” on page 91 for details of how to change the naming scheme that VxVM uses for disk devices. See “ Discovering and configuring newly added disk devices ” on page 82 for a description of how to make newly added disk hardware known to a host syst[...]

129 Administe ring dynamic multipathing (DMP) How DMP works DMP is also informed when a connection is repaired or restored, and when you add or remove devices after the system ha s been fully booted (provided that the operating system recognizes the devices correctly). If required, the response of DMP to I/O failure on a path can be tuned for the p[...]

130 Administering dyn amic multipathing (DMP) How DMP works DMP coexistence with HP -UX native multipathing The HP-UX 11i v3 release includes suppo rt for native multipathing, which can coexist with DMP. HP-UX native mu ltipathing creates a persistent ( agile ) device in the /dev/disk and /dev/rdisk directories for each disk that can be accessed by[...]

131 Administe ring dynamic multipathing (DMP) How DMP works 3 Rest art all the v olumes in each disk gr oup: # vxvol -g diskgroup startall The output from the vxdisk list command now shows only HP-UX native multipathing metanode names, for example: # vxdisk list DEVICE TYPE DISK GROUP STATUS disk155 auto:LVM - - LVM disk156 auto:LVM - - LVM disk224[...]

132 Administering dyn amic multipathing (DMP) How DMP works and under the new naming scheme as : # vxdisk list DEVICE TYPE DISK GROUP STATUS disk155 auto:LVM - - LVM disk156 auto:LVM - - LVM disk224 auto:cdsdisk - - online disk225 auto:cdsdisk - - online disk226 auto:cdsdisk - - online disk227 auto:cdsdisk - - online disk228 auto:cdsdisk - - online[...]

133 Administe ring dynamic multipathing (DMP) Disabling and enabling mu ltipathing for specific device s Enabling or disabling controllers with shared disk groups Prior to release 5.0, VxVM did not allo w enabling or disabling of paths or controllers connected to a disk that is part of a shared Veri tas Volume Manager disk group. From VxVM 5.0 onwa[...]

134 Administering dyn amic multipathing (DMP) Disabling and enabling mul tipathing for specific devices ◆ Select option 1 to ex clude all paths th r ough the specified c ontr oller from the view of V xVM. These paths r emain in the disabled state until the ne xt r eboot , or until the paths are r e-included. ◆ Select option 2 t o exc lude speci[...]

135 Administe ring dynamic multipathing (DMP) Disabling and enabling mu ltipathing for specific device s ? Display help about menu ?? Display he lp about the menuing system q Exit from menus ◆ Select option 1 t o make all paths thr ough a specified contr oller visible t o Vx V M . ◆ Select option 2 t o make specified paths v isible to V xVM. ?[...]

136 Administering dyn amic multipathing (DMP) Enabling and disabling I/ O for co ntrollers and storag e processors Enabling and disabling I/O for controllers and storage processors DMP allows you to turn off I/ O for a co ntroller or the array port of a storage processor so that you can perform admini strative operations. This feature can be used f[...]

137 Administe ring dynamic multipathing (DMP) Displaying DMP database information Displaying DMP database information You can use the vxdmpadm command to list DMP database information and perform other administrative tasks. This command allows you to list all controllers that are connected to disks, and other related information that is stored in t[...]

138 Administering dyn amic multipathing (DMP) Displaying the paths to a disk devicetag: c1t0d3 type: simple hostid: zort disk: name=mydg04 id=962923652.362193.zort timeout: 30 group: name=mydg id=962212937.1025.zort info: privoffset=128 flags: online ready private autoconfig autoimport imported pubpaths: block=/dev/vx/dmp/c1t0d3 privpaths: char=/de[...]

139 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm Administering DMP using vxdmpadm The vxdmpadm utility is a command line admi nistrative interface to the DMP feature of VxVM. You can use the vxdmpadm utility to perform the following tasks. ■ Retrie ve the name of the DMP device corr esponding to a partic ular path. ?[...]

140 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm The physical path is spec ified by argument to the nodename attribute, which must be a valid pat h listed in the /dev/rdsk directory. The above command displays ou tput such as the following: NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME =============================[...]

141 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm For A/P arrays in which the I/O policy is set to singleac tive , only one path is shown as ENABLED(A) . The other paths are enabled bu t not a vailable for I/O. If the I/O policy is not set to singleactive , DMP can use a group of paths (all primary or all secondary) for[...]

142 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm operations being disabled on that controller by using the vxdmpadm disable command. This form of the command lists controllers belonging to a specified enclosure and enclosure type: # vxdmpadm listctlr enclosure=enc0 type=ACME CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME =====[...]

143 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm NAME ENCLR-NAME ARRAY-PORT-ID pWWN ============================================================== c2t66d0 HDS9500V0 1A 20:00:00:E0:8B:06:5F:19 Displaying information abou t TPD-controlled devices The third-party driver (TPD) coexistence fe ature allows I/O that is contro[...]

144 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm Gathering and displa ying I/O statistics You can use the vxdmpadm iostat command to gather and display I/O statistics for a specified DMP node, enclosure, path or controller. To enable the gathering of st atistics, enter this command: # vxdmpadm iostat start [ memory= s[...]

145 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm c2t115d0 87 0 44544 0 0.001200 0.000000 c3t115d0 0 0 0 0 0.000000 0.000000 c2t103d0 87 0 44544 0 0.007315 0.000000 c3t103d0 0 0 0 0 0.000000 0.000000 c2t102d0 87 0 44544 0 0.001132 0.000000 c3t102d0 0 0 0 0 0.000000 0.000000 c2t121d0 87 0 44544 0 0.000997 0.000000 c3t121[...]

146 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm c3t115d0 0 0 0 0 0.000000 0.000000 cpu usage = 59us per cpu memory = 4096b OPERATIONS BYTES AVG TIME(ms) PATHNAME READS WRITES READS WRITES READS WRITES c3t115d0 0 0 0 0 0.000000 0.000000 Setting the attributes of the paths to an enclosure You can use the vxdmpadm setat[...]

147 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm ■ primary Defines a path as being the primary path for an Active/Passi ve disk array. The following example specifies a pri mary path for an A/P disk array: # vxdmpadm setattr path c3t10d0 pathtype=primary ■ secondary Defines a path as being the secondary pa th for a[...]

148 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm Note: Starting with release 4.1 of VxVM, I/ O policies are recorded in the file /etc/vx/dmppolicy.info , and are persistent acro ss reboots of the system. Do not edit this file yourself. The following policies may be set: ■ adaptive This policy attempts to maximize ov[...]

149 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm You can use the size argument to the partitionsize attribute to specify the partition size. The partition size in blocks is adjustable in powers of 2 from 2 up to 2^31 as illustrated in the table below: The default value for the partition size is 1024 blocks (1MB). A val[...]

150 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm ■ minimumq This policy sends I/O on paths that have the minimum number of outstanding I/O requests in the queu e for a LUN. This is suitable for low-end disks or JBODs where a signific ant track cache does not exist. No further configuration is possible as DM P automa[...]

151 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm # vxdmpadm setattr arrayname DISK iopolicy=singleactive Scheduling I/O on the paths of an Asymmetric Activ e / Active array You can specify the use_all_paths attribute in conjunction with the adaptive , balanced , minimumq , priority and round-robin I/O policies to speci[...]

152 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm # dd if=/dev/vx/rdsk/mydg/myvol1 of=/dev/null & By running the vxdmpadm iostat command to display the DMP statistics for the device, it can be seen that all I/O is being directed to one path, c5t4d15 : # vxdmpadm iostat show dmpnodename=c3t2d15 interval=5 count=2 ..[...]

153 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm c4t2d15 1086 0 1086 0 0.390424 0.000000 c4t3d15 1048 0 1048 0 0.391221 0.000000 c5t3d15 1036 0 1036 0 0.390927 0.000000 c5t4d15 1021 0 1021 0 0.392752 0.000000 The enclosure can be returned to the single active I/O policy by entering the following command: # vxdmpadm set[...]

154 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm The disable operation fails if it is iss ued to a controller that is connected to the root disk through a single path, and there are no root disk mirrors configured on alternate paths. If such mirrors exist, the command su cceeds. Enabling I/O for paths, controllers o r[...]

155 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm For a system with a volume mirrored acro ss 2 controllers on one HBA, set up the configuration as follows: 1 Disable the plex that is associated with the disk de vice: # /opt/VRTS/bin/vxplex -g diskgroup det plex 2 Stop I/ O to all disks thr ough one c ontroller of th e [...]

156 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm Configuring the response to I/O failures By default, DMP is configu red to retry a failed I/O request u p to 5 times for a single path. To display the current settings for handling I/O request failures that are applied to the paths to an enclosu re, array name or array [...]

157 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm The following example configures time -bound recovery for the enclosure enc0 , and sets the val ue of iotimeout to 60 seconds: # vxdmpadm setattr enclosure enc0 recoveryoption=timebound iotimeout=60 The next example sets a fixed-retry limit of 10 for the paths to all A[...]

158 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm The following example shows how to disabl e I/O throttling for the paths to the enclosure enc0 : # vxdmpadm setattr enclosure enc0 recoveryoption=nothrottle The vxdmpadm setattr command can be used to en able I/O throttling on the paths to a specified enclosure, di sk a[...]

159 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm Displaying recoveryoption values The following example shows the vxdmpadm getattr command being used to display the recoveryoption option values that are set on an enclosure. # vxdmpadm getattr enclosure HDS9500-ALUA0 recoveryoption ENCLR-NAME RECOVERY-OPTION DEFAULT[VAL[...]

160 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm Configuring DMP path restoration policies DMP maintains a kernel thread that re-ex amines the condition of paths at a specified interval. The type of analysis that is performed on the paths depends on the checking policy that is configured. Note: The DMP path restoratio[...]

161 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm The interval attribute must be specified for this policy. The default number of cycles between running the check_all policy is 10. The interval attribute specifies how ofte n the path restoration thread examines the paths. For example, after stopping the path restoration[...]

162 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm Displaying information about th e DMP error-handling thread To display information about the kernel thread that handle s DMP errors, use the following command: # vxdmpadm stat errord One daemon should be shown as running. Configuring array policy modules An array policy[...]

163 Administe ring dynamic multipathing (DMP) Administering DMP using vxdmpadm Note: By default, DMP uses the most recent APM that is available. Specify the -u option instead of the -a option if you want to force DMP to use an earlier version of the APM. The current version of an APM is replaced only if it is not in use. Specifying the -r option al[...]

164 Administering dyn amic multipathing (DMP) Administering DMP us ing vxdmpadm[...]

Chap ter 4 Creating and administering disk groups This chapter describes how to create and manage disk groups . Disk groups are named collections of disks that share a common configuration. Volumes are created within a disk group and are restricted to using disks within that disk group. Note: In releases of Veritas Volume Manager (VxVM) prior to 4.[...]

166 Creating and admi nistering disk gr oups As system administrator, you can create additional disk groups to arrange your system’s disks for different purposes. Ma ny systems do not use more than one disk group, unless they have a large nu mber of disks. Disks can be initialized, reserved, and added to disk groups at any time. Disks need not be[...]

167 Creating and administering disk groups Specifying a disk group to comm ands Specifying a disk group to commands Note: Most VxVM commands require superuser or equivalent privileges. Many VxVM commands allow you to specify a disk group using the -g option. For example, the following command creates a volume in the disk group, mktdg : # vxassist -[...]

168 Creating and admi nistering disk gr oups Specifying a disk group to commands Rules for determining the default disk group It is recommended that you use the -g option to specify a disk group to VxVM commands that accept this option. If you do not specify the disk group, VxVM applies rules in the following order until it determines a disk group [...]

169 Creating and administering disk groups Displaying disk gro up information If bootdg is specified as the argument to th is command, the default disk group is set to be the same as the currently defined system-wide boot disk group. If nodg is specified as the argument to the vxdctl defaultdg command, the default disk group is undefined. Note: The[...]

170 Creating and admi nistering disk gr oups Creating a disk group flags: online ready private autoconfig autoimport imported diskid: 963504891.1070.bass dgname: newdg dgid: 963504895.1075.bass hostid: bass info: privoffset=128 Displaying free space in a disk group Before you add volumes and file systems to your system, make sure you have enough fr[...]

171 Creating and administering disk groups Adding a disk to a dis k group A disk group must have at least one disk ass ociated with it. A new disk group can be created when you use menu item 1 (Add or initialize one or more disks) of the vxdiskadm command to add disks to VxVM control, as described in “ Adding a disk to VxVM ” on page 97. The di[...]

172 Creating and admi nistering disk gr oups Removing a disk from a disk grou p Removing a disk from a disk group Note: Before you can remove the last disk fr om a disk group, you must disable the disk group as described in “ Disabling a disk group ” on page 207. Alternatively, you can destroy the disk group as described in “ Destroying a dis[...]

173 Creating and administering disk groups Deporting a disk group ■ Ther e is not enough space on the remaining disk s. ■ Ple xes or striped subdisks cannot be alloc ated on differ ent disks fr om exist ing plexes or striped subdisks in the v olume. If vxdisk adm cannot move some volumes, you may need to remove some plexes from some disks to fr[...]

174 Creating and admi nistering disk gr oups Importing a disk group Enter name of disk group [<group>,list,q,?] (default: list) newdg 5 At the f ollowing pr ompt , enter y if you int end to remo ve the disks in this disk gr oup: VxVM INFO V-5-2-377 The requested operation is to disable access to the removable disk group named newdg. This disk[...]

175 Creating and administering disk groups Handling disk s with duplicated identifiers Enable access to (import) a disk group Menu: VolumeManager/Disk/EnableDiskGroup Use this operation to enable access to a disk group. This can be used as the final part of moving a disk group from one system to another. The first part of moving a disk group is to [...]

176 Creating and admi nistering disk gr oups Handling disks with dupl icated identifiers compared with the UDID that is set in the disk’s private region. If the UDID values do n ot match, the udid_mismatch flag is set on the disk. This flag can be viewed with the vxdisk list command. A new set of vxdisk and vxdg operations are provided to handle [...]

177 Creating and administering disk groups Handling disk s with duplicated identifiers # vxdg -o useclonedev=on [ -o updateid ] import mydg Note: This form of the command allows only cloned disks to be imported. All non-cloned disks remain unimported. If the clone_disk flag is set on a disk, this indicates the disk was previously imported into a di[...]

178 Creating and admi nistering disk gr oups Handling disks with dupl icated identifiers To check which disks in a disk group contain copies of this configuration information, use the vxdg listmeta command: # vxdg [-q] listmeta diskgroup The -q option can be specified to suppress detailed configuration information from being display ed. The tagged [...]

179 Creating and administering disk groups Handling disk s with duplicated identifiers These tags can be viewed by using the vxdisk listtag command: # vxdisk listtag DEVICE NAME VALUE TagmaStore-USP0_24 t2 v2 TagmaStore-USP0_25 t1 v1 TagmaStore-USP0_28 t1 v1 TagmaStore-USP0_28 t2 v2 The following command ensures that configuration database copies a[...]

180 Creating and admi nistering disk gr oups Handling disks with dupl icated identifiers To import the cloned disks, they must be assigned a new disk group name, and their UDIDs must be updated: # vxdg -n newdg -o useclonedev=on -o updateid import mydg # vxdisk -o alldgs list DEVICE TYPE DISK GROUP STATUS TagmaStore-USP0_3 auto:cdsdisk mydg03 newdg[...]

181 Creating and administering disk groups Handling disk s with duplicated identifiers DEVICE TYPE DISK GROUP STATUS EMC0_1 auto:cdsdisk EMC0_1 mydg online EMC0_27 auto:cdsdisk - - online udid_mismatch The following command imports the clon ed disk into the new disk group newdg , and updates the disk’s UDID : # vxdg -n newdg -o useclonedev=on -o [...]

182 Creating and admi nistering disk gr oups Handling disks with dupl icated identifiers As the cloned disk EMC0_15 is not tagged as t1 , it is not imported. Note that the state of the imported clon ed disks has changed from online udid_mismatch to online clone_disk . By default, the state of import ed cloned disks is shown as online clone_disk . T[...]

183 Creating and administering disk groups Renaming a disk gro up Renaming a disk group Only one disk group of a given name ca n exist per system. It is not possible to import or deport a disk gr oup when the target system already has a disk group of the same name. To avoid this problem, Vx VM allows you to rename a disk group during import or depo[...]

184 Creating and admi nistering disk gr oups Moving disks between disk g roups dgid: 774226267.1025.tweety Note: In this example, the administrator has chosen to name the boot disk group as rootdg . The ID of this disk group is 774226267.1025.tw eety . This procedure assumes that all the disks in the boot disk group are accessible by both hosts. 2 [...]

185 Creating and administering disk groups Moving disk groups between systems You can also move a disk by using the vxdiskadm command. Select item 3 (Remove a disk) from the main menu, and then select item 1 (Add or initialize a disk) . See “ Moving objects between disk groups ” on page 203 for an alternative and preferred method of moving disk[...]

186 Creating and admi nistering disk gr oups Moving disk groups be t ween system s Caution: The purpose of the lock is to ensure that dual-ported disks (disks that can be accessed simultaneously by two systems) are not used by both systems at the same time. If two systems try to acce ss the same disks at the same time, this must be managed using so[...]

187 Creating and administering disk groups Moving disk groups between systems The following error message indicates a recoverable error. VxVM vxdg ERROR V-5-1-587 Disk group groupname : import failed: Disk for disk group not found If some of th e disks in the disk group ha ve failed, you can force the disk group to be imported by specifying the -f [...]

188 Creating and admi nistering disk gr oups Moving disk groups be t ween system s minor numbers near the top of this rang e to allow for temporary device number remapping in the event that a device minor number collision may still occur. VxVM reserves the range of minor numbers from 0 to 999 for use with volumes in the boot disk grou p. For exampl[...]

189 Creating and administering disk groups Moving disk groups between systems reminor operation on the nodes that are in th e cluster to resolve the conflict. In a cluster where more than one node is joined, use a base minor number whic h does not conflict on any node. For further information on mi nor number reservation, see the vxdg (1M) manual p[...]

190 Creating and admi nistering disk gr oups Handling conflicti ng configuration copies You can use the foll owing command to discover the maximum number of volumes that are supported by VxVM on a Linux host: # cat /proc/sys/vxvm/vxio/vol_max_volumes 4079 See the vxdg (1M) manual page for more information. Handling conflicting configuration copies [...]

191 Creating and administering disk groups Handling confli cting configuration copies Figure 4-1 T ypical arrangement of a 2-node campus c luster A serial split brain condition typically arises in a cluster when a private (non- shared) disk group is imported on Node 0 with Node 1 configured as the failover node. If the network connections between t[...]

192 Creating and admi nistering disk gr oups Handling conflicti ng configuration copies for the disks in their copies of the config uration database, and also in each disk’s private region, are updated separately on that host. When the disks are subsequently re-imported into the original shared disk group, the actual serial IDs on the disks do no[...]

193 Creating and administering disk groups Handling confli cting configuration copies ■ If the other disks wer e also imported on another host, no disk can be consider ed to hav e a definitive c opy of the conf igurat ion database. The figur e below illustr ates how th is condition ca n arise for tw o disks. Figure 4-3 Example of a true serial sp[...]

194 Creating and admi nistering disk gr oups Handling conflicti ng configuration copies The following section, “ Correcting conflicting configuration information ,” describes how to fix this condition. For more information on how to se t up and maintain a remote mirror configuration, see “ Administering sites and remote mirrors ” on page 43[...]

195 Creating and administering disk groups Reorgani zing the contents of disk group s In this example, the disk group has four disks, and is split so that two disks appear to be on each side of the split. You can specify the -c option to vxsplitlines to print detailed information about each of the disk IDs from the config uration copy on a disk spe[...]

196 Creating and admi nistering disk gr oups Reorganizing th e contents of disk groups ■ T o perform online maint enance and upgr ading of fault-t olerant s ystems that can be split int o separate hos ts for this purpose, an d then rejoined. ■ T o isolate vol umes or disks fr om a disk group , and proc ess them independently on the same host or[...]

197 Creating and administering disk groups Reorgani zing the contents of disk group s imported disk gr oup exists with the same name as the tar get disk gr oup. An exist ing deported disk group is destr oy ed if it has the same name as the tar get disk gr oup (as is the c ase for the vxdg init com ma n d ). Th e split oper ation is illustra ted in [...]

198 Creating and admi nistering disk gr oups Reorganizing th e contents of disk groups Figure 4-6 Disk group join operation These operations are performed on VxVM objects such as disks or top-level volumes, and include all component objects such as sub-volumes, plexes and subdisks. The objects to be moved must be self-contained , meaning that the d[...]

199 Creating and administering disk groups Reorgani zing the contents of disk group s must recover the disk group manually as described in the section “Recovery from Incomplete Disk Group Moves” in the chapter “Recov ery from Hardware Failure” of the Veritas Volume Manager Troubleshooting Guide . Limitations of disk group split and join The[...]

200 Creating and admi nistering disk gr oups Reorganizing th e contents of disk groups within st orage pools ma y not be split or moved. See the Veritas Storage Foundation Intelligent Storage Provisioni ng Administrator’s Guide fo r a descript ion of ISP and stor age pools. ■ If a cac he object or v olume set that is to be split or mo ved uses [...]

201 Creating and administering disk groups Reorgani zing the contents of disk group s plexes were placed on the same disks as the data plexes for convenience when performing disk group split and move operations. As version 20 DCOs support dirty region logging (DRL) in addition to Persistent FastResync, it is preferable for the DCO plexes to be sepa[...]

202 Creating and admi nistering disk gr oups Reorganizing th e contents of disk groups Figure 4-7 Examples of disk group s that can and cannot be split X Snapshot Vo l u m e data plexes plex V olume DCO plex es Snapshot DCO plex X Split Snapshot Vo l u m e data plexes plex V olume DCO ple x Snap shot DCO plex V olume DCO ple x Snapshot Vo l u m e 1[...]

203 Creating and administering disk groups Reorgani zing the contents of disk group s Moving objects between disk groups To move a self-contained set of VxVM ob jects from an imported source disk group to an imported target disk group, use the following command: # vxdg [-o expand] [-o override|verify] move sourcedg tar getdg object ... The -o exp[...]

204 Creating and admi nistering disk gr oups Reorganizing th e contents of disk groups For example, the following output from vxprint shows the contents of disk groups rootdg and mydg : # vxprint Disk group: rootdg TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg rootdg rootdg - - - - - - dm rootdg02 c1t97d0 - 17678493 - - - - dm rootdg03 [...]

205 Creating and administering disk groups Reorgani zing the contents of disk group s Disk group: mydg TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg mydg mydg - - - - - - dm mydg07 c1t99d0 - 17678493 - - - - dm mydg08 c1t100d0 - 17678493 - - - - The following commands would also achieve the same result: # vxdg move mydg rootdg mydg01 my[...]

206 Creating and admi nistering disk gr oups Reorganizing th e contents of disk groups The output from vxprint after the split shows the new disk group, mydg : # vxprint Disk group: rootdg TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg rootdg rootdg - - - - - - dm rootdg01 c0t1d0 - 17678493 - - - - dm rootdg02 c1t97d0 - 17678493 - - - - [...]

207 Creating and administering disk groups Disabling a disk group Disk group: mydg TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0 dg mydg mydg - - - - - - dm mydg05 c1t96d0 - 17678493 - - - - dm mydg06 c1t98d0 - 17678493 - - - - v vol1 fsgen ENABLED 2048 - ACTIVE - - pl vol1-01 vol1 ENABLED 3591 - ACTIVE - - sd mydg01-01 vol1-01 ENABLED 359[...]

208 Creating and admi nistering disk gr oups Destroying a disk group Destroying a disk group The vxdg command provides a destroy option that rem oves a disk group from the system and frees the disks in th at disk group for reinitialization: # vxdg destroy diskgroup Caution: This command destroys all data on the disks. When a disk group is destroyed[...]

209 Creating and administering disk groups Upgrading a disk group becomes incompatible with earlier releases of VxVM that do not support the new version. Before the imported disk group is upgrad ed, no changes are made to the disk group to prevent its use on the release from which it was imported u ntil you explicitly upgrade it to the current rele[...]

210 Creating and admi nistering disk gr oups Upgrading a disk group Importing the disk group of a previous ver sion on a Veritas Volume Manager system prevents the use of features intr oduced since that version was released. The table, “ Features supported by disk group versions ,” summarizes the features that are supported by disk group versio[...]

211 Creating and administering disk groups Upgrading a disk group To list the version of a di sk group, use this command: # vxdg list dgname You can also determine the disk group version by using the vxprint command with the -l format option. To upgrade a disk group to the highes t version supported by the release of VxVM that is currently ru nning[...]

212 Creating and admi nistering disk gr oups Managing th e configuration daemon in VxVM To create a disk group with a previous version, specify the -T ve r s i o n option to the vxdg init command . For example, to create a disk group with version 120 that can be imported by a system running VxVM 4.1, use the following command: # vxdg -T 120 init ne[...]

213 Creating and administering disk groups Backing up an d restoring di sk group conf iguration da ta For more information about how to use vxdctl , refer to the vxdctl (1M) manual page. Backing up and restoring disk group configuration data The disk group configuration backup and restoration feature allows you to back up and restore all configurat[...]

214 Creating and admi nistering disk gr oups Using vxnotify to monitor configuration changes[...]

Chap ter 5 Creating and administering subdisks This chapter describes how to create and maintain subdisks . Subdisks are the low-level building blocks in a Veritas Volume Mananger (VxVM) configuration that are required to create plexes and volumes. Note: Most VxVM commands require superuser or equivalent privileges. Creating subdisks Note: Subdisks[...]

216 Creating and admini stering subdis ks Displaying s ubdisk information Note: As for all VxVM commands, the default size unit is s , representing a sector. Add a suffix, such as k for kilobyte, m for megabyte or g for gigabyte, to change the unit of size. For example, 500m would represent 500 megabytes. If you intend to use the new subdisk to bui[...]

217 Creating and administering subdisks Moving subdisks Moving subdisks Moving a subdisk copies the disk space contents of a subdisk onto one or more other subdisks. If the subdisk being move d is associated with a plex, then the data stored on the original subdisk is copied to the new subdisks. The old subdisk is dissociated from the plex, an d th[...]

218 Creating and admini stering subdis ks Joining subdisks For example, to split subdisk mydg03-02 , with size 2000 megabytes into subdisks mydg03-02 , mydg03-03 , mydg03-04 and mydg03-05 , each with size 500 megabytes, all in the disk group, mydg , use the following commands: # vxsd -g mydg -s 1000m split mydg03-02 mydg03-02 mydg03-04 # vxsd -g my[...]

219 Creating and administering subdisks Associatin g subdisks wit h plexes Subdisks can also be associated with a pl ex that already exists. To associate one or more subdisks with an existing plex, use the following command: # vxsd [-g diskgroup ] assoc plex subdisk1 [ subdisk2 subdisk3 ...] For example, to asso ciate subdisks named mydg02-01 , myd[...]

220 Creating and admini stering subdis ks Associatin g log su bdisks If the volume is enabled, the associatio n operation regenerates data that belongs on the subdisk. Otherwise, it is mark ed as stale and is recovered w hen the volume is started. Associating log subdisks Note: The version 20 DCO volume layout incl udes space for a DRL. Do not appl[...]

221 Creating and administering subdisks Dissociating su bdisks from plexes Dissociating subdisks from plexes To break an established conn ection betw een a subdisk and the plex to which it belongs, the subdisk is dissociated from the plex. A subdisk is dissociated when the subdisk is removed or used in anoth er plex. To dissociate a subdisk, use th[...]

222 Creating and admini stering subdis ks Changing subdi sk attributes ■ putil n ■ tutil n ■ len ■ comment The putil n field attributes are maintained on reboot; tutil n fields are temporary and are not retained on reboot. VxVM sets the putil0 and tutil0 utility fields. Other Symantec produ cts, such as the Veritas Enterprise Administrator [...]

Chap ter 6 Creating and administering plexes This chapter describes how to create and maintain plexes. Plexes are logical groupings of subdisks that create an area of disk space independent of physical disk size or other restrictions. Replication (mirroring) of disk data is set up by creating multiple data plexes for a sing le volume. Each data ple[...]

224 Creating and administering plexes Creating a striped plex Creating a striped plex To create a striped plex, you must specif y additional attributes. For example, to create a striped plex named pl-01 in the disk group, mydg , with a stripe width of 32 sectors and 2 columns, use the following command: # vxmake -g mydg plex pl-01 layout=stripe stw[...]

225 Creating and administering plexes Displaying plex information VxVM utilities use plex states to: ■ indicate w hether volume c ontents hav e been initialized t o a known state ■ determine if a plex c ontains a v alid copy (mirr or ) of the volume c ontents ■ tra ck whether a ple x was in acti ve use at the time of a syst em failur e ■ mo[...]

226 Creating and administering plexes Displaying plex information EMPT Y plex state Volume creation sets all plexes associat ed with the volume to the EMPTY state to indicate that the plex is not yet initialized. IOF AIL plex state The IOFAIL plex state is associated wi th persistent state logging. When the vxconfigd daemon detects an uncorrectable[...]

227 Creating and administering plexes Displaying plex information SNAPTMP plex state The SNAPTMP plex state is used during a vxassist sn apstart operation when a snapshot is being prepared on a volume. ST ALE plex state If there is a possibility that a plex does not have the complete and current volume contents, that plex is placed in the STALE sta[...]

228 Creating and administering plexes Displaying plex information TEMPRMSD plex state The TEMPRMSD plex state is used by vxassist when attaching new data plexes to a volume. If the synchronizatio n operation does not complete, the plex and its subdisks are removed. Plex condition flags vxprint may also display one of the follo wing condition flags [...]

229 Creating and administering plexes Attaching and associating plexes Plex kernel states The plex kerne l state indicates the accessibility of the plex to the volume driver which monitors it. Note: No user intervention is required to se t these states; they are maintained internally. On a system th at is operating properly, all plexes are enabled.[...]

230 Creating and administering plexes Ta k i n g p l e x e s o f f l i n e Note: You can also us e the command vxassist mirror volume to add a data plex as a mirror to an existing volume. Taking plexes offline Once a volume has been c reated and placed onli ne ( ENABLED ), VxVM can temporarily disconnect plexes from the volume. This is useful, for [...]

231 Creating and administering plexes Detaching plexes Detaching plexes To temporarily detach one data plex in a mirrored volume, use the following command: # vxplex [-g diskgroup ] det ple x For example, to temporar ily detach a plex named vol01-02 in the disk group, mydg , and place it in maintenance mo de, use the following command: # vxplex -g [...]

232 Creating and administering plexes Moving plex es If the vxinfo command shows that the volume is unstartable (see “Listing Unstartable Volumes” in the section “Recovery from Hardware Failure” in the Veritas Volume Manager Troublesho oting Guide ), set one of the plexes to CLEAN using the following command: # vxmend [-g diskgroup ] fix cl[...]

233 Creating and administering plexes Copying v olumes to ple xes Copying volumes to plexes This task copies the contents of a volume onto a specified plex. The volume to be copied must not be enabled. The plex cannot be associated with any other volume. To copy a plex, use the following command: # vxplex [-g diskgroup ] cp vol u m e new_plex After[...]

234 Creating and administering plexes Changing plex attributes Alternatively, you can first dissociate the plex and subdisks, and then remove them with the following commands: # vxplex [-g diskgroup ] dis plex # vxedit [-g diskgroup ] -r rm plex When used together, these commands produce the same result as the vxplex -o rm dis command. The -r optio[...]

Chap ter 7 Creating volumes This chapter describes how to create volumes in Veritas Volume Manager (VxVM). Volumes are logical devices that appear as physical disk partition devices to data management syst ems. Volumes enhance recovery from hardware failure, data av ailability, performance, an d storage configuration. Note: You can also use the Ver[...]

236 Creating volume s T ypes of volume la youts Types of volume layouts VxVM allows you to create volume s with the following layout types: Concat enated A volume whose subdisks ar e arr anged both sequent ially and cont iguously within a plex. Con catenation allo ws a volume t o be cr eated from multiple r egions of one or mor e disks if there is [...]

237 Creating volumes T ypes o f volume layouts Supported volume logs and maps Veritas Volume Manager supports the use of several types of logs and maps with volumes: ■ F astResyn c Maps are used t o perform q uick and efficient r esync hronization of mirr ors ( see “ FastResync ” on page 66 f or details ). These maps ar e supported either in [...]

238 Creating volume s Creating a volume Ref er to the f ollowing sect ions for inf ormation on cr eating a v olume on which DRL is enabled: ■ “ Creating a volume with di rty region logging enabled ” on page 252 for creating a volume wi th DRL log plexes. ■ “ Creating a volume with a version 20 DCO volume ” on page 252 for creating a vol[...]

239 Creating volumes Using v xassist 3 Associate plex es with the volume using vxmake vol ; see “ Creating a volume using vxmake ” on pag e 258. 4 Initializ e the volume using vxvol start or vxvol init zero ; see “ Initializing and starting a volume created using vxmake ” on page 261. See “ Creating a volume using a vxmake description fil[...]

240 Creating volume s Using vxass ist ■ Oper ations result in a set of co nfig uration changes that either suc ceed or fail as a gr oup, rather than individually . System cr ashes or other interrupt ions do not leave int ermediate states that you hav e to clean up. If vxassist finds an err or or an exc eptional condition, it exits after lea ving [...]

241 Creating volumes Using v xassist The section, “ Creating a volume on any disk ” on page 243 describes the simplest way to create a vol ume with default attr ibutes. Later sections describe how to create volumes with specific attributes. For example, “ Creating a volume on specific disks ” on page 244 describes how to control how vxassis[...]

242 Creating volume s Discovering the maximum siz e of a volume max_nstripe=8 min_nstripe=2 # for RAID-5, by default create between 3 and 8 stripe columns max_nraid5stripe=8 min_nraid5stripe=3 # by default, create 1 log copy for both mirroring and RAID-5 volumes nregionlog=1 nraid5log=1 # by default, limit mirroring log lengths to 32Kbytes max_regi[...]

243 Creating volumes Creating a volume on any disk To discover the value in blocks of the alig n ment that is set on a disk group, use this command: # vxprint -g diskgroup -G -F %align By default, vxassist automatically rounds up the volume size and attribute size values to a mul tiple of the alignm ent valu e. (This is equivalent to specifyi ng th[...]

244 Creating volume s Creating a volume on specifi c disks Creating a volume on specific disks VxVM automatically selects the disks on which each volume resides, unless you specify otherwise. If you wa nt a vo lume to be created on specific disks, you must designate those disks to VxVM. More than one disk can be specified. To create a volume on a s[...]

245 Creating volumes Creating a volume o n specific disks Specifying ordered allocation of storage to volumes Ordered allocation gives you complete co ntrol of space allocation. It requires that the number of disks that you specify to the vxassist command must match the number of disks that are required to create a volume. The order in which you sp[...]

246 Creating volume s Creating a volume on specifi c disks Figure 7-2 Example of using ord ered alloca tion to create a striped-mirror volume Additional ly, you can use the col_switch attribute to specify how to concatenate space on the disks into columns. For example, the following command creates a mirrored-str ipe volume with 2 columns: # vxassi[...]

247 Creating volumes Creating a volume o n specific disks Figure 7-3 Example of using c oncatenated disk space to create a mi rrored- stri pe vo lum e Other storage specification classes for co ntrollers, enclosures, targets and trays can be used with ordered allocation . For example, the following command creates a 3-column mirrored-stripe vo lume[...]

248 Creating volume s Creating a volume on specifi c disks Figure 7-4 Example of storage allocation us ed to create a mirrored-stripe volume across controllers For other ways in whic h you c an control ho w vxassist lays out mirrored volumes across controllers, see “ Mirroring across targets, controllers or enclosures ” on page 255. Mirrored-st[...]

249 Creating volumes Creating a mirrored volume Creating a mirrored volume Note: You need a full license to use this feature. A mirrored volume provides data redundancy by containing more than one copy of its data. Each copy (or mirror) is st ored on different disks from the original copy of the volume and from other mirro rs. Mirroring a volume en[...]

250 Creating volume s Creating a volu me with a version 0 DCO volu me # vxassist [-b] [-g diskgroup ] make volume length layout=concat-mirror [nmirror= number ] Creating a volume with a version 0 DCO volume If a data change object (D CO) and DCO vo lume are associated with a volume, this allows Persistent FastResync to be used with the volume. (S[...]

251 Creating volumes Creating a volume with a vers ion 0 DCO volume # vxdg list diskgr oup To upgrade a disk group to vers ion 90, use the following command: # vxdg -T 90 upgrade diskgroup For more information, see “ Upgrading a disk group ” on page 208. 2 Use the f ollowing comman d to cr eate the volume (y ou may need to specify additional at[...]

252 Creating volume s Creating a volu me with a version 20 DCO vo lume Creating a volume with a version 20 DCO volume T o create a volume with an attached version 20 DCO object and volume 1 Ensure that the disk gr oup has been up graded t o the latest version. Use the follow in g co mma n d to ch eck th e ve rsio n o f a di sk group: # vxdg list di[...]

253 Creating volumes Creating a striped volume Dirty region logging (DRL), if enable d, speeds recovery of mirrored volumes after a system crash. To enable DRL on a volume that is created within a disk group with a version number between 20 and 100, specify the logtype=drl attribute to the vxassist make command as shown in this example usage: # vxa[...]

254 Creating volume s Creating a striped volu me You can specify the disks on which the vo lumes are to be created by including the disk names on the command line. Fo r example, to create a 30-gigabyte striped volume on three specific disks, mydg03 , mydg04 , and mydg05 , use the following command: # vxassist -b -g mydg make stripevol 30g layout=st[...]

255 Creating volumes Mirroring across targets, controllers or enclosures for the attribute stripe-mirror-col-split-trigger-pt that is defined in the vxassist defaults file. If there are multiple subdisks per column, you can choose to mirror each subdisk individually instead of each column. To mirror at the subdisk level, specify the layout as strip[...]

256 Creating volume s Creating a RAID-5 volume See “ Specifying ordered allocation of storage to volumes ” on page 245 for a description of other ways in which you can control how v olumes are laid out on the specified storage. Creating a RAID-5 volume Note: VxVM supports this feature for private disk groups, but not for shareable disk groups i[...]

257 Creating volumes Creating tagged volumes RAID-5 logs can be concatenated or striped plexes, and each RAID-5 log associated with a RAID-5 volume has a co mplete copy of the logging information for the volume. To support concurrent access to the RAID-5 array, the log should be several times the st ripe size of the RAID-5 plex. It is suggested tha[...]

258 Creating volume s Creating a volume using vxmake Tag names and tag values are case-sensi tive character strings of up to 256 characters. Tag names can consist of letters (A through Z and a through z), numbers (0 through 9), dashes (-), und erscores (_) or periods (.) from the ASCII character set. A tag name must start wi th either a letter or a[...]

259 Creating volumes Creating a volume using vxmake If each column in a RAID-5 plex is to be created from multiple subd isks which may span several physical disks, you can specify to which column each subdisk should be added. For example, to crea te a three-column RAID-5 plex using six subdisks, use the following form of the vxmake command: # vxmak[...]

260 Creating volume s Initializing and starting a volume The following sampl e description file defines a volume, db , with two plexes, db- 01 and db-02 : #rty #name #options sd mydg03-01 disk=mydg03 offset=0 len=10000 sd mydg03-02 disk=mydg03 offset=25000 len=10480 sd mydg04-01 disk=mydg04 offset=0 len=8000 sd mydg04-02 disk=mydg04 offset=15000 le[...]

261 Creating volumes Initializing and starting a volume As an alternative to the -b option, you can specify the init=active attribute to make a new volume immediately ava il able for use. In this example, init=active is specified to prevent VxVM from synchr onizing the empty data plexes of a new mirrored volume: # vxassist [-g diskgroup ] make volu[...]

262 Creating volume s Accessing a vol ume Accessing a volume As soon as a volume has been created and initialized, it is av ailable for use as a virtual disk partition by the operating system for the creation of a file system, or by application programs such as rel ational databases a nd other data management software. Creating a volume in a disk g[...]

Chap ter 8 Administering volumes This chapter describes how to perform common maintenance tasks on volumes in Veritas Volume Manager (VxVM). Th is includes displaying volume information, monitoring tasks, addi ng and removing logs, resizing volumes, removing mirrors, removing volumes, an d changing the layout of volumes without taking them offline.[...]

264 Administe ring volumes Displayin g volume informati on Displaying volume information You can use the vxprint command to display information abou t how a volume is configured. To display the volume, plex, and subdisk record information for all volumes in the system, use the following command: # vxprint -hvt The vxprint command can also be applie[...]

265 Administerin g volumes Displaying vo lume informati on # vxprint -g mydg -t voldef This is example output from this command: V NAME RVG/VSET/CO KSTATE STATE LENGTH READPOL PREFPLEX UTYPE v voldef - ENABLED ACTIVE 20480 SELECT - fsgen Note: If you enable enclosure-based naming, and use the vxprint command to display the structure of a volume, it[...]

266 Administe ring volumes Displayin g volume informati on INV ALID volume state The contents of an instant snapshot volume no longer represent a true point-in- time image of the original volume. NEEDSYNC v olume state The volume requires a resynchronization operation the next time it is started. For a RAID-5 volume, a parity resyn chronization ope[...]

267 Administerin g volumes Monitoring a nd controll ing tasks Note: No user intervention is required to se t these states; they are maintained internally. On a system th at is operating properly, all volumes are ENABLED. The following volume kernel states are defined: DET A CHED volume kernel state Maintenance is being performed on the volume. The [...]

268 Administe ring volumes Monitoring an d controlling tasks Any tasks started by the utilities invoked by vxrecover also inherit its task ID and task tag, so establishing a parent-child task relationship. For more information about the utilities that support task tagging, see their respective manual pages. Managing tasks with vxtask Note: New task[...]

269 Administerin g volumes Monitoring a nd controll ing tasks generated when the task completes. When this occurs, the state of the task is printed as EXITED . pause Puts a running task in the paused state, causing it to suspend operation. resume Causes a paused task to continue operation. set Changes modifiable parameters of a task. Currently, the[...]

270 Administe ring volumes Stopping a volume Stopping a volume Stopping a volume renders it unavailabl e to the user, and changes the volume kernel state from ENABLED or DETACHED to DISABLED . If the volume cannot be disabled, it remains in its current state. To stop a volume, use the following command: # vxvol [-g diskgroup ] [-f] stop volume ... [...]

271 Administerin g volumes Starting a volume Starting a volume Starting a volume makes it availa ble for use, and changes the volume state from DISABLED or DETACHED to E NABLED. To start a DIS ABLED or DETACHED volume, use the following command: # vxvol [-g diskgroup ] start volume ... If a volume cannot be enabled, it remains in its current state.[...]

272 Administe ring volumes Adding a mirror to a volume Mirroring all volumes To mirror all volumes in a disk group to available disk space, use the following command: # /etc/vx/bin/vxmirror -g diskgroup -a To configure VxVM to create mirrored volumes by default, use the fo llowing command: # /etc/vx/bin/vxmirror -d yes If you make this change, you [...]

273 Administerin g volumes Removing a mirror You can choose to mirror volumes from disk mydg02 onto any available disk space, or you can choose to mirror onto a specific disk. To mirror to a specific disk, select the name of that disk. To mirror to any available disk space, select "any". Enter destination disk [<disk>,list,q,?] (def[...]

274 Administe ring volumes Adding logs and maps to volumes This command removes the mirror vol01-02 and all associated subdisks. This is equivalent to entering th e following separate commands: # vxplex -g mydg dis vol01-02 # vxedit -g mydg -r rm vol01-02 Adding logs and maps to volumes In Veritas Volume Manager, several ty pes of volume logs and m[...]

275 Administerin g volumes Preparing a volume for DR L and instant snapshots Preparing a volume for DRL and instant snapshots Note: T his procedure describes how to add a version 20 data change object (DCO) and DCO volume to a volume that you prev iously created in a disk group with a version number of 110 or greater. If you are creating a new volu[...]

276 Administe ring volumes Preparing a volume for DR L and ins tant snapshots Note: The vxsnap prepare command automatically enables Persistent FastResync on the volume. Persistent Fa stResync is also set automatically on any snapshots that are g enerated from a volume on which this feature is enabled. If the volume is a RAID-5 volume, it is conver[...]

277 Administerin g volumes Preparing a volume for DR L and instant snapshots If required, you can use the vxassist move command to relocate DCO plexes to different disks. For example, the follow ing command moves the plexes of the DCO volume, vol1_dcl , for volume vol1 from disk03 and disk04 to disk07 and disk08 : # vxassist -g mydg move vol1_dcl ![...]

278 Administe ring volumes Preparing a volume for DR L and ins tant snapshots Determining if DRL is enabled on a volume T o determine if DRL (configured using a version 20 DC O volume) is enabled on a volume 1 Use the vxprint c ommand on the volume t o discov er the name of its DCO: # DCONAME=‘vxprint [-g diskgroup ] -F%dco_name volume ‘ 2 T o [...]

279 Administerin g volumes Upgrading e xisting volume s to use version 20 DCO s To re-enable DRL on a vo lume, enter this command: # vxvol [-g diskgroup ] set drl=on volume To re-enable sequential DRL on a volume, enter: # vxvol [-g diskgroup ] set drl=sequential volume You can use these commands to change the DRL policy on a volume by first disabl[...]

280 Administe ring volumes Upgrading e xisting volumes to use ve rsion 20 DCOs # vxdg list diskgroup To upgrade a disk group to the latest version, use the following command: # vxdg upgrade diskgroup For more information, see “ Upgrading a disk group ” on page 208. 2 Use the f ollowing c ommand to disco ver whic h volumes in the disk gr oup hav[...]

281 Administerin g volumes Adding traditi onal DRL logging to a mirrored vo lume subsequently create from the snap shot plexes. For example, specify ndcomirs=5 for a volume with 3 data pl exes and 2 snapshot plexes. The value of the regionsize attribute specifies the size of the tracked regions in the volume. A write to a regio n is tracked by sett[...]

282 Administe ring volumes Adding traditional DRL logging to a mirrored vol ume where each bit represents one region in the volume. For example, the size of the log would need to be 20K for a 10GB volu me with a region size of 64 kilobytes. For example, to add a single log plex for the volume vol03 , in the disk group, mydg , use the following comm[...]

283 Administerin g volumes Adding a RAID-5 log Adding a RAID-5 log Note: You need a full license to use this feature. Only one RAID-5 plex can exist per RA ID-5 volume. Any additional plexes become RAID-5 log plexes, which are us ed to log information about data and parity being written to th e volume. When a RAID-5 vo lume is created using the vxa[...]

284 Administe ring volumes Resizing a volume Removing a RAID-5 log To identify the plex of the RAID-5 log, use the following command: # vxprint [-g diskgroup ] -ht volume where volume is the name of the RAID-5 volu me. For a RAID-5 log, the output lists a plex wi th a STATE field entry of LOG . To dissociate and remove a RAI D-5 log and any associa[...]

285 Administerin g volumes Resizing a volume vxassist command also allows you to specif y an increment by which to change the volume’s size. Caution: If you use vxassist or vxvol to resize a volume, do not shrink i t below the size of the file system which is located on it. If you do not shrink the file system first, you risk unrecov erable data [...]

286 Administe ring volumes Resizing a volume ■ Resizing a v olume with a usage type other than FSGEN or RAID5 can r esult in loss of data. If such an oper ation is r equired, use the -f option t o for cibly re s i ze s u ch a vo lu m e . ■ Y ou cannot r esize a v olume that contains ple xes with dif fer ent layout t ypes. At tempting to do so r[...]

287 Administerin g volumes Resizing a volume Note: If specified, the -b option makes growing the volume a background task. For example, to extend volcat by 100 sectors, use th e follo wing command: # vxassist -g mydg growby volcat 100 Note: If you previously performed a relayout on the volume, additionally specify the attribute layout=nodiskalign t[...]

288 Administe ring volumes Setting tags on volumes Note: The vxvol set len command cannot increase the size of a volume unless the needed space is available in the plex es of the volume. Wh en the size of a volume is reduced using the vxvol set len command, the freed space is not released into the disk group’s free space pool. If a volume is acti[...]

289 Administerin g volumes Changing the read poli cy for mirrored volumes # vxassist -g mydg settag myvol "dbvol=table space 1" Dotted tag hierarchies are understood by the list operation. For example, the listing for tag=a.b includes all volum es that have tag names that st art with a.b . The tag names site , udid and vdid are reserved a[...]

290 Administe ring volumes Removing a volume For example, to set the policy for vol01 to read preferentially from the plex vol01-02 , use the following command: # vxvol -g mydg rdpol prefer vol01 vol01-02 To set the read policy to select , use the following command: # vxvol [-g diskgroup ] rdpol select volume For more information about how read po [...]

291 Administerin g volumes Moving volume s from a VM disk T o move volumes from a disk 1 Select menu item 6 (Move volume s from a disk) from the vxdiskadm main menu. 2 At the f ollowing pr ompt, enter the disk name of the disk whose v olumes you wish t o move, as f ollows : Move volumes from a disk Menu: VolumeManager/Disk/Evacuate Use this menu op[...]

292 Administe ring volumes Enabling F astResync on a volume Enabling FastResync on a volume Note: The recommended method for enabling FastResync on a volume with a version 20 DCO is to use the vxsnap prepare command as described in “ Preparing a volume for DRL and instant snapshots ” on page 275. You need a Veritas FlashSnap TM or FastResync li[...]

293 Administerin g volumes Enabling F astResync on a volume Note: To use FastResync with a snapshot, FastResync must be enabled before the snapshot is taken, and must remai n enabled until after the snapback is completed. Checking whether FastResync is enabled on a volume To check whether FastResync is enab led on a volume, use the following comman[...]

294 Administe ring volumes Perf orming online relayout Performing online relayout Note: You need a full license to use this feature. You can use the vxassist relayout command to reconfigure the layout of a volume without taking it offline. Th e general form of this command is: # vxassist [-b] [-g diskgroup ] relayout volume [layout= layout ] [ re[...]

295 Administerin g volumes Perf orming online relayout Permitted relayout transformations The tables below give details of the relayout operations that are possible for each type of source storage layout. Table 8-2 Supported relayout transformati on s for concatenated volumes Relayout to Fro m c on c at concat No. concat-mirror N o. Add a mirr or ,[...]

296 Administe ring volumes Perf orming online relayout Table 8-4 Supported relayout transfor mations for RAID-5 volumes Relayout to From raid5 concat Ye s . concat-mirror Ye s . mirror-concat No. Us e vxassist convert after r elayout t o concate nated-mirr or volume instead. mirror-stripe No. U s e vxassist convert after relay out to striped -mirro[...]

297 Administerin g volumes Perf orming online relayout Table 8-6 Supported relayout transformati ons f or mirrored-stripe volumes Relayout to From mirror-st ripe concat Ye s . concat-mirror Ye s . mirror-concat No. Us e vxassist convert after r elayout t o concate nated-mirr or volume instead. mirror-stripe No. U s e vxassist convert aft er relay o[...]

298 Administe ring volumes Perf orming online relayout Specifying a non-default layout You can specify one or more relayout op tions to change the default layout configuration. Examples of these options are: ncol= numbe r Specifies the number of columns. ncol= + number Specifies the number of columns to add. ncol=- numbe r Specifies the number of c[...]

299 Administerin g volumes Perf orming online relayout Viewing the status of a relayout Online relayout operations take some time to perform. You can use the vxrelayout command to obtain information about the status of a relayout operation. For example, the command: # vxrelayout -g mydg status vol04 might display outp ut similar to this: STRIPED, c[...]

300 Administe ring volumes Converting between layered and non-layered volumes inserts a delay of 1000 milliseconds (1 second) between copying each 10- megabyte region: # vxrelayout -g mydg -o bg,slow=1000,iosize=10m start vol04 The default delay and region size valu es are 250 milliseconds and 1 megabyte respectively. To reverse the direction of re[...]

301 Administerin g volumes Converting between layered and non- layered volumes When the relayout has completed, use the vxassist convert command to change the resulting lay ered striped-mirror volume to a non-layered mirrored- stripe: # vxassist -g mydg convert vol1 layout=mirror-stripe Note: If the system crashes during relayou t or conversion, th[...]

302 Administe ring volumes Converting between layered and non-layered volumes[...]

Chap ter 9 Administering volume snapshots Veritas Volume Manager (VxVM) provides the capability for taking an image of a volume at a given point in time. Such an image is referred to as a volume snapshot . You can also take a snapshot of a volume set as described in “ Creating instant snapshots of volume sets ” on page 334. Volume snapshots all[...]

304 Administer ing volume snapshots Note: A volume snapshot represents the data that exists in a volu me at a given point in time. As such, VxVM does n ot have any knowledge of data that is cached by the overlying file system, or by applications such as databases that have files open in the file system. I f the fsgen volume usage type is set on a v[...]

305 Administe ring volume snapshots T raditional third-mi rror break-off snapsho ts Traditional third-mirror break-off snapshots The traditional thir d-mirror break -off volume snapshot model that i s supported by the vxassist command is shown in Figure 9-1 . This also shows the transitions th at a re supported by the snapback and snapclear command[...]

306 Administer ing volume snapshots T raditional third-mirror break -off snapsho ts its data plexes. The snapshot volume cont ains a copy of the original volume’s data at the time that you took the snap shot. If more than one snapshot mirror is used, the snapshot volume is itself mirrored. The command, vxassist snapback, can be used to return sna[...]

307 Administe ring volume snapshots Full-sized instant snapshots Full-sized instant snapshots Full-sized instant snapshots are a va riation on the third-mirror volume snapshot model that make a sn apshot volume available for access as soon as the snapshot plexes have been created. Th e full-sized instant volume snapshot model is illustrated in Figu[...]

308 Administer ing volume snapshots Full-s ized instant snap shots volume are updated, its original contents are gradually relocated to the snapshot volume. If desired, you can additionally select to perform either a background (non- blocking) or foreground (bl ocking) sync hronization of the snapshot volume. This is useful if you intend to move th[...]

309 Administe ring volume snapshots Space-optimized instant snapshots Space-optimized instant snapshots Volume snapshots, such as those described in “ Traditional third-mirror break- off snapshots ” on page 305 and “ Full-sized instant snapshots ” on page 307, require the creation of a complete copy of the original volume, and use as much s[...]

310 Administer ing volume snapshots Emulation of third-mirro r break-off snapshots As for instant snapshots, space-optimized snapshots use a copy-on-write mechanism to make them immediatel y av ailable for use when they are first created, or when their data is refreshed. Unlike instant snapshots, however, you cannot enable synchronization on space-[...]

311 Administe ring volume snapshots Linked bre ak-off snapshot volumes ■ Use the vxsnap make command w ith the sync=yes and type=full at tributes specified to c reate the snapshot v olume, and then use the vxsnap syncwait command t o wait f or synchr onization of the snapshot v olume to complete. See “ Creating and managing thir d-mirror break-[...]

312 Administer ing volume snapshots Cascaded snapshot s to recover the mirror volume in the same way as for a DISABLED volume. See “ Starting a volume ” on page 271. If you resize (that is, grow or shrink) a volume, all its ACTIVE linked mirror volumes are also resized at the same time . The volume and its mirrors can be in the same disk group [...]

313 Administe ring volume snapshots Cascaded snapshots to read data from an older snapshot that does not exis t in that snapshot, it is obtained by searching recursively up the hierarchy of more recent snapshots. A snapshot cascade is most likely to be used for regular online backup of a volume where space-optimized snapshots are written to disk bu[...]

314 Administer ing volume snapshots Cascaded snapshot s Figure 9-5 Creating a snapshot of a snap shot Even though the arrangemen t of the snapshots in this figure appears similar to the snapshot hierarchy shown in “ Snapshot cascade ” on page 312, the relationship between the snapshots is not recursive. When reading from the snapshot S2 , data [...]

315 Administe ring volume snapshots Cascaded snapshots Figure 9-6 Using a snapshot of a snaps hot to restore a database If you have configured snapshots in this way, you may wish to make one or more of the snapshots into independent volumes. There are two vxsnap commands that you can use to do this: ■ vxsnap dis dissociates a snapshot v olume and[...]

316 Administer ing volume snapshots Cascaded snapshot s Figure 9-7 Dissociating a snapsho t volume ■ vxsnap split dissociates a snapshot and its dependent snapshots fr om its parent v olume. The snapshot v olume that is to be split must have been f ully synchr onized fr om its parent v olume. This oper ation is illustrat ed in Figure 9-8 . vxsnap[...]

317 Administe ring volume snapshots Creating mu ltiple sn apshots Figure 9-8 Splitting snapshots Creating multiple snapshots To make it easier to create snapshots of sev eral volumes at the same time, both the vxsnap make and vxassist snapshot commands accept more than one volume name as their argument. For traditional snapshots, you can create sn [...]

318 Administer ing volume snapshots Restoring t he original volu me from a snapsho t Figure 9-9 Resynchronizing an original volu me from a snapshot Note: The original volume must not be in use during a snapback operation that specifies the option -o resyncfromreplica to resynchronize the volume from a snapshot. Stop any application, such as a datab[...]

319 Administe ring volume snapshots Creating instant snapshots Creating instant snapshots Note: You need a full license to use this feature. VxVM allows you to make instant snapshots of volumes by using the vxsnap command. Note: The information in this section also applies to RAID-5 vol umes that ha ve been converted to a special layered volu me la[...]

320 Administer ing volume snapshots Creating instant snapsho ts You can create instant snapshots of vo lume sets by replacing volume names with volume set names in the vxsnap command. For more information, see “ Creating instant snapshots of volume sets ” on page 334. Note: When using the vxsnap prepare or vxassist make commands to make a volum[...]

321 Administe ring volume snapshots Creating instant snapshots Preparing to create instan t and break-off snapshots T o prepare a volume for th e creation of instant and break -off snapshots 1 Use the f ollowing comman ds to see if the v olu me is associated with a ver sion 20 data chang e object (DCO) and DCO v olume that allo w instant snapshots [...]

322 Administer ing volume snapshots Creating instant snapsho ts created, and it must also h a ve the same region size. See “ Creating a volume for use as a full-sized instant or linked break-off snapshot ” on page 323 for details. Creating a shared cache object T o create a shared cac he object 1 Decide on the f ollowing c harac teristic s that[...]

323 Administe ring volume snapshots Creating instant snapshots Note: All space-optimized snapshots that share the cache must have a region size that is equal to or an inte ger multiple of the region size set on the cache. Snapshot creation also fails if the origin al volume’s region size is smaller than the ca che’s region size. If the region s[...]

324 Administer ing volume snapshots Creating instant snapsho ts 4 Use the vxassist comm a nd to c reat e a vo lu m e , snapvol , of the r equired siz e and redundanc y , tog ether with a version 20 DCO v olume with the corr ect re g i o n s i z e : # vxassist [-g diskgroup ] make snapvol $LEN [layout=mirror nmirror= number ] logtype=dco drl=off [...]

325 Administe ring volume snapshots Creating instant snapshots For space- optimized instant sna pshots t h at share a cache object, the specified region size must be greater than or eq ual to the regi on size specified for the cache object. See “ Creating a shared cache object ” on page 322 for details. The attributes for a snapshot are specifi[...]

326 Administer ing volume snapshots Creating instant snapsho ts For example, to create the sp ace-optimized instant snapshot, snap4 myvol , of the volume, myvol , in the disk group, mydg , on the disk mydg15 , and which uses a newly allocated cache object that is 1GB in size, but which can automatically grow in size, use the following command: # vx[...]

327 Administe ring volume snapshots Creating instant snapshots Creating and ma naging fu ll-sized instant snapshots Note: Full-sized instant snapshots are not suitable for write-intensive volumes (such as for database redo logs) because the copy-on-write mechanism may degrade the performance of the volume. For full-sized instant snapshots, you must[...]

328 Administer ing volume snapshots Creating instant snapsho ts If required, you can use the follo wing command to test if the synchronization of a volume is complete: # vxprint [-g diskgroup ] -F%incomplete snapvol This command returns the value of f if synchronization of the volume, snapvol , is complete; otherwise, it returns the value on . You [...]

329 Administe ring volume snapshots Creating instant snapshots ■ Dissociate the snapshot volume entirel y from the original volume. Th is may be useful if you want to use the copy for other purposes such as testing or report generation. If desired, you can delete the dissociated volume. See “ Dissociating an instant snapshot ” on page 340 for[...]

330 Administer ing volume snapshots Creating instant snapsho ts If you specify the -b option to the vxsnap addmir command, you can use the vxsnap snapwait command to wait for synchr onization of the snapshot plexes to complete, as shown in this example: # vxsnap -g mydg snapwait vol1 nmirror=2 2 T o create a third-mirror break-off sn apshot, use th[...]

331 Administe ring volume snapshots Creating instant snapshots synchronization was already in progress on the snapshot, this operation may result in large portions of the snapshot having to be resynchronized. See “ Refreshing an instant snapshot ” on page 337 for details. ■ Reatta ch some or a ll of the plexes of the snap shot volume with the[...]

332 Administer ing volume snapshots Creating instant snapsho ts [mirdg= snapdg ] The optional mirdg attribute can be used to specify the snapshot volume’s current disk group, snapdg . The -b option can be used to perform the synchronization in th e background. If the -b option is not specified, the command does not return until the link becomes A[...]

333 Administe ring volume snapshots Creating instant snapshots Note: This operation is not possible if the linked volume and snapshot are in different disk groups. ■ Reattach the snaps hot volume with the original volume. See “ Reattaching a linked break-off snapshot volume ” on page 339 for details. ■ Dissociate the snapshot volume entirel[...]

334 Administer ing volume snapshots Creating instant snapsho ts In this example, snapvol1 is a full-sized snapshot that uses a prepared volume, snapvol2 is a space-optimized snapshot that uses a prepared cache, and snapvol3 is a break-off full-sized snapshot that is formed from plexes of the original volume. An example of where you might want to c [...]

335 Administe ring volume snapshots Creating instant snapshots VOLUME INDEX LENGTH KSTATE CONTEXT svol_0 0 204800 ENABLED - svol_1 1 409600 ENABLED - svol_2 2 614400 ENABLED - A full-sized instant snapshot of a volume set can be created using a prepared volume set in which each volume is th e same size as the corresponding volume in the parent volu[...]

336 Administer ing volume snapshots Creating instant snapsho ts Adding snapshot mirrors to a volume If you are going to create a full-sized b reak-off snapshot volume, you can use the following command to add new sn apshot mi rrors to a volume: # vxsnap [-b] [-g diskgroup ] addmir volume | volume_set [nmirror= N ] [alloc= storage_attributes ] Not[...]

337 Administe ring volume snapshots Creating instant snapshots Note: This command is similar in usage to the vxassist snapabort command. If a volume set name is specified instea d of a volume, a mirror is removed from each volume in the volume set. Removing a linked break-off snapshot volume To remove a linked break- off snapshot volume from a volu[...]

338 Administer ing volume snapshots Creating instant snapsho ts To disable resynchroni zation, specify the syncing=no attribute. This attribute is not supported for space-optimized snapshots. Note: The snapshot being refreshed must no t b e open to any application. For example, any file system configured on the volume must first be unmounted. It is[...]

339 Administe ring volume snapshots Creating instant snapshots snapwait command (but not vxsnap syncwait ) to wait for the resynchronization of the reattached plexes to complete, as shown here: # vxsnap -g mydg snapwait myvol nmirror=1 Note: If the volume and its snapshot have both been resized (to an identical smaller or larger size) before perf o[...]

340 Administer ing volume snapshots Creating instant snapsho ts syncwait ) to wait for the resynchronizati on of the reattached volume to complete, as shown here: # vxsnap -g snapdg snapwait myvol mirvol=prepsnap Restoring a volume from an instant snapshot It may sometimes be desirable to reinsta te the contents of a volume from a backup or modifie[...]

341 Administe ring volume snapshots Creating instant snapshots snapshots remain, snapvol may be dissociated. The snapshot hierarchy is then adopted by snapvol ’s parent volume. Note: To be usable after dissociation, the snapshot volume and any snapshots in the hierarchy must have been fully synchronized. See “ Controlling instant snapshot synch[...]

342 Administer ing volume snapshots Creating instant snapsho ts Note: The topmost snapshot volume in the hierarchy must have been fully synchronized for this command to succ eed. Snapshots that are lower down in the hierarchy need not have b een fully resynchronized. See “ Controlling instant snapshot synchronization ” on page 344 for more info[...]

343 Administe ring volume snapshots Creating instant snapshots Alternatively, you can use the vxsnap list command, which is an al ias for the vxsnap -n print command: # vxsnap [-g diskgroup ] [-l] [-v] [-x] list [ vol ] The following output is an example of using this command on the disk group dg1 : # vxsnap -g dg -vx list NAME DG OBJTYPE SNAPTYPE [...]

344 Administer ing volume snapshots Creating instant snapsho ts See the vxsnap (1M) manual page for more information about using the vxsnap print and vxsnap list commands. Controlling instant sn apshot synchronization Note: Synchronization of the contents of a snapshot with its original volume is not possible for space-optimized instant snapshots. [...]

345 Administe ring volume snapshots Creating instant snapshots instant snapshot ” on page 338 and “ Reattaching a linked break-off sn apshot volume ” on page 339 for details. Improving the performance of snapshot synchronization Two optional arguments to the -o option are provided to help optimize the performance of synchronization when using[...]

346 Administer ing volume snapshots Creating instant snapsho ts Tuning the autogrow at tributes of a cache The highwatermark , autogrowby and maxautogro w attributes determine how the VxVM cache daemon ( vxcached ) maintains the cache if the autogrow feature has been enabled and vxcached is running: ■ When cach e usage r eaches the high watermar [...]

347 Administe ring volume snapshots Creating instant snapshots Caution: Ensure that the cache is suffic iently large, and that the autogrow attributes are configured correctly for your needs. Growing and shrinking a cache You can use the vxcache command to increase the size of the cache volume that is associated with a cache object: # vxcache [-g d[...]

348 Administer ing volume snapshots Creating traditional t hird-mirror break-off snap shots Creating traditional third-mirror break-off snapshots VxVM provides third-mirror break-off snap shot images of volume devices using vxassist and other commands. Note: To enhance the efficiency and usabil ity of volume snapshots, turn on FastResync as describ[...]

349 Administe ring volume snapshots Creating traditional th ird-mirror break-off snap shots creating the snapshot mirror is long in contrast to the brief amount of time that it takes to create the snaps hot volume. The online backup procedure is completed by running the vxassist snapshot command on a volume with a SNAPDONE mirror. This task detache[...]

350 Administer ing volume snapshots Creating traditional t hird-mirror break-off snap shots It is also possible to make a snapshot pl ex from an existing plex in a volume. See “ Converting a plex into a snapshot plex ” on page 351 for details. 2 Choose a suitable time t o create a sn apshot. If possible, plan t o take the snapshot at a time w h[...]

351 Administe ring volume snapshots Creating traditional th ird-mirror break-off snap shots Note: Dissociating or removin g the snapshot volume loses the adva ntage of fast resynchronization if FastResync was enabled. If there are no further snapshot plexes availabl e, any subsequent snapsh ots that you take require another complete copy of the ori[...]

352 Administer ing volume snapshots Creating traditional t hird-mirror break-off snap shots To convert an existing plex into a snapshot plex in the SNAPDONE state for a volume on which Non-Persistent FastRe sync is enabled, use the following command: # vxplex [-g diskgroup ] convert state=SNAPDONE plex A converted plex is in the SNAPDONE st ate, an[...]

353 Administe ring volume snapshots Creating traditional th ird-mirror break-off snap shots plexes are snapped back. This task res ynch ronizes the data in the volume so that the plexes are consistent. Note: To enhance the efficiency of the sn apback operation, enable FastResync on the volume before taking th e snapshot, as described in “ Enablin[...]

354 Administer ing volume snapshots Creating traditional t hird-mirror break-off snap shots 2 Use the vxassist mirror c ommand to cr eate mirr ors of the existing snapshot v olume and its DC O volume: # vxassist -g diskgroup mirror snapshot # vxassist -g diskgroup mirror $DCOVOL Note: The new plex in the DCO volume is required for use w ith the new[...]

355 Administe ring volume snapshots Creating traditional th ird-mirror break-off snap shots Displaying snapshot information The vxassist snapprint command displays the associations between the original volumes and their respective replicas (snapshot copies): # vxassist snapprint [ vol u m e ] Output from this command is sh own in the following exam[...]

356 Administer ing volume snapshots Adding a version 0 DCO and DCO volume Adding a version 0 DCO and DCO volume Note: The procedure described in this sectio n adds a DCO log vol ume that has a version 0 layout as introduced in Vx VM 3.2. The version 0 layout supports traditional (third-mirror break-off) snapshots, but n ot full-sized or space- opti[...]

357 Administe ring volume snapshots Adding a version 0 DCO and DCO volume 3 Use the fo llowing command to add a DCO and DCO v olume to the exist ing vo lu m e: # vxassist [-g diskgroup ] addlog volume logtype=dco [ndcomirror= number ] [dcolen= size ] [ storage_attributes ] For non-layered volumes, the default nu mber of plexes in the mirrored DCO[...]

358 Administer ing volume snapshots Adding a version 0 DCO and DCO volume the volume named vol1 (the TUTIL0 and PUTIL0 columns are omitted for clarity): TY NAME ASSOC KSTATE LENGTH PLOFFS STATE ... v vol1 fsgen ENABLED 1024 - ACTIVE pl vol1-01 vol1 ENABLED 1024 - ACTIVE sd disk01-01 vol1-01 ENABLED 1024 0 - pl vol1-02 vol1 ENABLED 1024 - ACTIVE sd [...]

359 Administe ring volume snapshots Adding a version 0 DCO and DCO volume This form of the command dissociates the DCO object from the volume but does not destroy it or the DCO volume. If the -o rm option is specified, the DCO object, DCO volume and its plexes, and an y snap objects are also removed. Note: Dissociating a DCO and DCO volume disa ble[...]

360 Administer ing volume snapshots Adding a version 0 DCO and DCO volume[...]

Chap ter 10 Creating and administering volume sets This chapter describes how to use the vxvset command to create and administer volume sets in Veritas Volume Manager (V xVM). Volume sets enable the use of the Multi-Volume Support feature with Veri tas File System (VxFS). It is also possible to use the Veritas Enterprise Administrator (VEA) to crea[...]

362 Creating and admini stering volum e sets Creating a volume set ■ V olume sets can be used in place of v olumes with the f ollowing vxsnap oper ations on instant snapshots: addmir , dis , make , prepare , reattach , refresh , restore , rmmir , split , syncpause , syncresume , syncstart , syncstop , syncwait , and unprepare . The thir d-mirror [...]

363 Creating and admini stering v olume sets Listing detai ls of vo lume sets Caution: The -f (force) option must be specifie d if the volume being added, or any volume in the volume set, is either a snapshot or the parent of a snapshot. Using this option can potentially cause inconsistencies in a snapshot hierarchy if any of the volumes involved i[...]

364 Creating and admini stering volum e sets Removing a volume from a volume set # vxvset -g mydg list set1 VOLUME INDEX LENGTH KSTATE CONTEXT vol1 0 12582912 DISABLED - vol2 1 12582912 DISABLED - vol3 2 12582912 DISABLED - # vxvset -g mydg start set1 # vxvset -g mydg list set1 VOLUME INDEX LENGTH KSTATE CONTEXT vol1 0 12582912 ENABLED - vol2 1 125[...]

365 Creating and admini stering v olume sets Raw device node access to component volumes Caution: Writing directly to or reading from the raw device node of a component volume of a volume set should only be performed if it is known that the volume's data will not otherwise change during the period of access. All of the raw device nodes for the[...]

366 Creating and admini stering volum e sets Raw device node access to component vol umes value of the makedev attribute is currently set to on . The access mode is determined by the current setting of the compvol_access attribute. The following example creates a volume set, myvset1 , containing the volume, myvol1 , in the disk group, mydg , with r[...]

367 Creating and admini stering v olume sets Raw device node access to component volumes The syntax for setting the compvol_access attribute on a volume set is: # vxvset [ -g diskgroup ] [ -f ] set compvol_access= { read-only | read-write } vset The compvol_access attribute can be specified to the vxvset set command to change the access mode to t[...]

368 Creating and admini stering volum e sets Raw device node access to component vol umes[...]

Chap ter 11 Configuring off-host processing Off-host processing allows you to implement the following activities: Data backup As the r equirement f or 24 x 7 a vailability bec omes essential f or many businesses, org anizations c annot affor d the downt ime involv ed in backing up cr itical data offline. B y taking a snapshot of the data, and bac k[...]

370 Configuring off-host process ing Implement ing off-host processing so lutions Off-host processing is made simpler by using linked break-off snapshots, which are described in “ Linked break-off snapshot volumes ” on page 311. Implementing off-host processing solutions As shown in Figure 11-1 , by accessing snapshot volu mes from a l ightly l[...]

371 Configuring off-host process ing Implementing off-hos t processing solutions ■ Implementing decision support These applications use the Persistent FastResync feature of VxVM in conjunction with linked break-off snapsh ots. Note: A volume snapshot represents the data th at exists in a volume at a given point in time. As such, VxVM does not hav[...]

372 Configuring off-host process ing Implement ing off-host processing so lutions Note: If the volume was created under VxVM 4.0 or a later release, and it is not associated with a new-style DC O object and DCO volume, f ollow the procedure described in “ Preparing a volume for DRL and instant snapshots ” on page 275. If the volume was created [...]

373 Configuring off-host process ing Implementing off-hos t processing solutions If a database spans more than one volume, you can specify all the volumes and their snapshot volumes using one command, as shown in this example: # vxsnap -g dbasedg make source=vol1/snapvol=snapvol1/snapdg=sdg source=vol2/snapvol=snapvol2/snapdg=sdg source=vol3/[...]

374 Configuring off-host process ing Implement ing off-host processing so lutions # vxsnap -g snapvoldg reattach snapvol source= vol sourcedg= volumedg For example, to reattac h the snapshot volumes svol1 , svol2 and svol3 : # vxsnap -g sdg reattach svol1 source=vol1 sourcedg=dbasedg svol2 source=vol2 sourcedg=dbasedg svol3 source=vol3 sour[...]

375 Configuring off-host process ing Implementing off-hos t processing solutions This command returns on if FastResync is enabled; otherwise, it returns off . If FastResync is disabled, enable it using the following command on the primary host: # vxvol -g volumedg set fastresync=on volume 3 Pr epar e the OHP host to r eceiv e the snapshot volume th[...]

376 Configuring off-host process ing Implement ing off-host processing so lutions 8 On the primary host, if y ou temporaril y suspended updates to a volume in step 6 , r elease all the data base ta bles from hot backup mode. 9 On the primary host, deport the snap shot volume’ s disk group using the fo ll ow in g c om m a n d : # vxdg deport snapv[...]

377 Configuring off-host process ing Implementing off-hos t processing solutions For example, to reattac h the snapshot volumes svol1 , svol2 and svol3 : # vxsnap -g sdg reattach svol1 source=vol1 sourcedg=dbasedg svol2 source=vol2 sourcedg=dbasedg svol3 source=vol3 sourcedg=dbasedg You can use the vxsnap snapwait comma nd to wait fo r synchr[...]

378 Configuring off-host process ing Implement ing off-host processing so lutions[...]

Chap ter 12 Administering hot-relocation If a volume has a disk I/O failure (for example, the disk has an uncorrectable error), Veritas Volume Manager (VxVM) ca n detach the plex involved in the failure. I/O stops on that plex but co ntinues on the remaining plexes of the volume. If a disk fails completely, VxVM can deta ch the disk from its disk g[...]

380 Administer ing hot-relocatio n How hot-relocation works How hot-relocation works Hot-relocation allows a sy stem to react automatically to I/O failures on redundant (mirrored or RAID-5) VxVM objects, and to restore redundancy and access to those objects. VxVM detects I/ O failures on objects and relocates the affected subdisks to disks designat[...]

381 Administer ing hot-relocation How hot-relocation works spares ( mark ed spare ) in the disk group wher e the failur e occ urred. It then r elocates the subdisks to use this space. ■ If no spar e disks ar e available or addit ional space is needed, vxrelocd uses free spac e on disks in the same disk gro u p, exc ept those disks that have been [...]

382 Administer ing hot-relocatio n How hot-relocation works Figure 12-1 Example of hot-relocation for a subdisk in a RAID-5 volume mydg01 mydg02 mydg03 mydg04 mydg05 mydg01 mydg02 mydg03 mydg04 mydg05 mydg01-01 mydg02-01 mydg02-02 mydg03-01 mydg03-02 mydg05-01 mydg04-01 mydg01-01 mydg02-01 mydg02-02 mydg03-01 mydg03-02 mydg04-01 X Spare Disk mydg01[...]

383 Administer ing hot-relocation How hot-relocation works Partial disk failure mail messages If hot-relocation is enabled when a plex or disk is detached by a failure, mail indicating the failed objects is sent to root . If a partial disk failure occurs, the mail identifies the failed plexes. For example, if a disk containing mirrored volumes fail[...]

384 Administer ing hot-relocatio n How hot-relocation works Complete disk failure mail messages If a disk fails completely and hot-relocat ion is enabled, the mail message lists the disk that failed and a ll plexes that use the disk. For example, you can receive mail as shown in th is example display: To: root Subject: Volume Manager failures on ho[...]

385 Administer ing hot-relocation Configurin g a system for hot-re location does not take place. If relocation is no t possible, the system administrator i s notified and no further action is taken. From the eligible disks, hot-relocation atte mpts to use the disk that is “closest” to the failed disk. The value of “closene ss” depends on th[...]

386 Administer ing hot-relocatio n Displaying spare disk in formation After a successful relocation, remove and repl ace the failed disk as described in “ Removing and replacing disks ” on page 112). Displaying spare disk information Use the following command to display in formation about spare disks that are available for relocation: # vxdg [-[...]

387 Administer ing hot-relocation Marking a disk as a hot-relocation spare Marking a disk as a hot-relocation spare Hot-relocation allows the system to react au tomati cally to I/O failure by relocating redundant subdisks to other disks. Hot-relocation then restores the affected VxVM objects and data. If a disk has already been designated as a spar[...]

388 Administer ing hot-relocatio n Removing a disk from use as a ho t-relocation spare electronic mail. After successful relocation, you may want to replace the failed disk. Removing a disk from use as a hot-relocation spare While a disk is designated as a spare, th e space on that disk is not used for the creation of VxVM objects within its disk g[...]

389 Administer ing hot-relocation Making a disk a vailable for h ot-relocation use T o use v xdiskadm to exclude a disk from hot-relocation use 1 Select menu item 15 (Exclude a disk from hot-relocation use) fr om the vxdiskadm main menu. 2 At the f ollowing pr ompt, enter the disk media name (suc h as mydg01 ): Exclude a disk from hot-relocation us[...]

390 Administer ing hot-relocatio n Configuring ho t-relocation to use only spare disks Enter disk name [<disk>,list,q,?] mydg01 The following confirmation is displayed: V-5-2-932 Making mydg01 in mydg available for hot-relocation use is complete. 3 At the f ollowing pr ompt, indicate whether y ou want t o add more disks t o be exclud e d from[...]

391 Administer ing hot-relocation Moving and unrelocating su bdisks Volume home Subdisk mydg02-03 relocated to mydg05-01, but not yet recovered. Before you move any relocated subdisks, f ix or replace the disk that failed (as described in “ Removing and replacing disks ” on page 112). Once this is done, you can move a relocated subdisk back to [...]

392 Administer ing hot-relocatio n Moving and unreloc ating subdis ks subdisks using vxassist ” on page 392 and “ Moving and unrelocating subd isks using vxunreloc ” on page 392. Moving and unrelocating subdisks using vxassist You can use the vxassist command to move and unrelocate subdisks. For example, to move the relocated subdisks on mydg[...]

393 Administer ing hot-relocation Moving and unrelocating su bdisks without using the original offsets. Refer to the vxunreloc (1M) ma nual page for more information. The examples in the following se ctions demonstrate the use of vxunreloc . Moving hot-relocated subdisks back to their original disk Assume that mydg01 failed and all the subd isks we[...]

394 Administer ing hot-relocatio n Moving and unreloc ating subdis ks Examining which subdisks were hot-relocated from a disk If a subdisk was hot relocated more than on ce due to multiple disk failures, it can still be unrelocated back to its original location. For instance, if mydg01 failed and a subdisk named mydg01-01 was moved to mydg02 , and [...]

395 Administer ing hot-relocation Modifying t he behavior of hot-relocatio n If the system goes down after the new subdisks are created on the destination disk, but before all the data has been moved, re-execute vxunreloc when the system has been rebooted. Caution: Do not modify the string UNRELOC in the comment field of a subdisk record. Modifying[...]

396 Administer ing hot-relocatio n Modifying the beh avior of hot-re location Alternatively, you can us e the following command: # nohup /etc/vx/bin/vxrelocd root user1 user2 & See the vxrelocd (1M) manual page for more information.[...]

Chap ter 13 Administering cluster functionality A cluster consists of a number of hosts or nodes that share a set of disks. The main benefits of clus ter configurations are: The cluster functionality of Veritas Vo lume Manager (CVM) allows up to 16 nodes in a cluster to simultaneously access and manage a set of disks under VxVM control (VM disks). [...]

398 Administer ing cluster function ality Overview of cluster volume managemen t enabled, all the nodes in the cluster can share VxVM objects such as shared disk groups. Private disk groups are supported in the same way as in a non-clustered environment. This chapter discusses the cluster functionality that is provided with VxVM. Note: You need an [...]

399 Administerin g cluster fun ctionality Overview of cl uster volume managemen t membership. Each node starts up indepen dently and has its own cluster monitor plus its own copies of the operating sy stem and VxVM with support for cluster functionality. Wh en a node joins a cluster, it gains access to shared disk groups and volumes. When a node le[...]

400 Administer ing cluster function ality Overview of cluster volume managemen t Figure 13-1 Example of a 4-node cluster To the cluster monitor, all nodes are th e same. VxVM objects configured within shared disk groups can potentially be acce ssed by all nodes that join the cluster. However, the cluster functionality of Vx VM requires that one nod[...]

401 Administerin g cluster fun ctionality Overview of cl uster volume managemen t Private and shared disk groups Two types of disk groups are defined: In a cluster, most disk groups are sh ared. Disks in a shared disk group are accessible from all nodes in a cluster, allowin g applications on multiple cluster nodes to simultaneously access the same[...]

402 Administer ing cluster function ality Overview of cluster volume managemen t cluster-shareable disk group is available as long as at least one node is active in the cluster. The failure of a cluster node does not affect access by the remaining active nodes. Regardless of which node a ccesses a cluster-shareable disk group, the configuration of [...]

403 Administerin g cluster fun ctionality Overview of cl uster volume managemen t The following table summarizes the allo wed and conflicting activation modes for shared disk groups: Shared disk groups can be automatically activated in any mode during disk group creation or during manual or auto -import. To control aut o-activation of shared disk g[...]

404 Administer ing cluster function ality Overview of cluster volume managemen t Note: The activation mode of a disk grou p controls volume I/O from different nodes in the cluster. It is not possible to activate a disk g roup on a given node if it is activated in a conflicting mode on another node in the cluster. When enabling activation using the [...]

405 Administerin g cluster fun ctionality Overview of cl uster volume managemen t policy . However, in some cases, it is not desirable to have all nodes react in this way to I/O failure. To address this, an alternate way of responding to I/O failures, known as the local det ach policy , was introduced in release 3.2 of VxVM. The local detach policy[...]

406 Administer ing cluster function ality Overview of cluster volume managemen t Local detach policy Caution: Do not use the local detach policy if you use the VCS agents that monitor the cluster functionality of Veritas Volume Manager, and which are provided with Veritas Storage Foundation TM for Cluster File System HA and Veritas Storage Foundati[...]

407 Administerin g cluster fun ctionality Overview of cl uster volume managemen t Disk group failure policy The local detach policy b y itself is insu fficient to determine the desired behavior if the master node loses access to al l disks that contain copies of the configuration database and logs. In this case, the disk group is disabled. As a res[...]

408 Administer ing cluster function ality Overview of cluster volume managemen t Guidelines for choosing detach and failure policies In most cases it is recommended that you use the global detach policy, and particularly if an y of the following condit ions apply: ■ If yo u are using the VCS ag ents that monitor the clust er functionality of V er[...]

409 Administerin g cluster fun ctionality Overview of cl uster volume managemen t The default settings for the detach and failure policies are global and dgdisable respectively. You can use the vxdg command to change both the detach and failure policies on a shared disk group, as shown in this example: # vxdg -g diskgroup set diskdetpolicy=local dg[...]

410 Administer ing cluster function ality Cluster init ialization and configurat ion Cluster initialization and configuration Before any nodes can join a new clust er for the first time, you must supply certain configuration in formation during clust er monitor setup. This information is normally stored in some form of cluster mo nitor configuratio[...]

411 Administerin g cluster fun ctionality Cluster initi alization and con figuration During cluster reconfiguration, VxVM sus pends I/O to shared disks. I/O resumes when the reconfiguration completes. A pplications may appear to freeze for a short time during reconfiguration. If other operations, such as VxVM operations or recoveries, are in progre[...]

412 Administer ing cluster function ality Cluster init ialization and configurat ion Table 13-5 Node abort messages Reason Description cannot find disk on slave node Missing disk or bad disk on the slave node. cannot obtain configuration data The node cannot r ead the conf iguration dat a due to an error such as disk failur e. cluster device open f[...]

413 Administerin g cluster fun ctionality Cluster initi alization and con figuration See the vxclustadm (1M) manual page for more information about vxclustadm and for examples of its usage. Volume reconfiguration V olume r econfiguration is the process of creati ng, changing, and removing VxVM objects such as disk groups, volumes and plexes. In a c[...]

414 Administer ing cluster function ality Cluster init ialization and configurat ion When an error occurs, such as when a chec k on a slave fails or a node leaves the cluster, the error is returned to the utilit y and a message is sent to the console on the master node to identify on which node the error occurred. vxconfigd daemon The VxVM configur[...]

415 Administerin g cluster fun ctionality Cluster initi alization and con figuration stopped, volume reconfigura tion cannot take place. O ther nodes can join the cluster if the vxconfigd daemon is not running on the slave nodes. If the vxconfigd daemon stops, different actions are taken depending on which node this occurred: ■ If the vxconfigd d[...]

416 Administer ing cluster function ality Cluster init ialization and configurat ion Note: The -r reset option to vxconfigd restarts the vxconfigd daemon and recreates all states from scratch. This option cannot be used to restart vxconfigd while a node is joined to a cluster because it causes cluster information to be discarded. In an HP Servicegu[...]

417 Administerin g cluster fun ctionality Multiple h ost failover configurations Note: Once shutdown succeeds, the node has left the cluster. It is not possible to access the shared volumes until the node joins the cluster again. Since shutdown can be a lengthy process, other reconfiguration can take place while shutdown is in progress. Normally , [...]

418 Administer ing cluster function ality Multiple ho st failover co nfigurations corrupted. Similar corruption can also occur if a f i l e s y s t e m o r da t a b a s e o n a r a w disk partition is accessed concurrently by two hosts, so this problem in not limited to Veritas Volume Manager. Import lock When a host in a non-clustered environm ent[...]

419 Administerin g cluster fun ctionality Multiple h ost failover configurations For details on how to clear lo cks and force an import, see “ Moving disk groups between systems ” on page 185 and the vxdg (1M) manual page. Corruption of disk group configuration If vxdg import is used with -C (c lears locks) and/or -f (forces import) to import a[...]

420 Administer ing cluster function ality Administeri ng VxVM in cluster environme nts Administering VxVM in cluster environments The following sections describe the administration of VxVM’s cluster functionality. Note: Most VxVM commands require superuser or equivalent pri vileges. Requesting node status and discovering the master node The vxdct[...]

421 Administerin g cluster fun ctionality Administering VxVM in cluster environme nts Determining if a disk is shareable The vxdisk utility manages VxVM disks. To use the vxdisk utility to determine whether a disk is part of a cluster-sharea ble disk group, use the following command: # vxdisk list accessname where accessname is the disk access name[...]

422 Administer ing cluster function ality Administeri ng VxVM in cluster environme nts The following is example output for the command vxdg list group1 on the master: Group: group1 dgid: 774222028.1090.teal import-id: 32768.1749 flags: shared version: 140 alignment: 8192 (bytes) ssb: on local-activation: exclusive-write cluster-actv-modes: node0=ew[...]

423 Administerin g cluster fun ctionality Administering VxVM in cluster environme nts Caution: The operating system cannot tell if a disk is shared. To protect data integrity when dealing with disks that can be accessed by multiple systems, use the correct designation when adding a disk to a disk group. VxVM allows you to add a disk that is not phy[...]

424 Administer ing cluster function ality Administeri ng VxVM in cluster environme nts ■ Some of the nodes to wh ich disks in the disk gr oup are att ached ar e not cur rently in the clust er , so the disk gro up cannot acc ess all of its disks. In this case, a f orc ed import is unsafe an d must not be at tempted because it can r esult in incons[...]

425 Administerin g cluster fun ctionality Administering VxVM in cluster environme nts can join two private disk groups on any cluster node where those disk groups are imported. If the source disk group and the target disk group are both shared, you must perform the join on the master node. Note: You cannot join a private disk group and a shared dis[...]

426 Administer ing cluster function ality Administeri ng VxVM in cluster environme nts Setting the disk group failure policy on a shared disk group Note: The disk group failure policy for a sha red disk group can only be set on the master node. The vxdg command may be used to set either the dgdisable or leave failure policy for a shared disk group:[...]

427 Administerin g cluster fun ctionality Administering VxVM in cluster environme nts Multiple opens by the same node are also supported. Any attempts by other nodes to open the volu me fail until the final close of the volume by the node that opened it. Specifying exclusive=off instead means that more than one node in a cluster can open a volume s[...]

428 Administer ing cluster function ality Administeri ng VxVM in cluster environme nts Upgrading the cluster protocol version Note: The cluster protocol version can only be updated on the master node. After all the nodes in the cluster have b een updated with a new cluster protocol, you can upgrade the entire cluster using the following command on [...]

429 Administerin g cluster fun ctionality Administering VxVM in cluster environme nts This comm and produces ou tput similar to the following: OPERATIONS BLOCKS AVG TIME(ms) TYP NAME READ WRITE READ WRITE READ WRITE vol vol1 2421 0 600000 0 99.0 0.0 To obtain and display statistics for the entire cluster, use the following command: # vxstat -b The [...]

430 Administer ing cluster function ality Administeri ng VxVM in cluster environme nts[...]

Chap ter 14 Administering sites and remote mirrors In a Remote Mirror configuration (also known as a campus cluster or stretch cluster) the hosts and storage of a cluster that would usually be located in one place, are instead divided between two or more sites. These sites are typically connected via a redundant high -capacity network that provides[...]

432 Administering sites and remot e mirrors If a disk group is config ured across the storage at the sites, and inter-site communication is disrupted, there is a possi bility of a serial split brain condition arising if each site continues to update the local disk group configuration copies (see “ Handling conflicting configuration copies ” on [...]

433 Administering sites and rem ote mirrors To enhance read performance, VxVM will service reads from the plexes at the local site where an application is running if the siteread read policy is set on a volume. Writes are written to plexes at all sites. The site consistency of a volume is ensu red by detaching a site when its last complete plex fai[...]

434 Administering sites and remot e mirrors Configuring sites f or hosts and disks Configuring sites for hosts and disks Note: The Remote Mirror feature requires th at the Site Awareness license has been installed on all hosts at all sites th at are participating in the configuration. Use the following command to set the site name for each host: # [...]

435 Administering sites and rem ote mirrors Configuring site consistency on a disk group The -f option allows the requirement to be removed if the site is detached or offline. The site name is not removed fr om the disks. If required, use the vxdisk rmtag command to remove the site tag as described in “ Configuring sites for hosts and disks ” o[...]

436 Administering sites and remot e mirrors Setting the s iteread policy on a volume To turn on the site consistency requirement for an existing volume, use the following form of the vxvol command: # vxvol [ -g diskgroup ] set siteconsistent=on volume To turn off the site consistency requi rement for a volu me, use the following command: # vxvol [ [...]

437 Administering sites and rem ote mirrors Site-based allocation of storage to volumes Note: If the Site Awareness license is inst alled o n all the hosts in the Remote Mirror configuration, and site consis tency is enabled on a volume, the vxassist command attempts to alloca te storage across the sites that are registered to a disk group. If not [...]

438 Administering sites and remot e mirrors Site-based allocation of s torage to volumes Examples of storage allocation usi ng sites The examples in the following table demo nstrate how to use site names with the vxassist command to allocate st orage. The disk group, ccdg , has been enabled for site consistency with disks configured at two sites, s[...]

439 Administering sites and rem ote mirrors Making an existing disk gro up site consistent Making an existing disk group site consistent T o make an existing disk group site consiste nt 1 Ensure that the disk gr oup is updated to at least v ersion 140, by running the vxdg upgrade com m an d on i t : # vxdg upgrade diskgroup 2 On each host that can [...]

440 Administering sites and remot e mirrors Fire drill — t esting the configuratio n Fire drill — testing the configuration Caution: To avoid potential loss of service or data, it is recomme nded that you do not use these procedures on a live system. After validating that the consistency of the v olumes and disk groups at you r sites, you shoul[...]

441 Administering sites and rem ote mirrors Failure scenarios and recovery procedures site state to ACTIVE, and initiates recov ery of the plexes. When all the plexes have been recovered, the plexes are put into the ACTIVE state. Note: vxsited does not try to reattach a site t h at you have explicitly detached by using the vxdg detachsite command. [...]

442 Administering sites and remot e mirrors Failure scenarios and re covery p rocedures Recovery from a loss of site connectivity If the network links between the si tes are disrupted, the application environments may continue to run in parallel, and this may lead to inconsistencies between the disk group co nfiguration copies at the sites. When co[...]

443 Administering sites and rem ote mirrors Failure scenarios and recovery procedures at the other sites. When the storage comes back online, you can use the following commands to reattach a site and recover the disk group: # vxdg -g diskgroup reattachsite sitename # vxrecover -g diskgroup Recovery from site failure If all the hosts and storage fai[...]

444 Administering sites and remot e mirrors Failure scenarios and re covery p rocedures[...]

Chap ter 15 Using Storage Expert About Storage Expert System administrators often find that gathering and interpreting data about large and complex configurations can be a difficult task. Veritas Storage Expert is designed to help in diagnosing configuration problems with VxVM. Storage Expert consists of a set of simple commands that collect VxVM c[...]

446 Using Storage E xpert How Storage Expert works How Storage Expert works Storage Expert components include a set of rule scripts and a rules engine. The rules engine runs the scripts and produce s ASCII output, which is organized and archived by Storage Expert’s report generator. This output co ntains information about areas of VxVM configurat[...]

447 Using Storage E xpert Running Storage Expert See “Rule definitions and attribut es” on page 456. Discovering what a rule does To obtain details about wh at a rule does, use the info keyword, as in t he following example: # vxse_stripes2 info VxVM vxse:vxse_stripes2 INFO V-5-1-6153 This rule checks for stripe volumes which have too many or t[...]

448 Using Storage E xpert Running Storage Expert # vxse_dg1 -g mydg run VxVM vxse:vxse_dg1 INFO V-5-1-5511 vxse_vxdg1 - RESULTS ---------------------------------------------------------- vxse_dg1 PASS: Disk group (mydg) okay amount of disks in this disk group (4) This indicates that the specified disk group ( mydg ) met the conditions specifie d in[...]

449 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert ■ A value specified on the c ommand line. ■ A value specified in a user-defined defa ults file. ■ A value in the /etc/default/vxse f ile that has not been commented out. ■ A built-in v alue defined at compile t ime. Identifying configuration problems using [...]

450 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert Checking for large mirror vo lumes without a dirty re gion log (vxse_drl1) To check whether large mirro r volumes (larger than 1G B) have an associated dirty region log (DRL), run rule vxse_drl1 . Creating a DRL speeds recovery of mirro red volumes after a system c[...]

451 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert A mirror of the RAID-5 log protects agains t loss of data due to the f ailure of a single disk. You are strongly advised to mirror the log if vxse_raid5log3 reports that the log of a large RAID-5 volume does not have a mirror. See “Adding a RAID-5 log” on page [...]

452 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert Checking the number of configur ation copies in a disk group (vxse_dg5) To find out whether a disk group has on ly a single VxVM configured disk, run rule vxse_dg5 . See “Creating and administering disk groups” on page 165. Checking for non-imported disk gro up[...]

453 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert ■ v olumes needing rec overy See “Reattaching plexes” on page 231. See “Starting a volume” on page 271. See the Veritas Volume Manager Troubleshooting Guide . Disk striping Striping enables you to enhance your system’s performanc e. Several rules enable[...]

454 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert Checking the number of columns in striped volumes (vxse_stripes2) The default values for the number of colu mns in a striped plex are 16 and 3. By default, rule vxse_stripes2 reports a violation if a striped plex in your volume has fewer than 3 columns or more than[...]

455 Using Storage E xpert Identifying configurati on problem s using Stora ge Expert Checking the system name (vxse_host) Rule vxse_host can be used to confirm that the system name in the file /etc/vx/volboot is the same as the name that was assigned to the system when it was booted.[...]

456 Using Storage E xpert Rule defini tions and attributes Rule definitions and attributes You can use the info keyword to show a description of a rule. See “Discovering what a rule does” on page 447. Table 15-1 lists the available rule definiti ons, and rule attributes and their default values. Table 15-1 Rule definitions in Storage Expert Rul[...]

457 Using Storage E xpert Rule definitions and attributes You can use the list and check keywords to show what attributes are available for a rule and to display the defa ult values of these attributes. See “Running a rule” on page 447. Table 15-2 lists the available rule attrib utes and their default values. vxse_raid5log1 Checks f or RAID -5 [...]

458 Using Storage E xpert Rule defini tions and attributes Table 15-2 Rule attributes and defaul t attribute values Rule Attribute Default value Description vxse_dc_failures - - No u ser-configur able vari ab l es . vxse_dg1 max_disks_per_dg 250 Maximum number of disks in a dis k group . W arn if a disk group has mor e disks than this. vxse_dg2 - -[...]

459 Using Storage E xpert Rule definitions and attributes vxse_mirstripe large_mirror_size nsd_threshold 1g (1GB) 8 Larg e mirr or-stripe thr eshold size. W arn if a mirror-stripe vol u m e is l a rge r th a n this. Larg e mirr or-stripe number of subdi sks thre shold . W arn if a mirr or-stripe volume has more subdisks than this. vxse_raid5 too_na[...]

460 Using Storage E xpert Rule defini tions and attributes vxse_redundancy volume_redundancy 0V o l u m e r e d u n d a n c y chec k. The value of 2 perf orms a mirror red u n d an cy c he c k . A value of 1 performs a RAID- 5 re dundanc y chec k . The def ault value of 0 performs no red u n d an cy c he c k . vxse_rootmir - - No u ser-configur abl[...]

461 Using Storage E xpert Rule definitions and attributes vxse_volplex - - N o user-configur able vari ab l es . Table 15-2 Rule attributes and defaul t attribute values Rule Attribute Default value Description[...]

462 Using Storage E xpert Rule defini tions and attributes[...]

Chap ter 16 Performance monitoring and tuning Veritas Volume Manager (VxVM) can improve overall syst em performance by optimizing the layout of data storage on the available hardware. This chapter contains guidelines establishing performance priorities, for monitoring performance, and for configurin g your system appropriately. Performance guidelin[...]

464 Performance moni toring and tuning Perf ormance guidelines Striping Striping improves access performance by cu tting data into slices and storing it on multiple devices that can be access ed in parallel. Stri ped plexes improve access performance for both read and write operations. Having identified the most heavily accessed volumes (containing[...]

465 Performance monit oring and tuning Performan ce guidelines Combining mirroring and striping Note: You need a full license to use this feature. Mirroring and striping can be used together to achieve a significant improvement in performance when there are multiple I/O streams. Striping provides better throughput beca use parallel I/O streams can [...]

466 Performance moni toring and tuning Perf ormance guidelines Volume read policies To help optimize performance for diff erent types of volumes, VxVM supports the following read policies on data plexes: ■ round— a r ound-robin r ead policy , wher e all plexes in the v olume tak e turns satisfying r ead r equests to the v olume. ■ prefer —a[...]

467 Performance monit oring and tuning Performan ce monitoring Note: To improve performance for read-intens ive workloads, you can attach up to 32 data plexes to the same volume . However, this would usually be an ineffective use of disk space for the gain in read performance. Performance monitoring As a system administrator, you have two sets of p[...]

468 Performance moni toring and tuning Performance monitoring T racing volume operations Use the vxtrace command to trace operations on specified volumes, kernel I/O object types or devices. The vxtrace command either prints kernel I/O errors or I/O trace records to the standard output or writes the records to a file in binary format. Binary trace [...]

469 Performance monit oring and tuning Performan ce monitoring an operation makes it possible to measure the impact of that particular operation. The following is an example of output produced using the vxstat command: OPERATIONS BLOCKS AVG TIME(ms) TYP NAME READ WRITE READ WRITE READ WRITE vol blop 0 0 0 0 0.0 0.0 vol foobarvol 0 0 0 0 0.0 0.0 vol[...]

470 Performance moni toring and tuning Performance monitoring Such output helps to identify volume s with an unusually large number of operations or excessive read or write times. To display disk statistics, use the vxstat -d command. The following is a typical display of disk statistics: OPERATIONS BLOCKS AVG TIME(ms) TYP NAME READ WRITE READ WRIT[...]

471 Performance monit oring and tuning Performan ce monitoring If two volumes (other than the root volu me) on the same disk are busy, move them so that each is on a different disk. If one volume is particularly busy (es pecially if it has un usually large average read or write times), stripe the volume (or split the volume into multiple piec es, w[...]

472 Performance moni toring and tuning T uning VxVM writes where mirroring can improve performance depends greatly on the disks, the disk controller, whether multiple co ntrollers can be used, and the speed of the system bus. If a particul arly busy volume has a high ratio of reads to writes, it is likely that mirroring can significantly improve pe[...]

473 Performance monit oring and tuning T uning VxVM Tuning guidelines for large systems On smaller systems (with fewer than a hundred disk drives), tuning is unnecessary and VxVM is capable of adopting reasonable defaults for all configuration parameters. On larger systems, configurations can require additional control over the tuning of th ese par[...]

474 Performance moni toring and tuning T uning VxVM To set the number of configuration co pies for a new disk group, use the nconfig operand with the vxdg init command (see the vxdg (1M) manual page for details). You can also change the number of copies for an existing group by using the vxedit set command (see the vxedit (1M) manual page). For exa[...]

475 Performance monit oring and tuning T uning VxVM Tunable parameters The following sections describe specific tunable parameters. dmp_cache_open If set to on , the first open of a device that is performed by an array support library (ASL) is cached. This enhances the performance of device discovery by minimizing the overhead caused by su bsequent[...]

476 Performance moni toring and tuning T uning VxVM The value of this tunable is changed by using the vxdmpadm settune command. dmp_health_time DMP detects intermittently failing paths, and prevents I/O requests from being sent on them. The value of dmp_health_time represents the time in seconds for which a path must stay healthy. If a path’s sta[...]

477 Performance monit oring and tuning T uning VxVM increasing the value of this tunable. For example, for the HDS 9960 A/A array, the optimal value is between 14 and 16 for an I/O activity pattern that consists mostly of sequential reads or writes. Note: This parameter only affe cts the behavior of the balanced I/O policy. A value of 0 disables mu[...]

478 Performance moni toring and tuning T uning VxVM dmp_restore_policy The DMP restore policy, which ca n be set to 0 (CHECK_ALL), 1 (CHECK_DISABLED), 2 (CHECK_PERIO DIC), or 3 (CHECK_A LTERNATE). The value of this tunable is only changeable by using the vxdmpadm start restore command. dmp_retry_count If an inquiry succeeds on a path, but there is [...]

479 Performance monit oring and tuning T uning VxVM dmp_stat_interval The time interval between gathering DMP statistics. The default and minimum value is 1 second. The value of this tunable is changed by using the vxdmpadm settune command. vol_checkpt_default The interval at which ut ilities performing recoveries or resynchronization operations lo[...]

480 Performance moni toring and tuning T uning VxVM Since the region size must be the same on all nodes in a cluster for a shared volume, the value of the vol_fmr_logsz tunable on the master node overrides the tunable values on the slave nodes, if these values are different. Because the value of a shared volume can change, the value of vol_fmr_logs[...]

481 Performance monit oring and tuning T uning VxVM performing operations of a certain size and can fail unexpectedly if they issue oversized ioctl requests. The default value for this tunable is 32768 bytes (32KB). vol_maxparallelio The number of I/O operations that the vxconfigd (1M) daemon is permitted to request from the kernel in a single VOL_[...]

482 Performance moni toring and tuning T uning VxVM volcvm_sm artsync If set to 0 , volcvm_smartsync disables Smar tSync on sha red disk gr oups. If set to 1 , this parameter enables the use of SmartSync with shared disk groups. See“ SmartSync recovery accelerator ” on page 62 for more information. voldrl_max_drtregs The maximum number of dirty[...]

483 Performance monit oring and tuning T uning VxVM voliomem_maxpool_sz The maximum memory requested from the system by VxVM for internal purposes. This tunable has a direct impact on the performance of VxVM as it prevents one I/O operation from usin g all the memory in the system. VxVM allocates two pools that can grow up to voliomem_maxpool_sz , [...]

484 Performance moni toring and tuning T uning VxVM tracing event records. As trace buffers are requested to be stored in the kernel, the memory for them is drawn from this pool. Increasing this size can allow additional tracing to be performed at the expense of system memory usage. Setting this valu e to a size greater than can readily be accommod[...]

485 Performance monit oring and tuning T uning VxVM Note: The memory allocated for this cache is exclusively dedicated to it. It is not available for other proce sses or applications. Setting the value of volpagemod_max_memsz below 512KB fails if cache objects or volumes that have been prepa red for instant snapshot operations are present on the sy[...]

486 Performance moni toring and tuning T uning VxVM[...]

Appendix A Commands summary This appendix summarizes the usage an d purpose of important commonly-used commands in Veritas Volume Manager (VxVM). References are included to longer descriptions in th e remainder of this book. Most commands (excepting daemons, library commands and supporting scripts) are linked to the /usr/sbin directory from the /op[...]

488 Commands su mmary other commands and scripts, and which are not intended for general use, are not located in /opt/VRTS/bin and do not have manual pages. The following tables summariz e the commonly-used commands: ■ “ Obtaining inform ation about objects in VxVM ” on page 488 ■ “ Administering disks ” on page 489 ■ “ Creating and[...]

489 Commands summary vxinfo [-g diskgroup ] [ vol u m e ...] Display s informat ion about the accessibility and usability of volumes. See “Listing Unstartable V o lumes” in the Veritas Volume Manager Troubleshooting Guide . Example: # vxinfo -g mydg myvol1 myvol2 vxprint -hrt [-g diskgroup ] [ obje ct ] Prints single-line inf ormation about o[...]

490 Commands su mmary vxdiskadd [devicename ...] Adds a disk specified by dev ice name. See “ Using vxdiskadd to place a disk under control of VxVM ” on page 10 1. Example: # vxdiskadd c0t1d0 vxedit [-g diskgroup ] rename olddisk newdisk Renames a disk under c ontrol of Vx V M . See “ Renaming a disk ” on pag e 119. Example: # vxedit -g m[...]

491 Commands summary vxedit [-g diskgroup ] set spare=on|off diskname Adds/r emov es a disk from the pool of hot-r elocation spares. See “ Marking a disk as a hot- relocation spare ” on pag e 387. See “ Removing a disk from use as a hot-relocation sp are ” on page 388. Examples: # vxedit -g mydg set spare=on mydg04 # vxedit -g mydg set [...]

492 Commands su mmary Table A-3 Creating and administerin g disk groups Command Description vxdg [-s] init diskgroup [ diskname =] devicename Creat es a disk group using a pre- initialized disk. See “ Creating a disk group ” on page 170. See “ Creating a shar ed disk group ” on page 422. Example: # vxdg init mydg mydg01=c0t1d0 vxsplitli[...]

493 Commands summary vxdg [-o expand] listmove sourcedg targetdg object ... Lists the obj ects potentially aff ected by moving a disk gr oup. See “ Listing objects potentially affected by a move ” on pag e 200. Example: # vxdg -o expand listmove mydg newdg myvol1 vxdg [-o expand] move sourcedg targetdg object ... Mov es objects between di[...]

494 Commands su mmary vxrecover -g diskgroup -sb Starts all volumes in an imported disk gr oup. See “ Moving disk groups between systems ” on page 185. Example: # vxrecover -g mydg -sb vxdg destroy diskgroup Destr oy s a disk group and r eleases its disks. See “ Destroying a disk group ” on page 208. Example: # vxdg destroy mydg Table A-4 C[...]

495 Commands summary vxsd [-g diskgroup ] assoc plex subdisk1:0 ... subdiskM:N-1 Adds subdisks t o the ends of the columns in a striped or RAID-5 vol u m e. See “ Associating subdisks with plexes ” on pag e 218. Example: # vxsd -g mydg assoc vol01-01 mydg10-01:0 mydg11-01:1 mydg12-01:2 vxsd [-g diskgroup ] mv oldsubdisk newsubdisk ... R[...]

496 Commands su mmary vxunreloc [-g diskgroup] original_disk Relocates subdisks to their original disks. See “ Moving and unrelocating subdisks using vxunreloc ” on page 392. Example: # vxunreloc -g mydg mydg01 vxsd [-g diskgroup ] dis subdisk Dissociates a subdisk from a ple x. See “ Dissoc iating subdisks fr om plexes ” on page 221. Examp[...]

497 Commands summary vxmake [-g diskgroup ] plex ple x layout=stripe|raid5 stwidth= W ncolumn= N sd= subdisk1 [, subdisk2 ,...] Creat es a striped or R AID-5 plex. See “ Creating a striped plex ” on page 224. Example: # vxmake -g mydg plex pl-01 layout=stripe stwidth=32 ncolumn=2 sd=mydg01-01,mydg02-01 vxplex [-g diskgroup ] att vol u[...]

498 Commands su mmary vxplex [-g diskgroup ] cp vol u m e n ew p l ex Copies a volume ont o a plex. See “ Copying volumes to plexes ” on page 233. Example: # vxplex -g mydg cp vol02 vol03-01 vxmend [-g diskgroup ] fix clean ple x Sets the state of a ple x in an unstart able volu me to CLEAN. See “ Reattaching pl exes ” on page 231. Exampl[...]

499 Commands summary vxassist -b [-g diskgroup ] make vol u m e length [layout= lay out ] [ attr ibutes ] Creat es a volume. See “ Creating a volume on any disk ” on page 243. See “ Creating a volume on spec ific disks ” on page 244. Example: # vxassist -b -g mydg make myvol 20g layout=concat mydg01 mydg02 vxassist -b [-g diskgroup ] [...]

500 Commands su mmary vxassist -b [-g diskgroup ] make vol u m e length layout=mirror mirror=ctlr [ attributes ] Cre ates a volume with mirr ored data plexes on separ ate contr ollers. See “ Mirroring across targets, controllers or enclosures ” on page 255. Example: # vxassist -b -g mydg make mymcvol 20g layout=mirror mirror=ctlr vxmake[...]

501 Commands summary Table A-7 Adminis tering volumes Command Description vxassist [-g diskgroup ] mirror volu me [ attributes ] Adds a mirr or to a v olume. See “ Adding a mirror to a volume ” on page 271. Example: # vxassist -g mydg mirror myvol mydg10 vxassist [-g diskgroup ] remove mirror vol u m e [ attributes ] Remo ves a mirr or fr[...]

502 Commands su mmary vxsnap [-g diskgroup ] prepare volu me [drl=on|sequential|off] Pr epares a volume f or instant snapshots and f or DRL logging . See “ Preparing a volume for DRL and instant snapshots ” on page 275. Example: # vxsnap -g mydg prepare myvol drl=on vxsnap [-g diskgroup ] make source = vol u m e /newvol = snapvol [/nmir[...]

503 Commands summary vxmake [-g diskgroup ] cache cache_object cachevolname = vol u m e [regionsize = size ] Creates a cache obje ct for use by space-optimized instant snapshots. See “ Creating a shared cache object ” on page 322. A cache v olume must have alr eady been cre ated, as shown in this exa mp l e: # vxassist -g mydg make cvol 1[...]

504 Commands su mmary vxsnap [-g diskgroup ] unprepare volu me Removes support f or instant snapshots and DRL logging fr om a vol u m e. See “ Removing suppo rt for DRL and instant snapshots from a volu me ” on page 279. Example: # vxsnap -g mydg unprepare myvol vxassist [-g diskgroup ] relayout vol u m e [layout= lay ou t ] [ relay out_opt[...]

505 Commands summary vxassist [-g diskgroup ] convert vol u m e [layout = lay ou t ] [ conv er t_options ] Conv erts between a la yered v olume and a non-lay ered v olume lay out. See “ Converting between layered and non-layered volumes ” on pag e 300. Example: # vxassist -g mydg convert vol3 layout=stripe-mirror vxassist [-g diskgroup ] re[...]

506 Commands su mmary vxtask pause task Suspends oper ation of a task. See “ Using the vxtask command ” on page 269. Example: # vxtask pause mytask vxtask -p [-g diskgroup ] list L ists all paused tasks. See “ Using the vxtask command ” on page 269. Example: # vxtask -p -g mydg list vxtask resume task Resumes a paused task. See “ Using th[...]

507 Commands summary Online manu al pages Online manual pages Manual pages are organi zed into three sections: ■ Section 1M — administrative commands ■ Section 4 — file formats ■ Section 7 — device driver interfaces Section 1M — admini strative commands Manual pages in section 1M describe commands that a re used to administer Veritas [...]

508 Commands su mmary Online manual pages vxconfigd V eritas V olume Manager c onfigurat ion daemon vxconfigrestore Rest ore disk gr oup conf igurat ion. vxcp_lvmroot Copy L VM root disk onto new V eritas V olume Manager root disk. vxdarestore Rest ore simple or nopriv disk access r ecords. vxdco Perf orm operat ions on version 0 DCO object s and D[...]

509 Commands summary Online manu al pages vxmend Mend simple problems in c onfigur ation rec ords. vxmirror Mirr or volume s on a disk or contr ol default mirr oring. vxnotify Display V eritas V olume Manager c onfigur ation ev ents. vxpfto Set P owerf ail T imeout (pfto ). vxplex Perf orm V eritas V olume Manager oper ations on plex es. vxpool Cre[...]

510 Commands su mmary Online manual pages Section 4 — file formats Manual pages in section 4 describe the fo rmat of files that are used by Veritas Volume Manager. Section 7 — device driver interfaces Manual pages in section 7 describe th e interfaces to Veritas Volume Manager devices. vxtune Adju st V eritas V olume Replicat or and V eritas V [...]

Appendix B Configuring Veritas Volume Manager This appendix provides guidelines for se tting up efficient storage management after installing the Verita s Volume Manager software. This chapter describes: ■ Setup tasks after insta llation ■ Adding unsupported disk arrays as JBODs ■ Adding foreign devices ■ Adding disks to disk groups ■ Gui[...]

512 Configuring Veritas Volume M anager Adding unsupported disk arrays as JBODs Optional Setup T asks ■ Place the root disk under V xVM contr ol and mirr or it to c reat e an alternate boot disk. ■ Designate hot -reloc ation spar e disks in e ach disk gr oup. ■ Add mirr or s to v olumes. ■ Configur e DRL and F astResync on v olu mes. Mainte[...]

513 Configuring Ve ritas Volume Man ager Guideline s for configuring storage groups. Storage pools are only required if you intend using the ISP feature of VxVM. Guidelines for configuring storage A disk failure can cause loss of data on th e failed disk and lo ss of access to your system. Loss of access is due to the fa ilure of a key disk used fo[...]

514 Configuring Veritas Volume M anager Guidelin es for configurin g storage ■ Leav e the V eritas V olu me Manager hot -relocat ion feat ure enabled. See “ Hot- relocation guidelines ” on page 516 f or details. Mirroring guidelines Refer to the following guidelines when using mirroring. ■ Do not place subdisks fr om differ ent plex es of a[...]

515 Configuring Ve ritas Volume Man ager Guideline s for configuring storage Dirty region logging guidelines Dirty region logging (DRL) can speed up recovery of mirrored volumes following a system crash. When DRL is enabled, Veritas Volume Manager keeps track of the regions within a volume that have ch anged as a result of writes to a plex. Note: U[...]

516 Configuring Veritas Volume M anager Guidelin es for configurin g storage ■ If mor e than one plex of a mir ror ed v olume is striped, configur e the same stripe-unit size f or each striped ple x. ■ Where poss ible, distribute the subdisks of a striped v olume across dri ves connec ted to diff erent c ontroller s and buses. ■ A v oid the u[...]

517 Configuring Ve ritas Volume Man ager Guideline s for configuring storage The hot-relocation feature is enabled by default. The associated daemon, vxrelocd , is automatically started during system startup. Refer to the following guidelin es when using hot-relocation. ■ The hot-r elocat ion featur e is enabled by def ault. A lthough it is possi[...]

518 Configuring Veritas Volume M anager Controlling VxV M’s view of multipathed de vices subdisks to determine whether they should be r elocated to mor e suitable disks t o reg ain the original performan ce benefits. ■ Although it is possible t o build V eritas V olume Manager objects on spar e disks (using vxma ke or the VEA interface ), it is[...]

519 Configuring Ve ritas Volume Man ager Configuring cl uster support Configuring shared disk groups This section describes how to configure shared disks in a cluster. If you are installing Veritas Volume Ma nager for the first time or adding disks to an existing cluster, you need to configure new shared disks. If you are setting up Veritas Volume [...]

520 Configuring Veritas Volume M anager Reconfiguration tasks If dirty region logs exist, ensure they are active. If not, replace them with larger ones. To display the shared flag for all the shared disk groups, use the following command: # vxdg list The disk groups are now ready to be shared. 3 Bring up the other cluster nodes. Enter the vxdg list[...]

Glo ssar y Activ e/Active d isk arr ays This type of multipathed disk arr ay allows you to ac cess a disk in the disk arr ay throu gh all the paths to the disk simultaneously , without any perf ormance degr adation. Active/Passive disk arrays This type of multipathed disk arr ay allow s one path to a disk to be designated as primary and used to ac [...]

522 Glossa ry cluster A set of hosts ( eac h termed a node ) that share a set of disks. cluster manager An ext ernally-pro vided daemon that runs on each node in a c luster . The c luster manager s on each n od e co mm un ic ate wi th ea ch o th e r and inform V xVM of chang es in cluster membership . cluster-shareable disk gr oup A disk group in w[...]

523 Glossa ry maintained in the DCO v olume. Otherwise, the DRL is allocated to an associated subdisk called a log subdisk . disabled path A path to a disk that is not availa ble for I/O . A path can be disabled d ue t o rea l h a rd wa re failures or if the user has used th e vxdmpadm disable command on that contr oller . disk A co llection of rea[...]

524 Glossa ry An alternat ive term f or a disk name . disk media record A configur ation rec ord that identifies a partic ular disk , by disk ID, and gives that disk a logical ( or administrativ e ) name. disk name A logical or administrati ve name chosen for a disk that is under the c ontrol of V xVM, such as disk03 . The term disk media n ame is [...]

525 Glossa ry An ar ea of a disk under V xVM contr ol that is not allocat ed to any subdisk or r eserv ed for use by a ny other V xVM obj ect. free subdisk A subdisk that is not associated with any ple x and has an empty putil[0] fi eld . hostid A st r i n g t h a t i d e n t i fi e s a h o s t t o VxV M . T h e hostid fo r a h o s t i s s to re d [...]

526 Glossa ry Where the re ar e multiple phy sical acc ess paths to a disk connec ted to a sy stem, the disk is called multipathed. Any softwar e residing on the host, (for e xample, the DMP driver ) that hides this f act fr om the user is said to pr ovide multipathing func tionality . node One of the hosts in a cluster . node abort A situat ion wh[...]

527 Glossa ry A f orm of FastResync that can pr eserve its maps acr oss r eboots of the syst em by storing its cha nge ma p i n a DCO volume on disk. Al so see data change object (DCO) . persistent state logging A logging type that ensures that only act ive mirr ors are used f or rec overy purposes and pre vents failed mirr ors from being selected [...]

528 Glossa ry The disk containing the r oot file syst em. This disk may b e under V xVM contr ol. root file system The initial f ile system mount ed as part of the UNIX kernel start up sequence. root partition The disk region on w hich the root file sy stem resides. root volume The V xVM volume that c ontains th e r oot file system, if such a v olu[...]

529 Glossa ry A plex that is not as long as the volume or th at has holes (regions of the ple x that do not have a ba cking subdisk). Storage Area Network (SAN) A networ king paradig m that pr ovides easily r econfigur able c onnectiv ity between any subset of computers, disk stor age and inter connecting har dwar e such as switches, hubs and bridg[...]

530 Glossa ry A virtual disk, r epresenti ng an addressable r ange of disk block s used by applications such as file syst ems or databases. A volume is a collect ion of from one t o 32 plex es. volume configuration device The v olume configur ation devic e ( /dev/vx/config ) is the interface thr ough which all conf iguration c hanges to the volume [...]

Index Symbols /dev/vx/dmp directory 126 /dev/vx/rdmp directory 126 /etc/default/vxassist file 241, 390 /etc/default/vxdg defaults file 403 /etc/default/vxdg file 171 /etc/default/vxdisk file 81, 97 /etc/default/vxse file 448 /etc/fstab file 290 /etc/volboot file 21 2 /etc/vx/darecs file 212 /etc/vx/disk.info file 93 /etc/vx/dmppolicy.inf o file 148[...]

532 Index ndcomirror 25 1, 252, 357 ndcomirs 275, 3 21 newvol 330 nmirror 330 nomanual 146 nopreferred 146 plex 234 preferred priority 146 primary 147 putil 222, 234 secondary 147 sequential DRL 252 setting for paths 146 setting for rule s 448 snapvol 3 27, 332 source 327, 3 32 standby 147 subdisk 221 syncing 319, 34 4 tutil 222, 234 auto disk type[...]

533 Index clusters activating disk gro ups 403 activating shared disk groups 425 activation modes for sha red disk groups 40 2 benefits 397 checking cluster proto col version 4 27 cluster-shareable disk groups 401 configur ation 410 configur ing exclusive open of volume by node 426 connectivity po licies 404 converting shared disk groups to private[...]

534 Index crash dumps using VxVM volumes for 107 Cross-platform Data Sharing (CDS) alignment constraints 242 disk format 81 CVM cluster functionality of VxVM 397 D d# 20, 78 data change object DCO 69 data redundancy 42, 43, 46 data volume configuration 6 2 database replay logs and seq uential DRL 61 databases resilvering 62 resynchronizing 62 DCO a[...]

535 Index A/P-C 126 A/PF 126 A/PF-C 126 A/PG 126 A/PG-C 126 Active/Active 126 Active/Passive 125 adding disks to DISKS c ategory 87 adding vendor-supplied support package 84 Asymmetric Active/Active 126 defined 21 excluding support for 86 listing excluded 8 6 listing supported 85 listing supported disks in DISKS category 87 multipathed 22 re-includ[...]

536 Index serial split brain condition 190 setting connectivity policies in clusters 425 setting default disk group 1 68 setting failure policies in clusters 426 setting nu mber of con figuratio n copies 4 74 shared in clusters 401 specifying to commands 167 splitting 196 , 205 splitting in clus ters 424 Storage Expert rules 451 upgrading version o[...]

537 Index spares 388 removing from VxVM c ontrol 112, 17 2 removing tags fro m 178 removing with sub disks 111, 112 renaming 119 replacing 112 replacing removed 1 15 reserving for special purpo ses 119 resolving status in clusters 404 scanning for 82 secondary path 138 setting connectivity policies in clusters 425 setting failure policies in cluste[...]

538 Index dmp_scsi_timeo ut tunable 4 78 dmp_stat_inter val tunable 479 DRL adding log subdisks 220 adding logs to mirrored volumes 281 checking existence of 450 checking existence of mirror 450 creating volumes with DR L enabled 252, 25 3 determining if active 278 determining if enabled 278 dirty bits 60 dirty region logging 60 disabling 278 enabl[...]

539 Index use with snapshots 66 fastresync attr ibute 251 , 252, 293 file systems growing using vxresize 285 shrinking using vxresize 285 unmounting 290 fire drill defined 432 testing 440 firmware upgrading 154 FMR. See FastResync foreign devices adding 89 formatting disks 96 free space in disk groups 384 fullinst snapshot typ e 343 full-sized inst[...]

540 Index initialization of di sks 90 instant snapshots backing up multiple volumes 333 cascaded 312 creating backups 319 creating for volume s ets 334 creating full-sized 327 creating space-optimized 324 creating volumes for use as full-sized 3 23 displaying information about 342 dissociating 340 full-sized 307 improving performance of synchroniza[...]

541 Index LUN group f ailover 126 LUN groups displaying details of 140 LUNs idle 477 M maps adding to volumes 274 usage with volumes 237 master node defined 400 discovering 420 maxautogro w attribute 322 maxdev attribute 189 MC/ServiceGuard use with VxVM in clusters 41 0 memory granularity of allocation by VxVM 482 maximum size of pool for VxVM 483[...]

542 Index plex attribute 234 renaming disks 119 subdisk 29 subdisk attr ibute 221 VM disk 29 volume 31 naming scheme changing for disks 91 changing for TPD enclosures 94 for disk devices 78 native multipathing 77, 130 ncachemirror a ttribute 3 25 ndcomirror attrib ute 251, 252, 357 ndcomirs a ttribute 275, 321 NEEDSYNC volume state 266 newvol attri[...]

543 Index hot spots identified by I/O traces 4 72 impact of number o f disk group conf iguration copies 473 improving for instant snapshot synchronization 345 load balancing in DMP 129 mirrored volumes 4 64 monitoring 467 moving volumes to improve 470 obtaining statist ics for disks 470 obtaining statistics for volu mes 468 RAID-5 volumes 465 setti[...]

544 Index condition flags 228 converting to snapshot 351 copying 233 creating 223 creating striped 224 defined 30 detaching from volumes tempor arily 231 disconnecting from volumes 230 displaying information about 224 dissociating from volum es 233 dissociating subdisks from 22 1 failure in hot -relocatio n 380 kernel states 229 limit on number per[...]

545 Index performance of 466 prefer 289 round 289 select 289 siteread 28 9, 433, 434, 436 split 289 read-only mode 402 readonly mode 40 2 RECOVER plex condition 228 recovery checkpoint interval 479 I/O delay 479 preventing on restarting volumes 271 recovery accele rator 62 recovery time Storage Expert rules 449 redo log configuration 63 redundanc y[...]

546 Index read policy 289 rules attributes 458 checking attrib ute values 447 checking disk group configuration copies 451 checking disk group version number 451 checking for full disk group confi guration database 451 checking for initialized disks 452 checking for mirrored DRL 450 checking for multip le RAID-5 logs on a disk 449 checking for non-[...]

547 Index siteconsistent at tribute 435 siteread read policy 289 , 433, 434, 436 sites reattaching 440 size units 216 slave nodes defined 400 SmartSync 62 disabling on shared disk groups 482 enabling on shared disk groups 482 snap objects 72 snap volume naming 317 snapabort 305 SNAPATT plex state 226 snapback defined 306 merging snapshot volum es 3[...]

548 Index standby path attribute 147 states for plexes 224 of link objects 311 volume 265 statistics gathering 12 8 storage ordered allo cation of 245, 251, 257 storage attributes and volum e layout 244 storage cache used by space-optimized instant snapshots 309 Storage Expe rt check keyword 447 checking default values of rule attributes 447 comman[...]

549 Index physical disk placement 513 putil attribute 22 2 RAID-5 fail ure of 380 RAID-5 plex, configuring 516 removing from VxVM 22 1 restrictions on moving 217 specifying differ ent offsets for unrelocation 393 splitting 217 tutil attribute 22 2 unrelocating after ho t-relocation 39 0 unrelocating to different disks 393 unrelocating using vxassis[...]

550 Index vol_default_iodelay 479 vol_fmr_logsz 68, 479 vol_max_vol 480 vol_maxio 480 vol_maxioctl 480 vol_maxparallelio 481 vol_maxspecialio 481 vol_subdisk_num 481 volcvm_smartsync 482 voldrl_max_drtregs 482 voldrl_max_seq_dirty 61, 482 voldrl_min_regionsz 482 voliomem_ chunk_size 482 voliomem _maxpool_sz 483 voliot_ errbuf_dflt 483 voliot_iobuf_[...]

551 Index DETACHED 267 DISABLED 267 ENABLED 267 volume length, RAID-5 guidelines 516 volume resynchronization 59 volume sets adding volumes to 362 administering 361 controlling access to r aw device no des 366 creating 362 creating instant snapshots of 334 displayi ng access t o raw device nodes 366 enabling access to raw device nodes 365 listing d[...]

552 Index effect of growing on FastResync maps 73 enabling FastResync on 292 enabling FastResync on new 251 excluding storage from use by vxassist 244 finding ma ximum size of 242 finding out maximum p o ssible growth of 284 flagged as dirty 59 initializing contents to zero 261 initializing using vxassist 260 initializing using vxvol 261 kernel sta[...]

553 Index zeroing out contents of 261 vxassist adding a log subdisk 220 adding a RAID-5 log 283 adding DCOs to volumes 357 adding DRL logs 281 adding mirrors to volu mes 230, 271 adding sequentia l DRL logs 282 advantages of using 239 changing number of columns 298 changing stripe unit size 29 8 command usage 240 configuring exc lusive access to a [...]

554 Index reattach ing version 0 DCOs to volumes 359 removing version 0 DCOs from volumes 358 vxdctl checking cluster proto col version 4 27 managing vxconfigd 212 setting a site tag 43 4 setting default disk group 1 68 upgrading cluster p rotocol version 42 8 usage in clusters 42 0 vxdctl enable configur ing new disks 82 invoking device discovery [...]

555 Index vxdisk scandisks rescanning devices 82 scanning devices 82 vxdiskadd adding disks to disk groups 171 creating disk groups 171 placing disks under VxVM control 101 vxdiskadm Add or initialize one or mo re disks 97, 171 adding disks 97 adding disks to disk groups 171 Change/display the default disk lay out 97 changing disk-naming scheme 91 [...]

556 Index removing instant snapshots 341 removing plexes 234 removing snapshots from a cache 347 removing subdisks from VxVM 221 removing volumes 290 renaming disks 119 reserving disks 119 VxFS file system resizing 28 5 vxiod I/O kernel threads 19 vxmake associating plexes with volumes 229 associating subdisks with new plexes 218 creating cache obj[...]

557 Index vxse_dg2 rule to check disk gr oup configuration copies 451 vxse_dg3 rule to check on disk config size 451 vxse_dg4 rule to check disk gr oup version number 451 vxse_dg5 rule to check number of configuration copies in disk group 452 vxse_dg6 rule to check for n on-imported disk groups 452 vxse_disk rule to check for initiali zed disks 452[...]

558 Index moving subdisks after hot- relocation 392 restarting afte r errors 394 specifying different of fsets for unrel ocated subdisks 393 unrelocating su bdisks after hot-relocat ion 392 unrelocating subdis ks to different disks 393 VxVM benefits to performance 4 63 cluster functionality (CVM) 397 configuration daem on 212 configur ing disk devi[...]