ADIC 6-00026-01 Rev A manual

AMASS Over vie w AMASS V er sion 5.3 A ugust 2002 6-00026-01 Re v A[...]

Trad emark Notice ADIC, AMASS, CentraVision, DAS, DataMgr, FileServ, and VolServ are either trademarks or registered trademarks of A dvanced Digital Information Corporation. All other product names and identificat ions are trademarks or r egi stered trademarks of their respective owners. Copyright Notice © 1996-2002 ADIC ® All rights reserved. Th[...]

ADIC includes this Form in an effort to provide the best possible documentation to our customers. Please take a few mome nts to mail or FAX your response to: ADIC Technical Public ations 8560 Upland Drive Englewood, CO 80112 FAX: 303-792-2465 Email: techdocs@adic.com Question Cir cle One Inf or mat ion was c omplete. Agree Disag ree Inf or mat ion [...]

NO T ES[...]

6-0002 5-01 Rev A Contents v Contents Preface Purpose of This Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . P-3 Who Should Read This Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . P-3 How This Book is Organized . . . . . . . . . . . . . . . . . . . . . . [...]

Accessing Storage Devices vi Cont ents 6-0002 5-01 Rev A Design Maintains Data Integrity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-13 File Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-14 Database Recovery . . . . . . . . . . . . . . . . . . . . . . . . . . .[...]

Accessing Storage Devices 6-0002 5-01 Rev A Contents vii Accessing the Stora ge Network 2 Local and Network Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-3 Local Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-3 Network Access . . .[...]

Accessing Storage Devices viii Co ntent s 6-0002 5-01 Rev A Index[...]

P Preface[...]

AMA SS Overview P-2 Pr eface 6-00026-0 1 Rev A NO TES[...]

AMASS Ov erview 6-00026-01 Rev A Preface P-3 Purpose of This Book This book pro vides an introduction or high-lev el summary of AMASS, ADIC’ s Archi val Managem e nt and Storage System software application. Who Shou ld Read This Book This book is written for prospecti v e customers as well as for the system admi nistrator who will be using and ma[...]

AMA SS Overview P-4 Pr eface 6-00026-0 1 Rev A Conventions The c on v entions used throughout the AMASS technical books are listed below: Con vention Exa m ple The word “li brary” usually includes “j uk ebox” and “stand alone drive” and is a gener ic wa y to ref e rence a st orage de vic e . If using HP SunSpot j uk ebox es, instal l pa[...]

1 Online Ar c hiving with AMASS[...]

AMA SS Overview 1-2 Online Archiving wi th AMASS 6-0002 6-01 Rev A NO TES[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archivi ng with A MASS 1-3 Using AMASS to Arc hive Yo u r D a t a The Archiv al Management and Storage System (AMASS) is a management tool for your storage solution. Files are archiv ed to media stored in robotic libraries, jukebox es, and standalone dr i v es . The archi ved f ile system managed by AMASS is[...]

AMA SS Overview 1-4 Online Archiving wi th AMASS 6-0002 6-01 Rev A Ar chive ver sus Bac kup and Restore Backup and restore applications are usually an automatically scheduled operation aimed at pr otecting original data against any kind of loss or damage. The goal of archiving is usually to conserv e online storage space. It is mor e cost ef fectiv[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archivi ng with A MASS 1-5 Documentat ion Set Ov er vie w The f igure belo w provides an ov ervie w of an AMASS-managed storage solution and a reference to other books in the AMASS documentation set. S C S I - a t t a c h e d n e t w o r k - a t t a c h e d T o use s tandalone drives, ref er to Accessing Sto[...]

AMA SS Overview 1-6 Online Archiving wi th AMASS 6-0002 6-01 Rev A Benefits of Using AMASS The management tool for your storage system should provide: • Performan ce • Data i ntegrity • Ease-of-use • Fle xibility The benefits of using AMASS are descr ibed in the follo wing table: Database Impr oves P erformance AMASS keeps a File System Dat[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archivi ng with A MASS 1-7 The follo wing figure illustrates the concept of ho w the File System Database maps the f ile system data to the volum e s in the libra ry. F aster P erformance Because the File System Database is resident on the server’ s hard disk, utilities a nd system calls operate quick ly b[...]

AMA SS Overview 1-8 Online Archiving wi th AMASS 6-0002 6-01 Rev A A utomated Backu ps via Cron Job Because the File System Database is ext remely important, this information must be protected. Consequently , the amassbackup command, run from a cron job, re gularly backs up both the Database and the Journal. The Journal is a transaction log of dail[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archivi ng with A MASS 1-9 Design Pre vents Thrashing In a storage en vironm ent, there ar e many v olume s b ut onl y a fe w driv e s . I f se veral requests come in for many dif f erent v olumes, the potential exists for AMASS to spend most of its time mo ving media in and out of dri ves and little of it s[...]

AMA SS Overview 1-10 Online Archiv ing with AM ASS 6-00026-01 Rev A • Prioritizing reads-from-volumes o ver writes-to-volumes Configurable Cache The cache size can be c onf igured to take adv antage of both the application being used and the system en vironment where AMASS is instal led. Applications running database tables in the library , may n[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-11 When a volume is full, AMASS a utoma tica lly se lects t he next a vailable volume to continue its operations. The v olumes that make up AMASS can be subdi vided, if desired, into multiple groups called volume groups . V olume Groups Archiving f iles by projects can be achie ved wi[...]

AMA SS Overview 1-12 Online Archiv ing with AM ASS 6-00026-01 Rev A The follo wing figure illustrates these v olume groups: After a volume has been assigned to a numerical volum e group, all writes to the volum e group di rec tory and its subdirectories go to the specif ied volumes. No other data is placed on these volum es. There fore, when all th[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-13 • Allo w AMASS to automatically assign a v olume from the space pool to the out-of-space volume group. Do this b y using the AMASS vgpool command to enable space pool for the specified v olume group. For more information on volume groups, refer to Managing the AMASS File System .[...]

AMA SS Overview 1-14 Online Archiv ing with AM ASS 6-00026-01 Rev A File Recov er y Because write operations go to the cache first (including sync , fsync , and synchronous IO), in the e vent of a system crash, AMASS recovers all write opera tions that were in the cache a nd processes the writes to media afte r the system is rebooted. This paradigm[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-15 As an aid in v olume verification, the system adminis trator enters either a bar code or a user-def ined label when introducing a v olume to the File System Da tabase. At the same time, AMASS assigns the v olume a uni que numer ical ID. From then on, AMASS tracks the v olume by thi[...]

AMA SS Overview 1-16 Online Archiv ing with AM ASS 6-00026-01 Rev A Scattered writes a llo w s AMASS to use more tha n one dri ve to write to volum es in a volume group. F or configuration parameters, refer to Installing AMASS . Compre ssion and Bl oc k S ize Im prov es Throug hput Config uring compression and block size typically impro ves through[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-17 T ape Strea ming Improves Writ e P erf ormance Streaming tape IO provides a cons tant flo w of data output to a dri ve, which lessens start and stop operations. This feature typically impro ves write performance but depends on f ile size, number of files, a nd dri ve type. During p[...]

AMA SS Overview 1-18 Online Archiv ing with AM ASS 6-00026-01 Rev A T ool s The follo wing tools assist with f ile system tasks and troubleshooting: Command s The AMASS commands are a set of UNI X-style, command-line interfaces. These commands, as well as standard UN IX commands, help you manage archivi ng a file system onto media in storage de vic[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-19 ADIC Scalar 1000 AMASS does not support automatic dri ve cleaning on the ADIC Scalar 1000 with firmw are ear lier than le v e l 2.10. Consequently , the Cleaning Mode must be disabled as f ollo ws: Step 1. Enter the Main menu by pressing the Escape butt on on the operator pa nel. S[...]

AMA SS Overview 1-20 Online Archiv ing with AM ASS 6-00026-01 Rev A Step 8. Press Escape until you reach the Status Display menu (the initial screen). Flexi ble AMASS is both driv e and librar y independent thus allo wing you to choose the hardware that meets the specif ic nee ds of your company . For detailed information, refer to Accessing Stora [...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-21 • A network-attached Storage T echnology storage device using Automatic Cartridge System Library Software (A CSLS). During the AMASS installation, conf igure the unique media types with separate authorization strings. For e xample, if the AML contains both DL T and 3590 media, de[...]

AMA SS Overview 1-22 Online Archiv ing with AM ASS 6-00026-01 Rev A Optional Features T o enable the follo wing optional features, obtain a unique authorization string from your AMASS sales representativ e. Enter this alphanumeric string during the installation process. Offline Medi a Manager If media has been removed from a li br ary , juke, or st[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-23 The metadata contains the di rectory structure and media attributes (such as media type, ownership, and ti mestamp) for a specified v olume group. The metadata is located in /usr/amass/filesysdb and is exported as standard ASCII te xt. Send this fil e to the tar get AMASS si te usi[...]

AMA SS Overview 1-24 Online Archiv ing with AM ASS 6-00026-01 Rev A The following figure il lustrates these steps: For more information, refer to the Command Reference chapter in Managing the AMASS File System . Te xa s 1. Impor t metadata that describes specified volumes. 2. Load spec i fied volumes. Meta data File AM ASS[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-25 V olume Copy The volcopy command copies data from a source volume to a destination v olume. If the original v olume is lost, destroyed, or damaged, you can use the duplicate volume exactly lik e you would the original. AMAS S supports volcopy on the follo wing media: •W O R M •[...]

AMA SS Overview 1-26 Online Archiv ing with AM ASS 6-00026-01 Rev A CD Impor t Import data from CDs formatted by the standards prescribed by the follo wing: • High Sierra • ISO 9660 • Rockridge (an ISO 9660 format with extensions) For more information, refer to the Command Reference chapter in Managing the AMASS File System. DataMgr DataMgr i[...]

AMASS Ov erview 6-0002 6-01 Rev A Online Archiving with AM ASS 1-27 Infinite File Lif e The Inf inite File Life (IFL) opti onal feature automa tically manages vo latile media over an e xtended period. IFL performs the follo wing functions: • T racks magnetic media, which degenerates ov er time • Determines the amount of deterioration on each vo[...]

AMA SS Overview 1-28 Online Archiv ing with AM ASS 6-00026-01 Rev A NO TES[...]

2 Accessing the Stora g e Netw ork[...]

AMA SS Overview 2-2 Accessing the Storage Network 6-00026-0 1 Rev A NO TES[...]

AMASS Ov erview 6-00026-01 Rev A Accessing the Storag e Network 2-3 Local and Netw o rk Access Because AMASS is implemented at the virtual f ile system (VFS) laye r of the serve r’ s operating system, it is t ransparent to other software programs on the server . Consequently , AMASS as well as the file sys te m mounted under AMASS can be accessed[...]

AMA SS Overview 2-4 Accessing the Storage Network 6-00026-0 1 Rev A AMASS supports NFS b y making its file system appear as a mounted local f ile system to the NFS server . This allo ws the AMASS f ile system to be expor ted in the same manner as the standard local f ile system is exported. Thus, the AMASS f ile system or its subdire ctories can be[...]

AMASS Ov erview 6-00026-01 Rev A Accessing the Storag e Network 2-5 Remote F ile Cop y (RCP) RCP allo ws the user to do f ile transfers to a nd from the AMASS without manually logging onto the remote system. The login function is perfo r med a utomatically b y the RCP utility . In addition, RCP can do recurs iv e copies, whic h can copy an entire d[...]

AMA SS Overview 2-6 Accessing the Storage Network 6-00026-0 1 Rev A Suppor ted Libraries and Drives AMASS supports a maximum of: • 8 libra ries • 256 drives p e r library • 65,000 volumes AMASS supports the follo wing types of storage devices: • Multiple libra ries of the sa me model in a daisy-chained conf igura tion • Heterogeneous libr[...]

AMASS Ov erview 6-00026-01 Rev A Accessing the Storag e Network 2-7 The follo wing fi gure illustrates these connections: The follo wing figure illustrates library and dri ve addresses: RS-232 Juke box SCSI UNIX Application Server Client Juke box AMASS Library Netw ork Standalone Drive Drive Library The library has its own SCSI or IP address. Each [...]

AMA SS Overview 2-8 Accessing the Storage Network 6-00026-0 1 Rev A Fibre Cha nnel Suppor t This release of AMASS has been successfully tested on the follo wing Fibre Channel configurations HP9000 V Serie s S-class with Fibre Channel PCI Fibr e HP Fi bre Ch annel Multipl e xer A3511A SCSI IBM 359 0B1A T a pe SCSI card, us ing SCTL StorageT e k 9840[...]

AMASS Ov erview 6-00026-01 Rev A Accessing the Storag e Network 2-9 For more information about Fibre Channel support, refer to the appendix in Installing AMASS . AMASS Ins talled on Platfor m Multiplexer/Router Drive HP 900 0 V ser ies S-clas s runn ing HP-UX 1 1.0 with a Fibre C hannel PCI SCS I card using an SCTL dr iv er HP Fibre Chan nel Multip[...]

AMA SS Overview 2-10 Ac cessing the Storag e Network 6-00026-01 Rev A NO TES[...]

3 T echnical Suppor t[...]

AMA SS Overview 3-2 T e chnical Support 6-00026-0 1 Rev A NO TES[...]

AMASS Ov erview 6-00026-01 Rev A Tech nical Support 3-3 Phone Suppor t Depending on how you purchased technical support, telephone support is provided either through your reseller or directly through ADIC. The ADIC T echnical Assistance Center (A T A C) in Den v er , Colorado pro vides world-wide service and support. Methods of contacting A T AC ar[...]

AMA SS Overview 3-4 T e chnical Support 6-00026-0 1 Rev A Books The CD contains the AMASS books as PDF f iles. The books described belo w are part of th e technical documentation set: Contact Publ ications T o make corrections or to comment on AMASS publications, please contact T echnical Public ations at techdocs@adic.com. AMASS Overview An intr o[...]

AMASS Ov erview 6-00026-01 Rev A Tech nical Support 3-5 Related Publ ications The publications described in the following table are created and distribut ed on an as- needed basis: Related Publ ications Descripti on Release N otes For each version of AMASS, the Releas e Note s contain: • Summar y o f enhancement s • Descr ibes: - Fi x ed proble[...]

AMA SS Overview 3-6 T e chnical Support 6-00026-0 1 Rev A Secured Web Site T o receiv e access to the secured site on ADIC’ s home page containing technical product in formation (Release Notes, Product Alerts, Product Bulletins, F A Qs), visit http://partne rs.adic.com/ and follo w the passw ord request procedure. In return, AD IC will send instr[...]

6-00026-01 Rev A Glossary GL-1 Glossar y A AMASS ® The Archival Management and Storage System (A MASS) is stor age management software. AMASS archive s files onto media stored in robotic libraries, jukeboxes, and standalone drives. When applications need to read or writ e to archiv ed file s, the files app ear as a single, mounted file system on t[...]

AMA SS Overview GL-2 Glossary 6-00026-0 1 Rev A bar cod e An array of spaces a nd vertical bars in varying widths in a machine-readable pattern. Media is identified by barcode rather than a physical home storage slot. BFS Bitfile Server component of DataMgr. The BFS mainta ins storage policie s, assigns bitfile IDs, and manage s the licensing of cl[...]

AMASS Ov erview 6-00026-01 Rev A Glossary GL-3 D DAS ™ Distributed AML Server. An ADIC software product with both client and server components. The server component is installed on an OS/2 PC and the client component is installed on the same UNIX workstation where AMASS is instal led. With DAS , AMASS supports different media types in the same li[...]

AMA SS Overview GL-4 Glossary 6-00026-0 1 Rev A E Ethe rnet A networking system designed to connect computers that are re leatively close together (physically in the same department). The specification has bee n defined by IEEE Standard 802.3. Other software, such as TCP/IP, runs on top of Ethernet to provide high-level networking services to appli[...]

AMASS Ov erview 6-00026-01 Rev A Glossary GL-5 File Sy stem Dat abase The File System Data base contai ns tables of attributes—or me tadata—representing the directory structure and media mounted under the AMASS file system. The metadata includes: media ID, medi a type, media location, ownership, and timestam p. The File System Data base tells A[...]

AMA SS Overview GL-6 Glossary 6-00026-0 1 Rev A IPI Intelligent Peripheral Interface. A high-performance, gener al-purpose parallel peripheral interface. The intent of the IPI is to isolate the host, both hardware and software, from changes in peripherals by pro viding a “function gene ric” comm and set to al low the connection of multiple type[...]

AMASS Ov erview 6-00026-01 Rev A Glossary GL-7 •O p t i c a l •C D me tadata Represents the directory structure and attributes about media. Attributes include: •M e d i a I D • Media type • Media location • Ownership • T imestamp The metadat a for the AMASS file system resides in the AMASS database. See also File System Da tabase and [...]

AMA SS Overview GL-8 Glossary 6-00026-0 1 Rev A nonresid ent file A nonresident file is a file whose contents have been migrated to a storage device. The file is nonresident on the client’s machi ne but DataMgr leaves behind a stub file. O optical Types of optical pla tters are described below: • MO (Magneto Optical) is rewritable optical. It u[...]

AMASS Ov erview 6-00026-01 Rev A Glossary GL-9 S scattered wr ites If multiple writes occur to a single volume group, AMASS uses more than one drive to simultane ously write to the volume group. This increases throughput. SCSI Fa st/Wide Small Computer System Interface. An intelligent bus-le vel device interface. Refers to a c ombination of Fast tr[...]

AMA SS Overview GL-10 Glossary 6-0002 6-01 Rev A storage policy DataMgr migrate s files using storage policies, including Singl e Copy, Multi-tier Migration, and File Replication. stripi ng The UNIX operating system allows AMASS to cache dat a across multiple magnetic disks on the server or across partitions on a si ngle magnetic disk on the server[...]

AMASS Ov erview 6-00026-01 Rev A Glossary GL-11 V VBS The Virtual Block Server is an AMASS component that emulates a hard disk drive that maps an infinite ly large block of space on to physical libraries, drives, and media. Use the GUI to monitor the Virtual Block Server. volume Equivalent to media. See also media . • of fline = Media that does n[...]

AMA SS Overview GL-12 Glossary 6-0002 6-01 Rev A X XDI eXtensible Device Inte rface. An AMASS software module that provides a communication interface between AMASS and network-attached storage devices. Communication includes: • Operations (mount and dismount, import and exp ort, query volume and query driv es) • Audits • Hardware inform ation[...]

6-0002 6-01 Rev A Inde x INX-i Inde x A Access local . . . . . . . . . . . . . . . . . . . . . . . 2-3 network . . . . . . . . . . . . . . . . . . . . 2-3 Addresses . . . . . . . . . . . . . . . . . . . . . . 2-7 AMASS . . . . . . . . . . . . . . . . . . . . . . GL-1 benefits . . . . . . . . . . . . . . . . . . . . . 1-6 using . . . . . . . . . . .[...]

AMA SS Ove rview INX-i i Index 6-0002 6-01 Rev A definition . . . . . . . . . . . . . . . . . . GL-3 DataMgr . . . . . . . . . . . . . . . . . 1- 26 , GL-3 Dead Space . . . . . . . . . . . . . . . . . . . GL-3 DLT . . . . . . . . . . . . . . . . . . . . . . . . . GL-3 DMFS. . . . . . . . . . . . . . . . . . . . . . . . GL-3 Documentation Set . . . [...]

AMASS Overview 6-0002 6-01 Rev A Inde x INX-ii i M Mailbox . . . . . . . . . . . . . . . . . . . . . . G L-6 Mailslot . . . . . . . . . . . . . . . . . . . . . . GL-9 Media . . . . . . . . . . . . . . 1-3 , GL-6 , GL-11 less contention . . . . . . . . . . . . . . . 1-7 mixed . . . . . . . . . . . . . . . . . . . . . 1-20 optical. . . . . . . . . . [...]

AMA SS Ove rview INX-i v Index 6-0002 6-01 Rev A SSD . . . . . . . . . . . . . . . . . . . . . . . . . GL-9 Standalone Drives . . . . . . . . . . . . . . GL-9 Storage Area Ne twork . . . . . . . . . . . GL-9 Storage Devices supported . . . . . . . . . . . . . . . . . . . 2-6 Storage Policy . . . . . . . . . . . . . . . . GL-10 file replication . . [...]