HP (Hewlett-Packard) HP 9000 V2500 manual

Operator’s Guide HP 9000 V2 500/V26 00 SCA Serv er F irst Edition A5845-960 01 Customer Order Number: A5845-90001 Ju ly 1999 Prin te d in: U SA[...]

Revi si on Hi stor y Edition: Fir s t Document Number: A5845 -96001 Notice  Copyright H ewlett- P ackard Company 1999. All Rig hts Reserve d. Repr oduct i on, a dapta tio n, or tr ansl atio n with out pri or w ritt en permissio n is proh ibited, except as allowed under the co pyright laws. The i nf o rm at i on c o nta i n ed i n th is doc u me [...]

T able of Contents iii Contents Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii Notationa l convention s . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv Safety a nd regulatory info rmation . . . . . . . . . . . . . . . . . [...]

iv T able of Contents DVD-ROM drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Disk loading slot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Busy indicato r . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 5 Eject butt on . . . . [...]

T able of Contents v /spp/bin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 /spp/scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 /spp/data/ complex_name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 /spp/f[...]

vi T able of Contents Node configurat ion map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106 Node control panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 Configuratio n utilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110 autoreset . . . . . . . [...]

T able of Contents vii Logical V o lume Manager (L VM) relat ed problem . . . . . . . . . . . . . . . . 145 Recovery from o ther situat ions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 5 Rebooting the syste m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146 Monitoring t he syst em after a s ystem [...]

viii T able of Contents[...]

List of Figures ix Figures Figure 1 Japanese ra dio frequency notice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii Figure 2 BCIQ (Taiwan) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xviii Figure 3 V-Class Se rver Components : Cabinet a nd Service S upport Pro cessor [...]

x List of Figures Figur e 41 ts_config “Add/Configure Termi nal Mux” sele ction . . . . . . . . . . . . . . . . . . . 84 Figure 42 Terminal mux IP a ddress panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 5 Figure 43 “Start Co nsole Ses sion” select ion . . . . . . . . . . . . . . . . . . . . . . . . . . . . .[...]

List of T ables xi Ta b l e s Table 1 Valid CTI cache sizes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 Table 2 Indicator LED operatio n . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 6 Table 3 Processo r initializ ation steps . . . . . . . . . . . . . . . . . . . .[...]

xii Lis t of T a bles[...]

Preface xi ii Preface The O perator’s Guide HP 9000 V 2500/V2 600 Server documents th e info rmat ion nec ess ary to o pera te an d moni tor HP V -Clas s ser vers . Th is book is inte nded to be a reference f or system ad ministrato rs , system operat ors, and sys tem ma nagers.[...]

xiv Prefac e Pref ace Notational conventions This sectio n describes notational convention s used in this book. bold monospace In command examples , bold monospace identifies input t hat must be typed e xactly a s shown. monospace In paragra ph t ext, monospace identi fies command names , syst em calls , and data structures and types . In command e[...]

Preface xv Pref ace NOTE A note highligh ts im portant s upplement al info rmation. CA UTION Cautions highlight procedures or information necessary to av oid injur y to personnel. The caution should tell the reader exactly what will result fr om what actions and how to av oid them. W ARNING A warning highlights pr ocedures or information necessary [...]

xvi Prefac e Pref ace Safety and regulatory information F or your protection, t his prod uct ha s bee n te st ed to va rious na tio na l and internationa l regulation s and stand ards . The s cope of t his regu latory testing include s elect rical/mechanical safety , radio freq uency interference, ergonomics, acoust ics , and hazardo us mate rials.[...]

Preface xv ii Pref ace J apanese radio fr equenc y interfe rence VC CI F igure 1 Japane se radio freque ncy notice This equipment is a Class A category (Information T echnology Equipment to be used in co mmercial and / or industrial areas) and conforms to the standards set by the V oluntary Control Council for Interference by Information T echnolog[...]

xviii Pref ace Pref ace Figure 2 BC IQ (T aiwan) Acoustics (Germany) Laermanga be (Schalldruckpre gel LpA) gemessen am f iktiver Arbeitsplat z bei normalem Be trieb nach DIN 45635 , T eil 19: LpA =65.3 dB . Acoustic Noise (A-wei ghted Soun d Pre ssure Leve l LpA) mea sured at the bystander position, normal operati on, to ISO 77 79: LpA = 65.3 dB. I[...]

Preface xi x Pref ace Installation co nditions (U.S .) See install ation instruct ions before co nnecting to the supply . V oir la no tice d’ins tallation avant de raccorder au ré seau. CA UTION Please note the following conditions of installation: An insulated ear thing conductor that is identical in s ize, insulation material, and thickness to[...]

xx Prefac e Pref ace Associated documen ts Associated documents include: • HP Diagno stic Guide: V25 00/V2600 Servers , ( A5824-960 02) • HP-UX SCA Programming and Process Ma nagement White P aper – A v ailable in /us r/share/doc f or HP-UX 11 .10 • HP-UX 11.0 Configurable Kernel P arameters – A v ailable o nline at: http://docs.hp.com/hp[...]

Preface xx i Pref ace T echnical as sistance If you have questio ns that a re not answ ered in this book, co ntact the Hewlett- P ac k ard Resp onse Ce nter at the following locatio ns: • Within the continental U .S., call 1 (800) 633- 3600. • All ot hers, contact your local Hewl ett-Packard Response Center or sales o ffi ce for assist ance.[...]

xxii Prefac e Pref ace Reader feedback This document was produced by the System Sup portabilit y Lab Field Engineering Support org anization (SSL/FES). If yo u have editorial suggestions o r recommended improv ement s for this document, please write to us. Please report any technical inaccuracies immediat ely . Y ou can reach us through email at: f[...]

Chapter 1 1 1O v e r v i e w This chapter intro duces Hewle tt-P a c k ard V - Class syst em comp onents and includes a brief overvi ew of V2500 /V2600 serve r hardware resources. Some ba sic de tails abo ut HP- UX use a lso are provi ded. F or deta ils on t he external cabi net control s and disp lays, see Chapter 2. The V2500/V26 00 model of V -C[...]

2 Chapter 1 Overview V -Class System Components V -Clas s Sy stem C omp onent s Each V -Class system includes two main components: a V -Class server and a Service Suppo rt Pro cessor (SS P works tation) dedicated to suppor ting the se rver , as shown belo w in Figure 3 . F igure 3 V -Class Server Compon ents: Cabinet and Servi c e Support Process o[...]

Chapter 1 3 Overview V -Class System Compon ents Figure 4 sho ws a four-cabinet V250 0/V2600 se rver an d the Se rvice Support Processo r that is used for con s ole, diagnostic , and other support work. The V2500/V260 0 cabinets are tightly interconnected by Coherent T oroidal Interconne ct (CTI) cables, as described in “Multiple-Cabine t Server [...]

4 Chapter 1 Overview V -Class System Components monitoring the server hardwa re, as well as diagnostics operations . Y ou also must use the Service Supp ort Processo r when installing or upgr adin g V -Clas s firmw are . The Service Supp ort Processo r runs HP-UX V10. 20. In addition to HP- UX software, the Service Support Processor includes files [...]

Chapter 1 5 Overview V -Class System Compon ents Figure 5 Co n sole and Diagnostic Connections for a F our-Cabinet V2500/V260 0 Server The console p ort on cabinet ID 0 ’ s utilities b oard connects to the Service Support Processo r , and console ports on cabinet IDs 2, 4, and 6 connect to the terminal server (port numbers 2, 3, and 4, respective[...]

6 Chapter 1 Overview V -Class Ser ver Architecture V -Class Server Architecture The V2500/V2600 server has a powerful s et of interconnecting hardw are component s that allo w the serve r’s processors, memory , and I/O components to operate with minimal interruptions or contentions f o r resources . The processor agents s erve as a bus connection[...]

Chapter 1 7 Overview V -Class Server Architecture F igure 6 Functional Diagram of a S ingle-Cabinet V250 0/V 2600 Server I/O I/O I/O I/O Memo ry CTI PCI Controller Memory Controller Memo ry CTI Process or Agent Memory Controller CPU CPU CPU CPU I/O I/O I/O I/O Memo ry CTI PCI Controller Proc essor Agent Memory Controller CPU CPU CPU CPU Memo ry CTI[...]

8 Chapter 1 Overview V -Class Ser ver Architecture F igure 7 V2500/V2600 Hype r Plane Crossbar Connecti ons Each ERAC has 16 ports , 4 send and 4 receive on each side, whic h may oper ate si mult aneou sly . V2500/V2600 Cabinet Components The key co mponents within a V250 0/V2600 se rver cabinet i nclude: • “Core Utilities Board” on pag e 9 ?[...]

Chapter 1 9 Overview V -Class Server Architecture Core Utilities Board The utiliti es board pro vides boot , diagnost ics , and conso le connections from th e V -Class cabi net t o the Se rvice Su pport Process or , as well as syste m clock, sy stem LCD, and other fu nction ality . It al so sto res t he boot firmware and boot-tim e variabl e sett i[...]

10 Chapter 1 Overview V -Class Ser ver Architecture Three DIMM sizes are supporte d for use in V25 00/V2600 servers: 32 MByte, 12 8 MByte, and 256 MByte. On ly specif ied mixed D IMM size configurations are suppor ted. If planning for a multiple-cabinet server configuration, you must use 88- bit DIMMs a nd configure your V2500/V260 0 server to be o[...]

Chapter 1 11 Overview V -Class Server Architecture Memory Inter leaving Through the memory access controllers , each memory board provide s separate read and write access to the memory DIMMs. Up to 16 DIMMs may be installe d per board, providing up to 256-way memory interleaving per cabinet when all memory bo ards are fu lly popula ted. Slots f or [...]

12 Chapter 1 Overview V -Class Ser ver Architecture With small CTI cache size s , additional alia sing bet ween memory locations may occur , reducing the cache hit rate and increasing the latency fo r remote acces ses . The bold entries in T able 1 show the minimal CTI cache s izes neede d to avoid e xcessive al iasing. T able 1 V alid CTI cache si[...]

Chapter 1 13 Overview V -Class Server Architecture Each V2500/V2600 I/O port is capable of direct memory access (DMA), whic h eliminates processo r involveme nt during data transfers a nd stream lines data t ransfer f or large disk block s and high-s peed net work connections . The PCI bus controllers are numbered based on the V2500/V26 00 cabinet [...]

14 Chapter 1 Overview V -Class Ser ver Architecture F or multiple-cabinet servers , the PCI bus numbering is as shown in Figure 10. The PCI bus number also s e rves as the first field of the associated devices’ hardw a re path, so I/O devices on cabinet ID 0 are numbered with the first field of the hardware path of 0 to 7. F or cabinet ID 2 , the[...]

Chapter 1 15 Overview V -Class Server Architecture F or an example of li sting I/O devices on vari ous cabi n ets and deta ils of listing other V -Class server hardw a re configuration details , see “Listing the Server Hardware Configurati on” on page 118. Multiple-Cabinet Server Connections All cabinets in a multiple- cabinet V25 00/V2600 s er[...]

16 Chapter 1 Overview V -Class Ser ver Architecture Each CTI controller connects to a corresponding CTI controller on a remote cabine t by cables that prov ide both s end (local-t o-remote) and receive (r emote-to-l ocal) connectio ns among t he cabinets. F igure 11 F our -Cabinet V2500 /V2600 Server CTI Cabl e Connections Two dimensio ns of CT I c[...]

Chapter 1 17 Overview V -Class Server Architecture F or X-dimension connect i ons , CTI cables connect to the oppos i te controller on the remot e cabine t. This means—for X-dimens ion CTI connections—mem ory boards co nnect in the foll owing pairs: 0 and 2, 1 and 3, 4 and 6, and 5 and 7. F or details on CTI cable connections refer to q ualifie[...]

18 Chapter 1 Overview V2500/V2600 Cabinet Config urations V2500/V2 600 Cabine t Configurat ions This sectio n shows tw o sample V2 500/V2600 s erver configurat ions: a single- cabinet sy stem and a three- cabinet sy stem, f illed to o ne-half processor ca paci ty an d to one-ha lf a nd full memor y capacit y , respective ly . Each V2500/V2600 ca bi[...]

Chapter 1 19 Overview V2500/V2600 Cabinet Config urations F igure 12 Sample V2500/V2600 Cabi n et Configurat ions A single -cabinet V2 500/V260 0 server with 16 pro- cessor s and 1 6 Gbytes memory , using 256 MByte A three -cabinet V250 0/V2600 serve r with 48 pro- cessor s and 9 6 Gbytes memory , using 256 MByte[...]

20 Chapter 1 Overview V2500/V2600 Cabinet Config urations[...]

Chapter 2 21 2 Indicators, switches, and displays This sectio n describes indicators, switches, and displays of the HP 9000 V2500 se rver.[...]

22 Chapter 2 Indicators, s witches, and displays Operator panel Operator panel The op erator pane l is lo cated on the top le ft side of t he server and contains the ke y swit ch panel, DVD-ROM dr ive, optional D AT tape drive , and the LCD disp lay . Figure 13 sh ows the lo cation of the opera tor panel and its components . F igure 13 Operator pan[...]

Chapter 2 23 Indicators, s w itches, and displa ys Operator pa nel Key switch panel The k ey swit ch p anel is lo cated on the left of th e operat or panel, a s shown in Figu re 13 on p age 22. Th e key switch pane l contains a two position k ey switch, a DC O N LED, and a TOC (Tra nsfer Of C ontrol) button, as shown in Figure 1 4. F igure 14 Key s[...]

24 Chapter 2 Indicators, s witches, and displays Operator panel TOC The TOC (Transfer Of Control) button is a recessed switch that resets the syst em. DVD-ROM drive The D VD-ROM drive is l ocated on th e left of the opera tor panel , as shown in F igure 13 on page 22. Figure 15 show s the DVD-ROM dri ve front panel in detail . F igure 15 DVD-ROM dr[...]

Chapter 2 25 Indicators, s w itches, and displa ys Operator pa nel Busy indicator The busy ind icator LED flas hes to i ndicate that a read ope ration is occurring . CA UTION Do not push the eject button while this LED is flashing . If you do, th e operat ion in prog ress is aborted, a nd the DVD-R OM is e jected, p ossibl y causing a lo ss of d at[...]

26 Chapter 2 Indicators, s witches, and displays Operator panel T able 2 Indicator LED operation Eject button Push the eje ct button to remove ca rtridges from the ta pe drive. The drive performs t he follo wing Un load seque nce: 1. The tape is rewound to Beginning of P artition (BOP) for P artition 0. 2. If the tape is wr ite-enab led, the copy o[...]

Chapter 2 27 Indicators, s w itches, and displa ys System Displays System Displays The V - Class serve rs prov ide two me ans of dis playing status and e rror repo r ting: an L CD and an Atten tion ligh t bar . F igure 17 System displays 9/18/97 IOLM010 TOC DC ON DC OFF CONSOLE ENABLE CONSLOLE SECURE LCD display Attention light bar[...]

28 Chapter 2 Indicators, s witches, and displays System Displa ys LCD (Liq uid Crysta l Displa y) The LCD display is located on the right of the op erator p anel, as s hown in Figure 17 o n page 27. T he LCD i s a 20-character b y 4-line liqui d crystal d isplay . Figure 18 s hows the di splay and i ndicates what each line on the di sp lay m ea ns.[...]

Chapter 2 29 Indicators, s w itches, and displa ys System Displays T able 3 Processo r initia lizatio n steps T able 4 Processor run-time status codes Step De script ion 0 Processo r internal diag nostic regis ter initia lization 1 Processo r early dat a cache initi alization. 2 Process or stack SRAM test .(opti onal) 3 Processo r stack SRAM initia[...]

30 Chapter 2 Indicators, s witches, and displays System Displa ys Message display line The messag e dis play line sho ws the POST i nitializat ion prog ress. This is updated by the monarch proces sor . The system cons ol e also shows detail for some of t hese steps . Table 5 shows the co de definit ions . T able 5 Message di splay line d DECONFIG: [...]

Chapter 2 31 Indicators, s w itches, and displa ys System Displays Attention light bar The Atte ntion light b ar is l ocate d at the t op le ft corner on the fro nt of t he V2500/V2600 server as shown in Figure 17 on pa ge 27. Th e light ba r display s syst em sta tus in thre e ways: • OFF—dc power is turned off . Eit her the key switch or the [...]

32 Chapter 2 Indicators, s witches, and displays System Displa ys Environmental er rors Environmental e rrors are det ected by tw o basic sy stems in t he V2500/ V2600 se rver: Power -On a nd Environmental Monitor Uti lity C hip (MUC). P ow er -O n detected errors such as ASIC install o r ASIC not OK are detected i mmediately and will not allow dc [...]

Chapter 2 33 Indicators, s w itches, and displa ys System Displays Identifying a node with the blink command The blink command is used t o physically identify a node. This comma nd forces the node attention light bar to blink or turns off bli nking, provided an error does not exist on the node . Step 1. Bring up the sppdsh prompt at a sppuse r wi n[...]

34 Chapter 2 Indicators, s witches, and displays System Displa ys[...]

Chapter 3 35 3 SSP operation This chapter des cribes the op eration the SSP in conjunction w ith a V -Clas s server and includes: •S S P l o g - o n • Using the CD E (Common Desktop Environmen t) W orkspace menu •U s i n g t h e c o n s o l e •S S P f i l e s y s t e m • System log pathnames[...]

36 Chapter 3 SSP operation SSP and the V -C lass system SSP and the V -Class sy ste m The Service Support P rocesso r (SSP) is either a Hewlet t-P ackard B1 80L or 712 wo rkstation tha t performs the following functions for the V -Clas s syste m: • Running d iagnostics • Updating of CUB (Core Utility Board) firmw are • Logg ing environ mental[...]

Chapter 3 37 SSP operation SSP log- on SSP log- on Two UNIX user account s are created on the SS P during the HP-UX 10.2 0 operat ing syst em inst allati on proc ess. sppuser This u ser i s the norm al log- on for the S SP du ring system op eration, verificati on, and troubleshoo t ing . Default pa ssword: spp user Please no te the space be tween s[...]

38 Chapter 3 SSP operation SSP lo g-on F igure 19 SSP user windows for V2500/V26 00 servers with one node[...]

Chapter 3 39 SSP operation SSP log- on F igure 20 SSP user windows for V2500/V260 0 servers with more than two nodes[...]

40 Chapter 3 SSP operation SSP lo g-on Message window The messa ge window displa ys status from the ccmd daemon running on the SSP approximately 60 seconds after power on. The hard e rror logger also disp lays sta tus in this w indow . This is a displ ay window on ly and does not accep t input. Console window (sppconsole - complex conso le) The com[...]

Chapter 3 41 SSP operation Using the CDE ( Common Desk top En vironment) W orkspace menu Using the CDE ( Common Desktop Environment) W orkspace me nu The SSP uses the CDE W orkspace Manager to control the windows on the screen. Th e W orkspace menu is W ork space Manager main menu. The W orkspace me nu selects create new wind ows, initiate diag nos[...]

42 Chapter 3 SSP operation Using the CDE (Common Desktop En vironment) W orkspace menu F igure 21 SSP W orkspace submenus for V2500/V260 0 F igure 22 SSP W orkspace submenus for V2500/V260 0[...]

Chapter 3 43 SSP operation Using the CDE ( Common Desk top En vironment) W orkspace menu V2500/V2600 W orkspace menu op tions include: • V -Class Comp lex: name —Opens this submenu for the node/complex. If more t han one node/complex has been configured, multiple V -Class Complexes a re available by name. • Console —Creates a new console w [...]

44 Chapter 3 SSP operation Using the CDE (Common Desktop En vironment) W orkspace menu • Restart W orkspace Manager —Stops and resta r ts the W orkspace Manag er . • logout —Closes all op e n wi ndow s and stop s W orksp ace Manage r .[...]

Chapter 3 45 SSP operation Using the console Using th e cons ole The console serve s as the communication device for the V -Class serve r. Virtual consoles are also used to monitor sp ecific ope rations, like a syste m sof twar e cr ash du mp. Creating new c o nsole windows Console wi nd ows can also be created us ing the sppconsole and xterm comma[...]

46 Chapter 3 SSP operation Using the cons ole Starting the console from the W orkspace menu T o start the console using t he W orkspace menu, complete the following steps : Step 1. Move the p ointer over the CDE wo rkspace backd rop. Step 2. Press an d hold dow n any mouse button. The W orkspace (root) menu appears . Step 3. Drag the mouse pointer [...]

Chapter 3 47 SSP operation Using the console For examp le: COMPLEX_NAME = [Select from colossus, guardian] colossus Step 3. Start the cons ol e. Enter: sppconsole NOTE Running sppconsole witho u t a ny additio na l paramete rs defaults to Node 0 in the current complex. sppconsole 2 wou ld st art a cons ole on Node 2. The new sppco nsole window a pp[...]

48 Chapter 3 SSP operation Using the cons ole Step 5. Enter the root password. Refer to “Starting ts_config” on p age 92 for info rmation on start ing ts_config from a lo cal or remot e shell. Step 6. Select the d esired nod e(s) fro m the list in the displa y panel. F or example, clicking on nod e 0 in the list highlights that line in t he win[...]

Chapter 3 49 SSP operation Using the console Starting the console by logging back on This meth od o f starting the consol e works from the SSP or after log gi ng on from anot her system. T o start the conso le by logging o ut of t he SSP a nd logg ing back o n again, comp lete the fol lowin g ste ps: Step 1. Move the po inter over the CDE wo rkspac[...]

50 Chapter 3 SSP operation Using the cons ole Example: P erforming a ^E command T o execute the ^Ecf command complete the following steps : 1. Pres s the Cntrl key and the e key simultaneously . 2. Release the Cntrl ke y and the e key . 3. Pres s the c key . 4. Pres s the f key . W atching the console Any user can dis play the conso le via a re mot[...]

Chapter 3 51 SSP operation Using the console CTRL- Ec. The perio d is part of the command. Assuming con trol of the con sole System maint enance or d iagnostics can be perfo rmed remote ly by assuming control of the conso l e from a remote terminal. Upon gaining control of the console , the user has write access to that window . Only one w indow ca[...]

52 Chapter 3 SSP operation Using the cons ole Changing a console conn ection Once the console is started as a w at ch or a control connection, the connection type can be changed with escape characters . T o change a watch wi ndow to an a ctive conso le window , enter: CTRL- Ecf T o change an a c tive cons ole window to w atch wi ndow , enter: CTRL-[...]

Chapter 3 53 SSP operation Using the console prom pting the user if on ly one comp lex is conf igured). T his utili ty accesses the des i red node based on no de ID . However , the single node must still be configure d by ts_config and assign ed a comple x name before it can be acce ssed. T argeting commands to nodes Use the jf-ccmd_info command to[...]

54 Chapter 3 SSP operation SSP file system SSP file system The /spp and /users/sppus er directories contain most of the SSP specific files. Other files in vario us direct ories are al so modified . This se ction restricts , however , its discussion to the /spp directory . Figure 23 shows the SSP file system structure for V2500/V2600 servers . F igu[...]

Chapter 3 55 SSP operation SSP file sys tem conserver The console- serv er t hat directs RS-232 console traff ic from th e Utilit y Board to the various sppcons ole sessio ns. /spp /bin In the /spp/bin directory are specific commands and daemons that manage a V -Class node. Some of these are: est The command (Exemplar Scan T est) to initiate scan t[...]

56 Chapter 3 SSP operation SSP file system consolelog X A file contai ning all t he console activit y on the syste m, where X is t he node ID . est.log The scan tes ting log. hard_hist Log o f all hard failure inf ormation. Logs the out put of all suspect ed ASIC (Ap plication Sp ecific Integra ted Circuits). Th is file may be us eful in trou blesh[...]

Chapter 3 57 SSP operation SSP file sys tem Device files T able 8 shows the differ ences in the device file s betwe en the H P B180L and HP 712 S SPs. T able 8 Device fil e differences Device 712 B180L Location on workstation Device file Location on workstation De vice file Privat e/diag nostic LAN RS-232 /dev/lan1 LAN-AUI /dev/l an0 Global/custome[...]

58 Chapter 3 SSP operation System log path names System log pathna me s T o separate th e configuration and log files for ea ch complex, several files have bee n move d t o complex-spe cific directories . In T able 9, complex denotes specific comple x names . Thes e are assigned by the operator using ts_config . The /spp/da ta/complex directories a[...]

Chapter 4 59 4 F irmware (OBP and PDC) This chapter discus ses the bo ot seq uence and the co mmands available from the boot menu.[...]

60 Chapter 4 Firmware (OBP and PDC) Boot sequen ce Boot s eque nce OpenBoot PROM (OBP ) and SPP Processo r Dependent Code (SPP_PDC) make u p the fi rmwa re on HP V -Clas s servers tha t makes it pos sible to boot HP -UX. Once a machine powe rs on, the firmw are controls the system until the operating system ( OS) execu tes . If the sy stem encounte[...]

Chapter 4 61 Firmware (OBP and PDC) Boot seque nce F igure 24 Boot process NO NO YES YES Boot menu Prompt displays: To discontinue, press any key within 10 seconds. Continue Automatically? Press any key HP-UX boots Processor is starting the autoboot process. displ ays Autoboot Enabled? to display boot menu[...]

62 Chapter 4 Firmware (OBP and PDC) Boot pr ocess output Boot proces s outpu t The following outp ut illustrate s what typically displays on the co nsole as the syst em starts up: POST Hard Boot on [0:PB4L_A] HP9000/V2500 POST Revision 1.0.0.2, co mpiled 1999/04/12 11:51:10 Probing CPUs: PB4L_A Completing core logic SRAM initializat ion. Starting m[...]

Chapter 4 63 Firmware (OBP and PDC) Boot pr ocess output -------------------------------------- ----------------------------------------- PDC Firmware Ve rsion Information PDC_ENTRY version 4.2.0.4 POST Revi sion: 1.0.0.2 OBP Release 4.2.0, compile d 99/01/06 14:00:18 (3) SPP_PDC 2.0.0 (0 3/08/99 11:47:51) -------------------------------------- ---[...]

64 Chapter 4 Firmware (OBP and PDC) HP mode boot m enu HP mode boo t menu In some instances , the boot menu displays; otherwise the ope ra ting system b oots and t he syst em i s ready for use. The boot menu disp lays when one of t he following occurs: • The system encounte rs a proble m while booting • Autoboot is disabled • The o perat or i[...]

Chapter 4 65 Firmware (OBP and PDC) HP mode boot menu T able 10 lists the comma nds availab le from t he Command: prompt . T able 10 Boot menu commands Command Descrip tion AUto [BOot|SEArch|Force ON|OFF ] Displa ys or sets t he Autoboot or Se arch flag. If Autoboot is on, t he syst em boot s autom atically after res et. If AutoSearch is on, the sy[...]

66 Chapter 4 Firmware (OBP and PDC) HP mode boot m enu PAth [PRI|ALT|CON] [ path ] Displays or sets pr imary , alternate, cons ole, and keyboard hardware paths . Keyboard pat h cannot be modified. PDT [CLEAR|DEBUG] Displays or clears Page Deallocat ion T abl e (PDT ) information. F or use by service p ersonnel only . PIM_info [cpu#] [HPMC|TOC|LPMC][...]

Chapter 4 67 Firmware (OBP and PDC) Enabling Aut oboot Enabling Au tobo ot AUto displ ays or set s the Autoboot or Se arch flag, which s ets th e way a system w ill behave aft er powering on. If Autoboo t is ON , the system boots automaticall y after res et. If AutoS earch is ON and Auto boot is OFF , the syst em searche s for and disp lays all I/O[...]

68 Chapter 4 Firmware (OBP and PDC) Enabling A utoboot Examples au This command dis plays the st atus of the Auto boot and Autosearch flags. Autoboot:ON Autosearch:ON au bo This command displays the curre nt setting of the Autoboot flag. Autoboot:ON au bo on This command sets the Autoboot flag ON . Autoboot:ON[...]

Chapter 4 69 Firmware (OBP and PDC) HElp command HElp command The help command displays help information for the specified command or redisplays t he boot menu. Syntax HElp [ command ] Used alon e, HElp displa ys the boot menu. Specifying command displays the syntax and description of t he named command. Examples The foll owin g example il lustrat [...]

70 Chapter 4 Firmware (OBP and PDC) HElp command[...]

Chapter 5 71 5 Configuration utili ties This chapter describes s erver configuration management an d includes: • ts_config • ccmd • xconfig • Confi guration utilities Two uti lities, sppdsh and xconfig , allo w readin g or writ ing configuratio n information. O BP can also be used to mo dify the configuration. The SSP a llows t he user to c[...]

72 Chapter 5 Configuration utilities ts_config ts_conf ig ts_config [-display display name] Any V2500/V2 600 nodes a dded to t he SSP must be configured by ts_config to enable diagnost ic and scan capa bilities, environment al and hard-error monitoring , and console access . Once the co nfiguration for each node is s et, it is retained wh en new SS[...]

Chapter 5 73 Configuration utilities ts_config For examp le: $ DISPLAY=myws:0; export DISPLAY (sh/ksh/sppdsh) % setenv DISPLAY myws:0 (csh/tcsh) Also, the -display star t -up option may be used as s hown below: For examp le: # /spp/bin/ts_config -display myws:0 NOTE F or she lls that are run from the SSP desk top, the DI SPLA Y variabl e is set (a [...]

74 Chapter 5 Configuration utilities ts_config ts_config automaticall y updates the dis play when it detects either a change in the configuration st atus of any node or a new ly detected node. The node dis play is not update d while an A ction is being proce ssed or while the use r is ente ring informatio n into an Actio n dialog. The upper right c[...]

Chapter 5 75 Configuration utilities ts_config Configuration procedur es The foll owin g procedures provi de add itional det ails about each configuration action and a re inte nded as a ref erence. ts_config automati cally guide s the user through the ap propriate procedu re when a node is se lected. Upgrade JT AG firmware NOTE If the node shows ?[...]

76 Chapter 5 Configuration utilities ts_config Fi g u r e 2 6 ts_config showing node 0 hig h lighted Notic e that af ter the node has been hig hlighte d that ts_config displ ays information concerning t he node. In t his st ep , it te lls the user what action to take next, “This node’ s JTAG firmw are must be upgraded. Select “ Actions,” ?[...]

Chapter 5 77 Configuration utilities ts_config Figure 28 Upgrad e JT AG firmware confirmation panel Step 4. After the firmware is loaded a pane l appears as the one shown in Figure 29. Click “OK” and then pow er -cycle the node to activate the new firmware . Fi g u r e 2 9 ts_config power-cycle panel When the node is po wered up, the “Conf ig[...]

78 Chapter 5 Configuration utilities ts_config Fi g u r e 3 0 ts_config indicating Node 0 as not configured Step 2. Select “ Actions” and then click “Con figure Nod e,” as shown in Fig ure 31. Fi g u r e 3 1 ts_config “Configure Node” selection. After invoking ts_config to configure the node , a node configuration pane l appears as the [...]

Chapter 5 79 Configuration utilities ts_config Fi g u r e 3 2 ts_config node configuration panel Step 3. Enter a name for the V2500 /V2600 Syste m. The SSP uses this name a s the “Comple x Name” and to generate the IP host names of the Diag nostic and OBP LAN i nterfa ces. Select a s hort na me that SSP us ers ca n easil y relat e to the as soc[...]

80 Chapter 5 Configuration utilities ts_config Fi g u r e 3 3 ts_config restart workspace manager panel . Step 6. Read the panel and click “OK.” When the configuration proce ss is comp lete , the “Co nfiguratio n Status” of the node c hanges to “ Active ,” as shown in Figur e 34. Fi g u r e 3 4 ts_config indicating Node 0 is configured [...]

Chapter 5 81 Configuration utilities ts_config Configure the scub_ip address Step 1. Select t he desi red node fr om the li st of ava ilable nod es. Step 2. In the ts_config displa y panel, se lect “ Actions” and the n “Configure ‘scub_ip’ addre ss,” as shown in Figure 3 5. Fi g u r e 3 5 ts_config “Configure ‘scub_ip ’ address”[...]

82 Chapter 5 Configuration utilities ts_config Fi g u r e 3 7 ts_config scub_ip addre ss configuration confirmation Step 4. A panel as the s hown in Figure 38 appears confirming that the scub_i p addres s is se t. Click OK. Fi g u r e 3 8 ts_config scub_ip address s et confir mation panel Initiate a node reset to activate the new scub_ip address . [...]

Chapter 5 83 Configuration utilities ts_config Fi g u r e 3 9 ts_config “Reset Node” selection A panel as t he one sho wn in Figure 40 ap pears. Fi g u r e 4 0 ts_config node r eset panel Step 3. In the Node Res et panel, select the desired “Reset Level” and “Boot Options,” then click Reset.”[...]

84 Chapter 5 Configuration utilities ts_config Deconf igure a Node Deconfig uring a node removes the selected node from the SSP configuration. The SSP will no longer monitor the environmental and hard-error status of this node . Console access to the node is also be disabled. Step 1. Select t he desi red node fr om the li st of ava ilable nod es. S[...]

Chapter 5 85 Configuration utilities ts_config F igure 42 T erminal mux IP address panel Remove terminal mux ts_config does not remove t he te rminal mux i f any nod e consol es are assigned to terminal mux ports. Step 1. Select “ Actions,” then “Configure T e rminal Mux.” Step 2. Select “ Remove T erminal M ux,” t hen click “Y es.”[...]

86 Chapter 5 Configuration utilities ts_config Fi g u r e 4 3 “Start Console Session” select ion F igure 44 Started conso l e sessions[...]

Chapter 5 87 Configuration utilities ts_config V2500/V2600 SCA (multinode) configuration ts_config can also co nfigure a V2500 /V2600 SCA sys tem. An examp le to foll ow describes how . The example assumes that there a re two a ctive singl e-no de complexes . After the system has re booted to OBP , node 0 becomes the console for th e SCA complex. T[...]

88 Chapter 5 Configuration utilities ts_config Fi g u r e 4 6 ts_config Confi gure Multinode compl ex select ion Step 3. When “Conf igure Mult inode comp lex” is se lected, a co nfiguration dial og appe ars as show n in Fig ure 57. F igure 47 Configure Multinode Complex dialog window[...]

Chapter 5 89 Configuration utilities ts_config Step 4. Enter the require d fields int o the Conf igure Mult inode Complex dialog window . • V -Class Complex Name—Curren t comp lex name of either node or a new complex name . • Complex Seria l Number—Unique serial number of the complex. This is not required if the nodes have the same se ri al[...]

90 Chapter 5 Configuration utilities ts_config F igure 48 Configure Multinode Complex dialog window with a ppropriate values Step 10. Click the “C onfigure” b utton to s tart the configurat ion. A message box appears indicating that the configuration has started. F igure 49 Configuration started information box The foll owin g activiti es occur[...]

Chapter 5 91 Configuration utilities ts_config This informati on includes: •N o d e I D • Complex serial number (if it has been modified) • Reque sted or aut o-ge nerated softw are iden tifier • Confi gura tion Manager Daemon, ccmd , is notifie d of the new configuration. • The shared- memory dat abase o f node informa tion is update d. ?[...]

92 Chapter 5 Configuration utilities ts_config Fi g u r e 5 0 ts_config showing newly configured complexes When remotely running ts_config , the Re start W orkspa ce Mana ger step cannot be performed, because it is the SSP W ork space Manager that needs to be restarted. The W orkspace Manager can be restarted at any tim e by c lic kin g on th e des[...]

Chapter 5 93 Configuration utilities ts_config Fi g u r e 5 1 ts_config Split Multinode compl ex operation Fi g u r e 5 2 ts_config Spli t Mu lt in od e co mp lex pane l Step 3. Enter the complex names for each node. New comp lex serial numbers may be assigned. Each node becom es node 0 in a new complex. Figure 53 shows t he Split M ultinode pane l[...]

94 Chapter 5 Configuration utilities ts_config Fi g u r e 5 3 ts_config Split Multinode complex pa nel fill ed in The messag e shown in Fig ure 54 appe ars indicat ing the conf iguration is taking p lace. Figure 54 S plit Multinode confirmation panel Figure 55 sho ws the main ts_config display af ter the spl i t multinode operat ion has complete d.[...]

Chapter 5 95 Configuration utilities ts_config ts_config f iles ts_config either read s or mainta ins t he foll owing SSP c onfig uration files: /etc/hosts Th e stan dard system host s file, includ es ent ries for the cabinet rel ated IP addresse s. /etc/services Service defi nition s for the co nsole interf ace. /etc/ inetd.conf Contains e ntries [...]

96 Chapter 5 Configuration utilities ts_config NODE Complex Node ID JTAG-hostname OBP -hostname SSP-hostname Console-port The variab les of the entry are de fined as follows: NODE —Keyword desi gna t ing a cabi net (node) e ntry . Complex —Name to which the node (cabi net) is ass ociated. In a multi-cabinet complex all the cabinets comprise a s[...]

Chapter 5 97 Configuration utilities SSP-to-system communicat ions SSP-to-syste m commu nications Figure 56 depicts the V -Class server to SSP communications using HP-UX. Figure 56 S SP-to-system communications A layer of firmware betwe en HP-UX and OBP (Ope n Boot PRO M) called spp_pdc allows the HP-UX kernel to communicate with OBP . spp_pdc is p[...]

98 Chapter 5 Configuration utilities SSP-to-system com munications LAN comm un icati ons There are t wo ethernet ports locate d on the SCUB as shown in th e diagram in the up per-le ft side of the node (dotted l ine) in F i gure 56 on page 97. These co mprise the “ priva te ” or d ia gnost i c LAN . The JT AG port is used for s canning, and the[...]

Chapter 5 99 Configuration utilities SSP-to-system communicat ions Serial communica tions The DU ART port on t he SCUB provide s an RS232 serial link to the SS P . Through t his p ort H P-UX, OBP , POST (P ower -On Se lf T est) and the T est Controll er send consol e messages . The SSP proces ses these messag es using the sppconsole an d ttylink ut[...]

100 Chapter 5 Configuration utilities ccmd ccmd ccmd (Complex Configuration Management Daemon) is a daemon t hat maintains a database of information about the V250 0/V2 600 hardware . ccmd also moni tors the s ystem and reports any signific ant changes in system st atus . It supports multiple node s , mu ltiple complexes and n odes that have the sa[...]

Chapter 5 101 Configuration utilities ccm d If starte d with no option s , ccmd dis assoc iates itself fr om the te rminal or wind ow wh ere it was sta rted. It in stea d rep ort s to th e con sole wind ow and the file /s pp/data/ ccmd_log. If ccmd is sent a SIGHUP , i t regene rates the da tabas e. All scan-ba sed operat ions require ccmd . If POS[...]

102 Chapter 5 Configuration utilities xconfig xconfig xconfig is the gr aphical tool that can also modify th e paramet ers initialized by POST to reconfigure a node. The graphical interface allow s the user to s ee the configuration s tate. Also the names are consistent with the hardw are names, since individual configuration parameters are hidden [...]

Chapter 5 103 Configuration utilities xconfig Fi g u r e 5 7 xconfig window—physica l location names[...]

104 Chapter 5 Configuration utilities xconfig Fi g u r e 5 8 xconfig window—logical names As buttons are clicked, the item sele cted changes st ate and color . There is a legend on the screen to explain t he color and s tatus. The change is recorded in t he SSP’ s i mage of the node . When t he user is sa tisfied with the new co nfiguratio n, i[...]

Chapter 5 105 Configuration utilities xconfig The ma in xconfig window has three sections: • Menu bar—Provid es additional ca pability and functio ns. • Node co nfiguratio n map—Prov ides the status of the no de. • Node cont rol panel—P rovides t he capabil ity to se lect a node and control the way data f lows to it. Menu bar The menu b[...]

106 Chapter 5 Configuration utilities xconfig Node configurati on map The node config uration map i s a represen tation of the left and right side views o f a node as shown in Fig ure 60. Fi g u r e 6 0 xconfig window node configuration map[...]

Chapter 5 107 Configuration utilities xconfig The button bo xes are posit ioned to represe nt the actual boa rds as view ed from the le ft and right sides . Each of the co nfigurable components of t h e node is in t he disp lay . T he butto ns are used as foll ows: • Green bu tt on—Indicates tha t the componen t is present and enab led. • Red[...]

108 Chapter 5 Configuration utilities xconfig Fi g u r e 6 1 xconfig window node control panel The node number is shown in the node box. A new number can be selected by clicking on the nod e box and selecti ng the node f rom the pull- down menu. A new complex can be selected by click ing on the complex box and select ing it from the pu ll-down. A n[...]

Chapter 5 109 Configuration utilities xconfig When a new node is selected and available, its data is automa tically read and the node config uration map updated. The data image is kept on the SSP until i t is rebuilt on the node using the Rep lace butto n. This is similar to the replace comma nd on sppdsh . Even thoug h data can b e rebuilt on a no[...]

110 Chapter 5 Configuration utilities Configuration utilities Configura ti on utilitie s V2500/V2600 diagnos tics pr ovides utilities that ass ist the user with configuration management. autoreset autoreset allows the u ser to s pecify wheth er ccmd shoul d automatically reset a complex after a hard error and after the hard logger error analysis so[...]

Chapter 5 111 Configuration utilities Configuration ut ilities NOTE If there is a node_#. pwr file that is old er than the node_#.cfg file, existing node configuration files do no t need to be updated. repor t_c fg This utility generates a report summarizing the configuration of all nodes/complexe s specified on the comman d line . The format of re[...]

112 Chapter 5 Configuration utilities Configuration utilities Effects of hardware and software deconf iguration report_cfg counts all processors, ST ACs, SMACs , SAGAs and ERACs if POST ha s not marke d them as e mpty . This result s in ASICs and processors be ing included in the summary count even though they ma y have failed or have been deconfig[...]

Chapter 5 113 Configuration utilities Configuration ut ilities report_cfg ASIC report T o obtain a report on t he ASICs in a complex , use the -A option. The following is a sample ASIC report by report_cfg : report_cfg -A Complex |Node#| MIB COP | SCUB COP ====================+=====+=========== ============+======================= hw2a 0 A5074-6000[...]

114 Chapter 5 Configuration utilities Configuration utilities report_cfg memory report T o obtain a report on t he memory in a comple x, use the -m option. The following is a sample memory rep ort by report_cfg : report_cfg -m Complex |Node#| MIB COP | SCUB COP ====================+=====+=========== ============+======================= hw2a 0 A5074[...]

Chapter 5 115 Configuration utilities Configuration ut ilities report_cfg processor r eport T o obtain a report on the process or in a complex, use the -p option. The following is a sample processo r report by report_cfg : report_cfg -p Complex |Node#| MIB COP | SCUB COP ====================+=====+=========== ============+======================= hw[...]

116 Chapter 5 Configuration utilities Configuration utilities If the command line [-on | -off | -check] options are us ed, xsecure does not use th e GUI i nterface. These o ptions allow the us er to turn the se cure mode on, off or allow the user to check the secu re mode status . A simple butt on with a red or green secure mode ind icator prov ide[...]

Chapter 6 117 6 HP-UX Operating Sy stem Differen t versions of the HP-UX operatin g sys tem run on a V -Class server and its Service Support P rocessor . This section covers iss ues related to using HP-UX V11.0 an d HP-UX V11 .10 on V -Class se rvers. Multiple-cabine t server confi gurations and HP-UX SCA features require that HP-UX V1 1.10 be inst[...]

118 Chapter 6 HP-UX Operating System HP-UX on the V2500/V 2600 HP-UX on the V2500/V2600 In general HP-UX administration tasks are perf ormed on V -Cla ss servers as they are o n other HP s ervers. One differe nce is that V -Clas s servers run the HP-UX kerne l only in 64- bit mode. This facil itates addressi ng the larger memo ry capacit y availabl[...]

Chapter 6 119 HP-UX Operating System HP-UX on the V25 00/V2600 On multipl e-cabinet V25 00/V2600 servers, the first co mponent of the hardware path indicates whic h cabinet a hardware component res id es upon. Hardware on cabinet ID 0 is lis ted wi th a first hard ware path field starting a t 0, hardware on cab inet ID 2 i s listed s tarting at 64,[...]

120 Chapter 6 HP-UX Operating System HP-UX on the V2500/V 2600 Configuring HP-UX for V -Class Servers HP-UX V1 1.0 provides several t uned paramet er sets that are useful o n HP V -C lass serve rs. Configuring HP-UX w ith these para meter se ts can improve yo ur V -Class server ’s performa nce when using i t for diffe rent purposes, such as scien[...]

Chapter 6 121 HP-UX Operating System HP-UX on the V25 00/V2600 • Dedic ated comme rcial data p rocess ing u se—S erver s who se us e is restricted for online transaction processing (OL TP), running Oracle, and running other data proces sing wo rkloads . These systems pro vide limited, if any , interactive user acces s . The “OL TP/D atabase S[...]

122 Chapter 6 HP-UX Operating System HP-UX on the V2500/V 2600 /usr/sam/lib/kc/tuned Refer to th e SAM onl ine help fo r examples and details o n using kernel parameters . Process and Thr ead “Gang Scheduling ” HP-UX V1 1.0 includes suppor t for kernel thre ads and pr ovides a “g ang scheduling” feature for managing how t hreads belonging t[...]

Chapter 6 123 HP-UX Operating System HP-UX on the V25 00/V2600 extensio ns also pro vide system inquiry feat ures for retri eving information about the current hardware topolog y , as well as thread and process inq uiry features. Both traditio nal system archite ctures as well as SC A sy stems are support ed by the H P-UX 11.1 0 enhancements . HP-U[...]

124 Chapter 6 HP-UX Operating System HP-UX on the V2500/V 2600 • Fill First—Fill a lo cality first , then sp ill over to another loca lity , as needed. Once all lo calities are filled , start ov er as nee ded. • P acked—Place all thread s or proce sses in th e same lo cality; do no t spill o ver . • Least Lo aded—P lace each thre ad or [...]

Chapter 6 125 HP-UX Operating System Starting HP-UX Starting HP-UX Bringing the V -Clas s serve r to a usa ble stat e involv es two systems and their hardware and softw a re. This section pro vides a brief overview of the process; for comp l ete instructions , see Managing Systems and Wo r k g r o u p s . Additional info rmation is co ntained in th[...]

126 Chapter 6 HP-UX Operating System Starting HP-UX Start up, or boot, H P-UX aft er the opera ting syst em has been comp letely shut down o r partially s hut down to perform syst em ad ministration tasks . The boot p rocedure di ffers accordin g to the val ue of the Autob oot flag. See “Enabling Autoboot” on page 67 f or information on how to [...]

Chapter 6 127 HP-UX Operating System Starting HP-UX Step 4. Issue t he OBP menu’s BOOT comma nd to bo ot HP-UX on t h e V -Class serv er . Y ou can set t he server to au tomatically bo ot HP-UX if you have also set a primary boo t devi ce ( PRI ). The OBP menu p rovides th e AUTO BOO T option , which causes the server to auto m atical ly boot HP-[...]

128 Chapter 6 HP-UX Operating System Starting HP-UX T able 14 Bo ot variables Reviewing the state of the file system Durin g the start- up pr ocess, th e /sbin/bcheckrc scri pt ex ecutes /usr/sbin/fsclean . This command determines the shut down st atus of the s ystem and retu rns three pos sibilitie s: 1. Prop er fi le sy st em shut do w n The star[...]

Chapter 6 129 HP-UX Operating System Starting HP-UX The start -up proces s is inte rrupted: /usr/sbin/fsclean:/dev/dsk/0s0 not ok run fsck FILE SYSTEM(S) NOT PROPERLY SHUTDOWN, BEGINNING FILE SYSTEM REPAIR . At this point , the system runs /usr/sbin/fsck in a mode that corrects certain inco nsistencies in the file systems without your intervent ion[...]

130 Chapter 6 HP-UX Operating System Stopping H P-UX Stopping HP-UX This sectio n provide s a brief ove rview of the proces s; for complet e instructions , see Managi ng S ystems and W orkgroups . Additional information is containe d in the V 2500/V2 600 SCA HP-UX S ystem Guide . Typica lly , the syst em is sh ut do wn to : • Put it in sin gle-us[...]

Chapter 6 131 HP-UX Operating System Stopping HP-UX See the shutdown man page fo r a complete description o f the shutdown process and available option s .[...]

132 Chapter 6 HP-UX Operating System Stopping H P-UX Rebooting the system T o shutdo wn HP-UX and reboot the V -Class server, p erform th e following step s: Step 1. If the server is running HP-UX , log in to the server as root. Step 2. Check a ctivit y on t he se rver an d warn u sers of the i mpe nding server reboot. If HP-UX is hung , to rebo ot[...]

Chapter 6 133 HP-UX Operating System Stopping HP-UX Shutting down the system T o shut down the V -Class serv er, perform the following steps: Step 1. Login to th e serv er as root . Step 2. Check a ctivit y on t he se rver an d warn u sers of the i mpe nding serv er shutdown. Step 3. Change to the root directory . Enter: cd / Step 4. Shut down t he[...]

134 Chapter 6 HP-UX Operating System Stopping H P-UX Resetting the V2500/V2600 ser v er hardware The /spp/bin/do_reset command resets the V -Class hardware . The do_reset command is run from the Service Support Processor , causes OBP to reb oot, and halt s all a ctivity on t he V -Clas s server ca binets involved. F or details see t he do_res et ma[...]

Chapter 6 135 HP-UX Operating System Stopping HP-UX P erf orms a leve l 4 reset o f all cabinets. This ca uses a Transf er of Control ( TOC) that initiat es a crash d ump of the op erating syst em, if crash dump is configured. See the savecrash (1M) man pag e fo r crash dump details . T o reset the V -Class server hardware , perform the following s[...]

136 Chapter 6 HP-UX Operating System Stopping H P-UX[...]

Chapter 7 137 7 Recovering from failures This chapter pr ovides deta iled informat ion on recove ring from HP-UX system inte rruptions. Usua lly , the f ir st in dica tion of a pr oblem is tha t the syste m does not respond t o user input. This lack of res ponse ind icates ei ther a performance problem or sys tem interruption. P erf ormance proble [...]

138 Chapter 7 Recovering from f ailures Collecting inf ormation Collecting i nformatio n Providi ng the Respons e Center with a complet e an d accurate symptom descr ipt ion i s impor tan t in so lving any proble m. The V -Class server’ s SSP auto matically re cords informati on on environme ntal and sys tem level ev ents in se veral log f iles. [...]

Chapter 7 139 Recov ering from failures Per formance pr oblems P erformance pr oblems P erf ormance problems are generally pe rceived as: • Slu ggish response at the operat ing sys tem prompt • Slow prog ram execution • Some user s/programs unable to get a respons e Use the foll owing proced ure to trouble sho ot a performance pro b lem: Step[...]

140 Chapter 7 Recovering from f ailures System hangs System hangs System hangs are characterize d by users una ble to access the sy stem, although the LCD disp lay and attention ligh t may not indicate a problem exists . The system console may or may no t be hung . Use the fol lowing proced ure to troubleshoot a system ha ng: Step 1. Pres s Enter a[...]

Chapter 7 141 Recov ering from failures System panics System panics A system pa nic is the result of H P-UX encountering a condition th at it is unable to respond to and halting e xecution. System panics are rare and are not alway s the result of a catastrophe. They ma y occur on bootu p, if the sys tem wa s previous ly shut down improperly . Somet[...]

142 Chapter 7 Recovering from f ailures System panics Step 2. Record the pa nic messag e displayed on the system console . Look for text on th e cons ole t hat con tain s term s like : •S y s t e m P a n i c •H P M C • Privi lege Violati on • Data Segmen tati on F aul t • Ins truction S egmentatio n F ault Step 3. Categorize t he panic me[...]

Chapter 7 143 Recov ering from failures System panics 2. T ake t he de vice of fline. 3. P ower down the devi ce . 4. If it is a disk driv e, w a it for the dis k to st op spinning. 5. P ower up the device . 6. Place the device back onli ne. Step 3. Check to ensure the device address or ID is corre ct. Step 4. Check cable and terminator connections[...]

144 Chapter 7 Recovering from f ailures System panics Step 4. If the syst em does not reboot by itself , reboo t the computer by issu ing the reset command in the cons ole window or do_reset command at the ksh-shell w indow . F or more i nformation abo ut rebooting the system s ee “Reboot ing the system” on page 146. If the problem reap pears, [...]

Chapter 7 145 Recov ering from failures System panics Logical V olum e Manager (L VM) related problem If the size of a logical volume t hat contains a file system is reduced such that the log ical volume is smaller tha n the file system w ithin it, the file system w ill be corrupte d. When a n attempt is made to acce ss a part o f the truncated f i[...]

146 Chapter 7 Recovering from f ailures Rebooting the system Rebooting the sys tem Once a problem has been corre ct ed, reset and reboot the system. Step 1. Reset the V -Clas s server . See “Res etting the V 2500 /V260 0 server hardware” on page 13 4. Step 2. If the syst em panic ked due to a corrupt ed file system, fsck will report the errors [...]

Chapter 7 147 Recov ering from failures Abnormal system shutd owns Abnormal s ystem shutdowns Abnormal systems shutdowns (often ref erred to as system crashes) can occur for many reasons . In some cases, th e cause of the crash can be easily determined. In some ex t reme cases , however , it may be nece ssary to ana lyze a sna pshot (called a cor e[...]

148 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns The o n-di sk a nd fi le sy ste m for mat s of a cr ash du mp h ave ch ange d w ith HP-UX 11 .0. libcrash (3) is a new libra ry pro vided to allo w programmati c access to a crash dump. supports all pa st and current crash d ump formats. By using libcrash (3) under certain configura[...]

Chapter 7 149 Recov ering from failures Abnormal system shutd owns IMPORT AN T Crashdump must be configured to dump on cabinet zero disks only . It is important to have sufficient space to capture the part of memory that contains the instruction or data that caused the crash. More than one dump device ca n be defined so tha t if the first one fill [...]

150 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns T o calculate an ap propriate size for a V2500/V2 600 SCA crash dump volume, estimate t hat you will ne ed at mos t the follo wing amount of space: th e total amount of phy sical memory in the system, p lus space t o allow for dump headers and table s, min us the amount of memory de[...]

Chapter 7 151 Recov ering from failures Abnormal system shutd owns The fewe r pa ge s d umped to di sk ( and on reb oot, co pi ed to the H P- UX file system area), the faster t he system can be back up and running . Therefore , avoid usi ng the full dump option. When defining dump dev i ces , whether in a kernel build or at run time, the opera tor [...]

152 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns /etc/rc.config.d/savecrash ) reduces system re cove ry t ime . Af te r the system recovery , run savecrash manually to copy the memory image from t he du mp a rea to the HP -UX fi le sy stem a rea . P artial save If a memory dump resides partially on dedicated dump devices and parti[...]

Chapter 7 153 Recov ering from failures Abnormal system shutd owns Dump definitions built into the kern el vs. defined at runtime There are thre e places to define which devices are to be used as dump devices: 1. During kernel conf iguration 2. At boot t i me (entries defined in the /etc/fstab file ) 3. At run time (using the /sbin/crashconf comman[...]

154 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns paging fro m being e nabled t o the de vice by creating t he file /etc/ savecore.LCK . swapon do es not enable t he device for pagi ng if the device is lo cked in /etc/savecore.LCK . Systems co nfigured w ith small amo unts of memo ry and using o nly the primary swap devi ce as a d [...]

Chapter 7 155 Recov ering from failures Abnormal system shutd owns NOTE W it h HP-UX 11 .0, it is po ssible t o analyze a cra sh dump dire ctly from dump devices using a debugger that supp orts thi s feature . If , however , there is a need to s ave it to ta pe or send it to someone, copy t he memory image to t he HP-U X file system area firs t. If[...]

156 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns CLASS PAGES INCLUDED IN DUMP DESCRIPTION -------- ---------- ---------------- ------------------------------------- UNUSED 2036 no, by default unused pages USERPG 6984 no, by default user process pages BCACHE 15884 no, by default buffer cache pages KCODE 1656 no, by default kernel c[...]

Chapter 7 157 Recov ering from failures Abnormal system shutd owns Step 3. Use the SAM acti on menu t o add, remove , or modify devi ces or logical volumes . NOTE T he order of t he devices i n the l is t is impo rtant. Devices are used in reverse orde r from the w ay they appear in the l ist. The last device i n the lis t is as the first d ump d e[...]

158 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns • The logical volume cannot be used for file sys tem storage, because the whole l ogical v ol ume is used. T o use logical volumes for du mp devices (no matter how many logical volumes are req uired), i nclude the foll owing dump st atement in t he syste m file: dump lvol Configur[...]

Chapter 7 159 Recov ering from failures Abnormal system shutd owns The /e tc/fstab file Define en tries in the fstab file to act ivate dump devices duri ng the HP- UX init ializ at ion (boot) pr oces s or when crashconf reads t he fi le. The format of a dump entry for /etc/fstab loo ks like t he fo llowing: devicefile_name / dump defaults 0 0 Examp[...]

160 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns To h a v e crashconf add the device s repre sented by th e block device files /dev/dsk/c0t1d0 and /dev/dsk/c 1t4d0 to the d ump de vice list, enter the fo llo w i ng : /sbin/crashconf /dev/dsk/c0t1d0/dev /dsk/c1t4d0 To h a v e crashconf replace any existing d ump device definitions [...]

Chapter 7 161 Recov ering from failures Abnormal system shutd owns Operator override options When the sy stem crashes , the system console display s a panic message similar to the foll owing: *** A system crash has occu rred. (See the above me ssages for det ails.) *** Th e sy stem i s no w pr eparin g to dump phys ical m emor y to disk, for use **[...]

162 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns F ollo wing th e dump, the syste m attem pts to reboot . The reboot When dumping of phys ical memo ry pages is complete , the system attempts to reboot (if the A utoboot is set). F o r information on the Autoboot flag, see “Enabl ing Autobo ot” on p age 67. savecrash proce ssing[...]

Chapter 7 163 Recov ering from failures Abnormal system shutd owns Using crashutil to complete the saving of a dump If devices are being used for both paging (sw apping) and dumping , it is very imp ortant to no t disable savecrash processing at boot time. If t his is done, there is a chance tha t the memory i mage in the d ump area will be overwri[...]

164 Chapter 7 Recovering from f ailures Abnormal sys tem shutdowns des tin atio n Designate s the pat hname where t he conver ted file will be written. If no destination is specifie d the source will be overwrit ten. See the crash util(1M) manpage for more information. Analyzing crash dumps Analyzing crash d umps is not a trivial t ask. It requi re[...]

Appendix A 165 AL E D c o d e s This appendi x describes core utiliti es board (CU B) LED errors The Attention LED on the co re utilitie s board (C UB) turns on , and the Atte ntion light ba r on the front of the n ode flas hes to indica te the presence of an error co de liste d T able 1 5. Addit ionally , only t he highe st priority error is displ[...]

166 Appendix A LED codes P ower on detected err ors Power on detected errors This sectio n describes core utiliti es board (CUB ) LED errors from highest to lowest pri ority detect ed at powe r on. The Attent ion LED on the core utilit ies boa rd (CUB) tu rns on, and the At tention li ght bar on the fr ont of the n ode fl ashe s to in dicat e the p[...]

Appendix A 167 LED codes Power on de tect ed e rrors 03 FPGA not OK 1. Core Utilit ies Board (CUB) monitoring utilit ies chip (MUC) problem. 2. MUC cannot get correct program transfer f rom EEPROM on power up . • Cycle the n ode p ower using t he Key switch. • Cal l the Respon se Center . 04 dc OK error (Upper Left ) 1. P ower supply is reporti[...]

168 Appendix A LED codes P ower on detected err ors 08-11 48 V error NPSUL failure PWRU P=0- 9 1. Error occurs when 48 volt distri bution fall s below 42 volts during po werup state display ed. P owerup state indicate s which loads are bein g turned on. 2. Exce ssive load on 48 volts d ue to an inadequate number of functioning 48 volt supp lies or [...]

Appendix A 169 LED codes Power on de tect ed e rrors 1C-25 48V error NPSLL fai l ure PWRU P=0- 9 1. Error occurs when 48 volt distr i but ion fa lls be low 42 volts during po werup state display ed. P owerup state indicate s which loads are bein g turned on. 2. Exce ssive load on 48 volts du e to an inadequate number of functioning 48 volt supp lie[...]

170 Appendix A LED codes P ower on detected err ors 30-39 48 V error (maintenance) no supply failure reported PWRU P=0- 9 1. Error occurs when 48 volt distri bution fall s below 42 volts during po werup state display ed. P owerup state indicate s which loads are bein g turned on. 2. Exce ssive load on 48 volts d ue to an inadequate number of functi[...]

Appendix A 171 LED codes CUB detected memory power fail CUB detected memory power fail This describes covers memory errors detected by the monitoring utilities chip (MUC ) on the co re utilitie s board af ter powe r - on. T able 16 CUB dete c ts memory power fail LED F ault Symptoms C orrective action 40 MB0L P ower F ail 1. 3. 3V dr opped b elow a[...]

172 Appendix A LED codes CUB detected pro cessor err or CUB detected processor error This section describes processor errors detected by the monitoring utilities chip (MU C) on the co re utilitie s board af ter powe r - on. T able 17 CUB dete c ts processor p ower fail LED F ault Sympt oms Corrective acti on 48 PB0 L Power F ail 1. 3.3V dr opped b [...]

Appendix A 173 LED codes CUB detected I/O error CUB detected I/O error This section describes I/O errors detected by the monitoring utilities chip (MUC) on the core utilit ies boa rd after powe r -on . T able 18 CUB d etects I/O (I OB) power fail LED F ault Symptoms Corrective action 58 Le ft Front I/O Board failure 1. 3.3V or 5V droppe d below acc[...]

174 Appendix A LED codes CUB detected fan err o r CUB detected fan error This sectio n describes fan errors det ected by th e monitori ng utilities chip (MUC) on the core utilit ies boa rd after powe r -on . NOTE F an positions are referred to as viewe d from the rear of the server . T able 19 CUB d etects fan p ower f ail LED F ault Symptoms Corre[...]

Appendix A 175 LED codes CUB detected am bient air errors CUB detected ambient air errors This section describes air erro rs detected by the monitoring u tilities chip (MUC) on the core utilit ies boa rd after powe r -on . T able 20 CUB d etects ambie nt air error LED F ault Symptoms Corrective action 62 Ambient hot 1. A mbient air too hot. 2. Core[...]

176 Appendix A LED codes CUB detected hard error CUB detected hard error This sectio n describes hard errors d etected by t he monitori ng utilities chip (MUC ) on the co re utilitie s board af ter powe r - on. T able 21 Hard error LED F ault Symptoms C or rective action 68 Hard error (RAC) (P AC) (MAC) (T AC) (SAGA) 1. Hard error lines to core uti[...]

Appendix A 177 LED codes CUB detected intake ambient air er ror CUB detected intake ambient a ir error This section describes air intake errors detected by the monitoring utilities chip (MU C) on the co re utilitie s board af ter powe r - on. T able 22 Ambient air (i ntake) error LED F aul t Symptoms Correcti ve action 69 Ambi ent air too warm is a[...]

178 Appendix A LED codes CUB detected dc err or CUB detect ed dc err or This section describes dc errors detected by the monitoring utilities chip (MUC) on the core utilit ies boa rd after powe r -on . T a ble 23 dc er ror LED F ault Symptoms Corrective action 70 N PSUL failure (warning ) 1. Node p ower suppl y (V iewed fro m Node front) failure re[...]

Index 179 Index Symbols /spp directory , 4 /spp/bin , 55 /spp/data , 55 /spp/est , 56 /spp/etc , 54 /spp/firmware , 56 /spp/man , 56 /spp/scripts , 55 ^E key seq ue nce , 49 Numeric s 10/100 Ba se T Ethernet , 12 1000 B ase SX G igabit Eth ernet , 12 32-bit applic ations , 118 64-bit applic ations , 118 712 wo rkstati on , 36 , 98 A Abaqus , 120 ab[...]

180 Index detect ed me mory po wer fail , 171 detected proc essor e rror , 172 core utility board (CUB) , 36 CPU . see p roces sor , 9 crash dump , 147 SCA , 149 crash conf , 159 crash util , 147 creat ing new win dows , 41 crossbar , 6 CTI (Coh eren t T oroida l Interconnect) , 15 cables , 15 cache me mory , 11 , 12 control lers , 6 , 15 CTI cache[...]

Index 181 HyperPla ne Crossbar , 6 I I/O control lers , 13 listin g , 118 multipl e-cabinet number ing , 14 numbering , 119 physic al ac cess , 13 supported ca rds , 12 indicator LED s DAT , 25 DVD -R OM , 24 indicators , 21 DAT drive LEDs , 25 dc on LED , 23 light bar , 31 installa t ion c onditions , xix interco nnecting h ardware , 6 interl eavi[...]

182 Index L VM (Logica l V olu me Manager ), problems , 145 M materi al handl ing safety , xv i media DAT , 25 tape , 25 memo ry 80-bit DI MMs , 10 88-bit DI MMs , 10 board , 11 control lers , 6 CTI ca c he memo r y , 11 , 12 interl eaving , 11 latency , 10 numbering , 119 population , 10 supported DIMM sizes , 10 memo ry p ower fail , 171 MIB , 36[...]

Index 183 power , 23 powering down the system , 130 P ower -On Se lf T est (P O ST ) , 28 privat e ethern et , 36 private LAN , 57 private LAN see diag nostic LA N proces sor binding , 123 numbering , 119 P A-8200 , 9 P A-8500 , 9 P A-8600 , 9 proc es so r agents , 6 Proces sor Dep endent Co de (PDC) , 60 processo r statu s line , 28 programm ing e[...]

184 Index Stop-on-hard button , 10 9 supported I/O ca rds , 12 switch es , 21 Symbios , 98 Symmetric Multi -Processing (SMP) , 10 syst em displays , 27 hangs , 14 0 logs , 52 panics , 141 fil e syst em pr ob lem , 144 inter face card prob lem , 143 lan pro blem , 144 logica l volum e man ager problem , 145 monito ring the system , 146 peripheral pr[...]