Cambex Bus Adapter manual

Dynamic Path Failover Driver for AIX FibreQuik Host Bus Adapter Installation and User Guide Cambex Corporation 115 Flanders Road Westborough, MA 01581 Customer support support@cam bex.com Document: 081-468-025 Date: 12/07/06 Rev.: H[...]

[...]

Table of Contents DYNAMIC PATH FAILO VER FOR AIX ................................................ 3 Introduction ............................................................................................ 3 SAN Managem ent ................................................................................... 4 Storage Management .....................[...]

DECLARATION OF CO NFORMITY .................................................... 33 Warning................................................................................................ 33 SAFETY NOTICES ................................................................................... 34 FCC Warning ..............................................[...]

Dynamic Path Failover for AIX Introduction The Cambex FibreQuik ™ Fibre Channel host bus adapters provide attachment of Fibre Ch annel devices to PCI or Micro Channel based servers. They support the SCSI-FCP protocol. When used with the Cambex DPF (Dynamic Path Failover) software, two adapters in a system provide greater throughput and total prot[...]

SAN Management SAN Management is the top layer. It is responsible for assigning the required access for e ach server to each storage device. The unit of storage is the LUN (Logical Unit Number) which acts the same as a single di sk directly a ttached to the server. In reality, a LUN is made up of portions of a number of disks under the direction of[...]

communicating via a network connection to each managed device. The Cambex Dynamic Path Failov er driver is a Path Management component that allows multiple p aths to a sto rage device and provides automatic fail over between available paths. Cambex Dynamic Path Failover software provides both a command line interface and access through smit, the st[...]

How Preferred Paths work The basic idea of multip athing is fairly simple. Access a disk on one of two paths. If the path fails, move I/O activity to the other path. We build on that basis by adding m ore factors into the configuration and seeing what effect they have. A path is defined as an end- to-end connection through a SAN, ignoring any inter[...]

and set up preferences so that the re maining paths to the sam e controller are preferred over path s to the altern ate controller. Example 1) Suppose we have two HBAs, a switch, and two RAID controllers. A total of four cables, and four paths to each LUN (2 HBAs x 2 RAID controllers). We use the RAID controller preference to s elect which controll[...]

are accessed by different hosts, we could have the problem of "thrashing". One host tries to m ove the LUN group to preferred controller A while the other hos t tries to move the group to preferred controller B. Anti-th rashing code prevents this problem in the multipath ing software. 8[...]

Adapter S pecifications PC2000LC-HPSP PC2000LC-A PC4000 (Single Port) PC4002 (Dual Port) Bus PCI PCI-X 2.0 Data rate (each dir.) 100/200 100/200/400 MB/s Cable length - copper 30 - multimode optical 500 70 m - single mode optical 10 Voltage 3.3 or 5 3.3 V Power 7.2 8.0 W Shipping weight 10 10 oz Trademarks Dynamic Path Failover and FibreQuik are tr[...]

Sof tware and Hardware Inst allation Driver Installation (command line) The examples assume that the driver CD is mounted at /m nt and that you are installing on AIX 5.1. The name and revision level of the uninstalled driver image may be exam ined by issuing the command (as root): installp -ld <device> where <device> is the path to th e[...]

The new driver may be installed on the system with the command: installp -acd <device> all where <device> is as described above. example: installp -acd /mnt/AIX5.1 all After installing the driver, see the README f ile for additional information and release notes. /usr/lpp/cbxfc/READ_ME /usr/lpp/PC4000/READ_ME /usr/lpp/cbxdpf/READ_ME 11[...]

Driver Installation (smit) The smit path is Software Installation and Maintenance Install and Update Software Install and Update Software by Package Name For item " INPUT device / directory" use /mnt/AIX5.1 or the directory where the image f iles are located. A list should pop up with the name of the driver s. Select and press enter. Also[...]

Hardware Installation Power down the system and insta ll the adapter in a free slo t. The PCI cards may be installed in either 32 or 64-bit PCI card slots, however the 32-bit slots may limit performance at high data rates. Make sure that a ny cables do not block airflow to the card. Observe proper static precautions. Detailed procedures for opening[...]

AutoRecover cbxdpfar, the AutoRecover daemon, is autom atically installed and enabled when the DPF driver is installed. Control of the daemon is done using SRC. stopsrc -s cbxdpfar Stops AutoRecover startsrc -s cbxdpfar Starts AutoRecover AutoRecover works by periodical ly polling the standby paths to each LUN. If the polls fail, the pa th is marke[...]

AIX Configuration During power-up initialization, AI X will find and configure the new adapter(s) and any supporte d devices using the driver's configuration method. Devices ar e assigned a SCSI ID as they are discovered starting with 0. SC SI ID is not related to loop ID, port ID or to SCSI ID assignment on other hosts. It is a logical value [...]

Persistent Bindings Persistent Bindings is the term used to indicate the mapping of SCSI ID to FC Worldwide Name (WWN). By keeping a persistent binding, the loop ID or port ID of a device may change and the device will still be properly addressed. In the Cambex AIX driver, persistent binding is automatic. At configuration time, all devices that are[...]

SMIT Commands Commands The adapter management commands available in SMIT are in the devices menu under Cambex Fibre Channel Adapter : List all Cambex FC adapters This provides the name and location of each adap ter. Change / Show Characteristics of a Cambex FC A dapter Allows the user to display and modify attributes. Attributes (and default values[...]

sw_fc_class (3) Fibre channel class. devtype_exclude ( ) List of SC SI device types to ignore during configuration. For example, specifying "1,5" would exclude both tape and CD devices. Attributes only used in loop mode include: id (0) Default L_ID for adapter. Se e table of L_ID to ALPA. login_on_lip (yes) Full login if LIP occurs. full_[...]

The autorecover daemon will au tomatically move operation to preferred paths. The preferred pa th is the combination of path preference values for HBA, device and path. For some arrays, target device preference is read automatically fr om the array at configuration time. Consult the array user m anuals for more information. Change / Show Characteri[...]

for use until the purchased license is received. Issue the commands: cd /usr/lpp/cbxdpf mv license.30day license cfgmgr Licenses for OEM versions of the driver are obtained from the storage vendor who provided the software. The generic version of DPF purchased from Cambex is licensed for use only on Cambex cards and on only one LPAR. A license toke[...]

• failed or offline status is cons idered first. A path will not be used if failed or offline. • Anti-thrashing prevents pa ths to the wrong controller from causing thrashing. • HBA preference - normally all HBAs have equal preference to paths. To block an hba from using a path, do: Command line: dpfutil hba_set_wwn cbx0 no (default is yes) t[...]

T roubleshooting Use the errpt command to identify the cause of failure. The lsdev command will provide the location of the component. For example, if errpt identifies a loose cable on device hdisk1, lsdev will give an address similar to: hdisk1 Available 00-02-01 Cambex SCSI... and lsattr -El hdisk1 will show: clr_q no Device CLEARS it’s Queue o[...]

Checklist for driver and HBA installation The following commands may be used to isolate problems during installation of the fibre channel driver and card. Type the command shown in bold and verify the output. lslpp -l PC1000.driver.obj must give: Fileset Path: /usr/lib/ objrepos PC1000.driver.obj Level 01.05.00.00 (or greater) State Committed Descr[...]

If cfg.log contains the ID 7710002x and no driver is found, then the adapter driver is not installe d. During boot, the number displayed when configuring the adapter is hex 0x911 (FC adapter). /usr/lpp/cbxfc/mbtest fscsi1 This test code may be used to get fibre channel status from the adapter or from attached devices. Type the com mand as above for[...]

The message no failover devices available indicates that the attached storage is not yet rec ognized by the DPF driver. This could mean that a platform kit needs to be installed for your storage or that the storag e is not yet configured. /usr/lpp/cbxfc/runtrace This should be run to start a tr ace if Cambex support requests a trace of the card fai[...]

Error Messages Various errors and notifications will be placed in the AIX error log. These can be read using the errpt command, or automatic notification may be set up. DPF_FAILOVER This indicates that the active path to a device h as failed, and that DPF successfully transferred I/O to an alternate path. DPF_STDBYDN This indicates that a path othe[...]

Upgrading the Driver When upgrading to a newer versi on of the driver there are two methods: 1) Use rmdev to remove all dependent devices, remove the existing driver(s), then in stall the new driver(s) and run cfgmgr to recreate the devices. This method allows a new driver to be installed without rebooting the se rver. File systems which are unmoun[...]

Appendix A Identifying Fibre Channel Components Copper DE9 GBIC Copper DE9 Cable 28[...]

Copper HSSDC Cable Duplex SC Optical GBIC 29[...]

Small form factor (SFF) optical LC cable 30[...]

PC2000 LED Meanings Top LED – Transceiver hardwa re is detecting a signal. Middle LED – Firmware is being synchronized. Bottom LED – Flashing ambe r when not synchronized. LED NORM BAD CABLE NO CONN TOP GREEN GREEN OFF MIDDLE GREEN OFF OFF BOTTOM OFF FLASHING FLASHING[...]

PC4000 LED Meanings Y G A Y G A Off Off Off No Power On On On Power Applied Flash Flash Flash Initializing * Off Off On/Flash 1G (Flash indicates active) Off On/Flash Off 2G (Flash indicates active) On/Flash Off Off 4G (Flash indicates active) ∗ Flashing in unison indicates initialized, while alternate flashing indicat es a firm ware error. Y G A[...]

Declaration of conformity We Cambex C orporation of Westborough, Massachusetts, USA, declare under our sole responsibility, that the products PC2000LC-HPSP, PC2000LC-A, and PC4000 are in co nformity with the fo llowing standards: EN 55022:1994/ A 1: 1 99 5/ A 2: 1997 Class A ITE emissi ons re qui rements EN 50082-1:1 992 EMC resid ential, comm erci[...]

Safety Notices FCC Warning This equipment has been tested an d fou nd to comply with the limits for a class A compu ting device p ursuant to Part 15 of FCC rules whic h are designed to pr ovide reasona ble protection against inte rference whe n operating in a commercia l environment . This equipm ent generates, uses and can radiate radi o frequency[...]

Dynamic Path Failover License Agreement Cambex Dyna mic Path Failo ver (the Soft ware) is a licens ed product. The user must cons ent to the pro visions of t his license agreement in order to use the Software. Use of the Soft ware beyond t he number of purchased li censes is prohibited. The user m ay not cause or permit copying, m odification, r en[...]