Magma EB7-x8 manual

PCIe Expansion System User's Manual ExpressBox Universal (EBU) PCI Express® to PCI Express® Expansion Model: EB7-x8 Model: EBU Model: EB7R-x8[...]

Copyright © 2009 Mission Technology Group, Inc. - DBA Magma This publication is protected b y Feder al Copyrigh t Law, with all rights reserved. No part of this public ation may be copied, photoco pied, reproduced, stored in a retrieval system, translated, transmitted or transcribed, in any form or by an y means manual, electric, electronic, elect[...]

MA GMA i Table of Contents PREFACE .............................................................................................. V Advisori es .............................................................................................. v Safety Inst ructi ons.................................................................................. vi Wh[...]

MA GMA ii CHAPTER 5 MODULAR SOLUTIONS WITH EBU ......................... 33 Configuring a complete computer wi th EBU ......................................... 33 Configuring EBU for I/O Sharing bet ween multiple Blades or Other Server s ................................................................................................. 34 Virtualizat[...]

MA GMA iii 500Watt Power Supply Specifications ........................................................ 65[...]

[...]

MA GMA v Preface Advisories Five types of advisories are used throughout this manual to provide helpful information, or to alert you to the potential for hardware dama ge or personal injur y. They are Note , Important , Caution , Warning , and Danger . The following is an example of each t ype of advisory. NOTE Used to amplify or explain a comm ent[...]

MA GMA vi Safety Instruc tions Always use caution when servicing any electrical comp onent. Before handling the Magma PCI-E xpress E xpansio n chassis, re ad the fo ll o wing instructions and safety gui delines to prevent damage to the product and to ensure your o wn personal s afety. Refer to the “ Adv isories ” section for advisory convention[...]

MA GMA vii In addition, take note of these safe ty guidelines when appropriate: ♦ To help avoid possible damage to systems boards, wait five seconds after turning off the computer before removing a component, removing a s ystem board, or disco nnecting a peripheral device from the computer. ♦ W hen you disc onnect a cable, pull o n its connecto[...]

MA GMA viii ♦ Handle all sensitive compo nent s at an ESD workstation. If possible, use anti-static floor pads and workbench pads. ♦ Handle components and boards with care. Don’t touch the components or contacts on a boar d. Hold a board by its edges or by its metal mounting bracket. Rack-Mount Instructions Elevated Operating A mbien t - If i[...]

MA GMA 1 Chapter 1 Introduction General Specifications The Magma 7 Slot PCI Express® to PCI Express® Expansion System (Model EB7-x8) is a general-purpos e bus expansion c hassis for the Peripheral Component Interconnect Expr ess (PCIe) local bus. The expansion chassis is fully compliant with the PCI Express Loc al Bus Specification. This s ystem [...]

MA GMA 2 Pre-Installation Inf ormation Before using the Magma expansion chass is you should perform the following steps: • Inventory the shipping carton cont ents for all of the requir ed parts • Gather all of the necessary tools required for installation • Read this manual Parts List The following parts are provided: Item Qty Item 1 8 slot r[...]

MA GMA 3 Chapter 2 Hardware Inst allation The following steps will guide you through the installation of your Magma expansion system. Electrostatic Discharge (ESD) Warning All PCI cards are susceptible to electrostatic discharge. When moving PCI cards, it is best to carry the cards in anti-static packaging. If you need to set a PCIe card down, be s[...]

MA GMA 4 Before you Begin The 500W AC power supply is auto-sw itching. This means that it will automatically switch to match what ev er source power yo u are using. Since all products ship with a US/Canadian Standard 1 25V power cord, you will need t o use a locally available power cord for non- US Standard power sources. Install PCI Express Host C[...]

MA GMA 5 STOP YOU MUST ONLY INSTALL THE PCIe HOS T CARD INTO A PCI EXPRESS SLOT . Only use cards WITH brackets. This will ensure that your PCIe host card can only be inserted into a PCIe slot. Although PCI Express cards without brackets may fit into conventional PCI slots, you run the risk of damaging the PCI Express host card if you insert it into[...]

MA GMA 6 cable to the host card and the other end of the cab le to the expansion interface card alread y installed in th e chassis. Note: You may wish to verify the EIF is securely mounted in the chassis in the upstream slot. Connect x8 end to the chassis along with the power cord. Connect x8 end to the host card. CA UTIO N All cables attached to t[...]

MA GMA 7 Attach one end of the PCI Express cable to the Magma ExpressCard module and the other end to the conn ector on the back of the Magma chassis. Tighten the thumbscrews connecti ng t he ExpressCard to the cab le on one end and verify the other end is properly latched i nto the iPass connector of the chassis. In spite of the standardized des i[...]

MA GMA 8 Picture B shows the Incorrect orientation: Before inserting the Magm a ExpressCard, power down your laptop computer. Use the procedure s for shutting down and po wering off your system provided in your o wne r’s manual or s ystem documentation. Insert the Magma ExpressCa rd module with the logo side up, into the ExpressCard slot on your [...]

MA GMA 9 NOTE The Magma ExpressCard module can onl y be used in a computer system that contains an ExpressC ard slot. It will not function in CardBus or PCMCIA slots. NOTE If your laptop’s ExpressCard slot is “spring-loaded”, be sure that your ExpressCard is inserted correctly. It is very easy for this style slot to partially release a card i[...]

MA GMA 10 Applying Power Correctl y Starting Up: It is recommended that you apply po wer to the Magma expans ion chassis prior to powering up your computer. T his will allow the PCIe bus hierarchy to be in a stable stat e wh en the host system issues its master power-on bus reset. This will also allow the software driver to recogniz e the PCI bus h[...]

MA GMA 11 Windows Start Up As your Windows computer starts up, you will see a small message box pop- up in the lower-right corner of the screen to alert yo u that Windows has found new hard ware. Now you are all set. The system does not req uire any Magma drivers in order to operate, unless you requ ire Hot-Plug/Hot-Swap support (see Chapter 4 for [...]

MA GMA 12[...]

MA GMA 13 CHAPTER 3 V erify Inst allation Windows To verify a successful i nstallation on Wind ows, find the ‘ My Computer ’ icon and “right-click” on it. Then select ‘ Manage ’ from the pop-up menu. Next, click on ‘ Device Manager ’ i n the leftmost Computer Manageme nt window. Finally, click on the View Menu and select View Device[...]

MA GMA 14 If everything is OK, then the Magma ex pansio n s ystem installation is complete. If, however, the installation was uns uccessful, you may not see the PCI to PCI Bridge, or it will have a small yello w in front of it. Proceed to Chapter 6 for Troublesho otin g installation problems. Mac OS X When using Mac OS X no additional s oftware or [...]

MA GMA 15 If your computer did not automatically prompt you to choose a PCI Express profile, you c an loca te this utility u nder System Æ Librar y Æ CoreServices Æ Expansion Slot Utility.app. Apple System Profiler When using Mac OS X no additional software or driv ers are needed. As long as you are using Mac OS X Vers ion 10.4 or newer, the ope[...]

MA GMA 16 Then click the “More Info” button Æ click on the Devices tab Æ you should see a pci-bridge device listed under PCI as shown below: Any PCIe Cards you install in the e xpansion chassis will appear behind the pci-bridge device. Mac OS 10.5.x If any of these devices are not displayed as sho wn above, you should shut down your system (c[...]

MA GMA 17 For example, below is showing the Magma Chassis on Bus 7, Device 0, Function 0. Some information has been deleted, but notice the Link Supported Speed is 2.5 Gb/s, Width x8 . This is helpful to kno w that the chassis is configured for x8 PCI Express Sp eeds h ighlighted in red. 07:00.0 PCI bridge: Integrated Device Technology, Inc. Unknow[...]

MA GMA 18 Example: lspci –vvv Output 07:00.0 PCI bridge: Integrated Devic e Technology, Inc. Unkno wn device 8037 (prog-if 00 [Normal decode]) Link: Supported Speed 2.5Gb/ s, Width x8, ASPM L0s L1, Port 0 08:02.0 PCI bridge: Integrated Devic e Technology, Inc. Unkno wn device 8037 (prog-if 00 [Normal decode]) Link: Supported Speed 2.5G b/s, Width[...]

MA GMA 19 Link: Supported Speed 2.5G b/s, Width x8, ASPM L0s L1, Port 14 Slot: Number 7 , PowerLimit 0.000000 0c:00.0 SCSI storage controller: Tr iones Technolog ies, Inc. Unknown device 2310 (rev 02) Link: Supported Spee d 2.5Gb/s, Width x4, ASPM L0s, Port 8 0f:00.0 Ethernet controller: Intel Corporation 82571EB Giga bit Ethernet Controller (rev 0[...]

MA GMA 20 Chapter 4 Inst all Cards and Drives This chapter provides information on ho w to install 3 P rd P Party PCIe cards or hard drives into your Magma expa nsion chassis. More details on the installation of individu al cards are prov ided by the card’s manufactur er. This chapter is provided as a simple guide to help you install your PCIe ca[...]

MA GMA 21 Remove all of these screws in order to open the enclos ure. Slide the enclosure c over backward to d isengage it from the g uides at the front of the enclosure by firmly grasping the edg es of the cover lip and pulling the cov er backward about 1” until it clears the front hold- down, and then lift the cover off. Be careful to store the[...]

MA GMA 22 Install 3 rd Party PCIe Car ds or Hard Drives CA UTIO N When installing PCIe cards or hard drives, please ensure that the current ratings specified on the pow er supply label are not exceede d. Seven (7) PCIe slots Expansion Interface card with the x8 PCIe iPass connector Fan assembly with slot holders for full-length cards 500W, 90-264V/[...]

MA GMA 23 Install the PCIe peripheral cards followin g the card manufacturer’s recommendations. Some PCIe card manufacturers recom mend that yo u install their software driver(s) pri or to installing the hard ware. If this is the case, you should install t heir driver before you c onnect and power up the expansion chass is. Make sure that all PCI[...]

MA GMA 24 System Should Be Up and Running Apply power to the M agma expansion cha ssis first, then power up the computer. Use the procedures deta iled in Chapter 3 to confirm the card installation(s) in the Windo ws Device Mana ger or Appl e System Profiler. When everything is functio ning correctly, your Windows Devic e Manager should look somethi[...]

MA GMA 25 For this feature to work, you need to install the Magma soft ware driver. If running Windows XP, Server, or Vista go to our website and download the Expansion_DriverHP_2_6.exe, http://www.magma.com/support/drivers/index.html Follow the instructions on the screen. There is no hotplug support for 64 bit Windows, yet. Each of the PCIe slots [...]

MA GMA 26 4. If the device is currently in th e Magma chassi s, the location will show “Magma chassis x slot y ”. Where x identifies the physical chassis and y identifies the physical sl ot the devic e is plugged into. After verifying that this is the device to be removed, click on the OK button to close the new dialog. 5. The properties dialog[...]

MA GMA 27 Remove the card and rep l ace it with a new one, th en press the button aga in. Ideally the PCIe card that was removed from the system will be replaced with an identical, working card. Replacing that card with one that has a different function or purpose may ca use the system to crash due to a mismatch in the resources pre-allocated by th[...]

MA GMA 28 PCIe Expansion Solutions w ith the EB7-x8 In the following section we will take a lo ok at possible PCI Express expansion solutions using Ma gma’s EB7 chassis. Digi Design Pro Tools® Pro Tools® is a comprehensive solution for professional music editing. It offers advanced capabilities for recording and manipulation of music by control[...]

MA GMA 29 Note that the maximum number of tr acks is achieved with all PCIe c ards inserted directly into the PC. Using the EB7 expans ion chassis we note the difference in track counts is no larger than 2 0% compared to a scenario where all cards resid e in the PC, taking up all available slots. Video Card expansion solutions Magma’s EB7 chassis[...]

MA GMA 30 Since the built-in video chipset doesn’t sup port 3D rendering needed to run 3DMark® , we first establi shed a bas eli ne b y insta lling an entr y l evel PCIe card into an EB7 expansion chassis (Nv idia Quadro NVS440). All subsequent benc hmarks were complet ed using higher performing video cards and documente d in the tabl e below: T[...]

MA GMA 31 The growing demand for storage solutions in the past few years was one of the major catalysts behin d the exponential gro wth in hard driv e capacity. Moreover, a new breed of faster and mor e efficient interfaces have emerged in order to pr ovide higher throughp ut while maintaining the lowest possible d elays in accessing our data. One [...]

MA GMA 32 Developed orig inally by Intel as a proprietary tool, it eve ntually became part of the Open Source De velopment Lab (OSDL) from which point it has undergone several rev isions and updates. Going back to the Fibre channel h ost controller cards, one of the features that the ATTO FC-44ES s upp orts is the creation of multip le, small virtu[...]

MA GMA 33 Chapter 5 Modular Solutions with EBU Configuring a complete computer with EBU The EB7-x8 can be easily transformed into a Host Co mputer with 8 slots when a Root Complex card is installed in pla ce of the Expansion Interface ca rd. Any Root Complex PCI Expres s form factor card can replace the Expansion Interface C ard (EIF) in order to b[...]

MA GMA 34 Configuring EBU for I/O Sharing between mu ltiple Blades or Other Servers All IO PCI-X cards in PE6R4 can be shared with multiple Blades. PE6R4 is Magma’s PCI-X box and can be rep laced with any of Magma’s PCI Express expansion bo xes as well, such as EB7, EB4 EB4-1u, EB2R, EB2, etc. This c an be useful in virtualizatio n environments[...]

MA GMA 35 ability of its chassis to allow for peer to peer communic ation between its slots as well as its abilit y to communicate with multipl e Root Comple x Port sources with its complementar y Univ ersal Host Adaptor product lends itself to very elegant and immensely cost effective I/O virtualization applicatio ns. The same fundamental approach[...]

MA GMA 36 Chapter 6 Chassis Maintenance Like all computer systems, you will nee d to perform some routine maintenance tasks. Some of these inc lude making sure that the ai r vents in the chassis are clear of obs tructions an d that the cooling air from the fans flows freely. You will also need to check the foam filter behind the front panel to ensu[...]

MA GMA 37 Next, use a can of compres sed air fr om your local computer store to blow out any dust that may have accumulated in the chass is fans. Be sure to keep the can of compressed air about si x inches from the parts being sprayed with air. Pay particular attention to the fans in the chassis and power supply because they are critical to air mov[...]

MA GMA 38 If your chassis is extremely dirty and you would like professional help with getting it clean, you can contact Magma Support for instructions and costs on shipping the chassis back for cleaning. Finally, clean the a ir filter following the instructions later in this chapter. When finished, replac e the cover and turn on po wer to the syst[...]

MA GMA 39 In order to ensure the safety and efficiency of your expansion system, it is recommended that you keep a spare power supply module on hand – just in case. Protect yourself, keep a spare. Order your spare po wer supply module from Magma – PN 40- 00005-03. Cleaning the Air Filter The chassis is equipped with an air f ilter that is eas y[...]

MA GMA 40 Finally, replace the filter and faceplate. S ecure faceplate with four Phillips screws. Tighten scre ws until snug. Turn on power to the chassis.[...]

MA GMA 41 Chapter 7 T roubleshooting Locate the Problem If you are having trouble with the Magma expansion s ystem, verify that all cards are seated proper l y and all cables are conn ected pr operly. Be sure you followed the instructions in ea rli er sections of this User Guide. Always remember to power On and Off correctly when rechecking and tes[...]

MA GMA 42  Double-check that the PCIe host card is seated c orrectly in the right PCIe slot. Note that a physical x16 slot (in len gth) can electrically be connected as x8 or less. T herefore it is impo rtant to consult your motherboard’s user manual to verify the actual bandwidth supported by the slot. Check the DIP switch settings on the Mag[...]

MA GMA 43  If the expansion system is still not visib le after trying all of the above steps, go to Chapter 7 to get additional help. Windows If the PCI-to-PCI Bridge is now visible, but contains a (exclamation) in front of it, it has a pr oblem that must be fixed. To identify this problem, right-click on the l ine with the and select “Propert[...]

MA GMA 44 When Nothing Works The following troubleshooting steps will help you when the computer or chassis won’t turn on or “nothing seems to work” correctly: If it powers up OK, but nothing works, check the computer’s Device Manager or System Profiler to s ee if the e xpansion system has b een found. If not found, try the troubl eshooting[...]

MA GMA 45 My Computer Hangs Duri ng Po wer Up If your computer “hangs” while being turned on an d you can’t even start, follow the following steps to try to fix this problem: 1. Shut off the computer (first ) and then th e Magma expansio n system and verify that all cards and cables are con nected and seated correctly. Reapply p ower first to[...]

MA GMA 46 cards works, troubleshoot th e first card. If the second card also fails, call Technical Support. My PCIe Card Doesn’t Work The following flowchart describes a gener al approach to resolve PCI e card issues: PCIe card doesn’t work Are drivers required ? Reinstall drivers and re-check functionalit y Yes Check error codes or try a diffe[...]

MA GMA 47 The following additiona l steps might also help when the abov e troubleshooting steps fail to resolve your problem: 1. Shut down the computer fo llowed by the Magma expans ion chassis 2. Remove the PCIe card displaying a problem 3. Replace the “problem card” with a simple PCIe card, such as an Ethernet card that has driv ers built int[...]

MA GMA 48 Support for 3 P rd P Party PCIe Cards Magma will provide reas onable technical supp ort to with 3 P rd P Party PCIe cards. However, if you have verified a successful installation of the Magma PCIe Expansion S ystem (as defined in Chapter 4 ), but experience difficult y installing your 3 P rd P Party PCIe cards, the card manufacturer shoul[...]

MA GMA 49 Error Code Description/Action 10 This code indicates t hat there is a problem w ith the 3 rd Party PCIe Card driver. If necessary, contact the card’s manufacturer for updated software drivers. If all else fails, contact Magma Technical Support for further assistance. On the Bridge: If you receive error code 12 on th e first PCI to PCI B[...]

MA GMA 50 Chapter 8 How to Get More Help Frequently Asked Questions (FAQ) You can visit the Magma Technical Sup port FAQ pages on the Internet at: HT www.magma.com/support/ TH Contacting Technical Support Our support department can be reached by fax at (858) 530-2733 or by phone at (858) 530- 2511. Support is ava ilable Monday thr ough Friday, 8:00[...]

MA GMA 51 Magma Debug Utility Occasionally, Technical S upport may request Wi ndows users to produce and email a Magm a debug log file to help them resolv e your problem. This file should be i ncluded as an attachment when submitting a Technical Support req uest at H www. mag ma. com/ TU s UT upport H . You can download Magnostic.exe from the fol l[...]

MA GMA 52 PCIScope Software Utility PCIScope is a pow erful tool for Window s users. It was designed by a Germany company called APSoft. This software utility is a valuable resource to explore, e xamine and debug the PCI subs ystem of your computer. It was made to fit the requirements of the most demandin g users, especially engineers, progr ammers[...]

MA GMA 53 You should save this data as a file o n your computer. Please include your name and date as part of the f ile name with an extension of “.bpd.” This file should be included as a n attachment when submitting a Technical Support request at H www.magma.com/ TU s UT upport H .[...]

MA GMA 54 Returning Merchandi se to MAGMA If factory service is required, a Service Represe ntative will give you a Return Merchandise Authoriz ation (RMA) number. Put this number and your return address o n the shipping labe l when you retu rn the item(s) for service. Magma will return any product that is not accompan ied by an RMA number . Please[...]

MA GMA 55 Appendix A Need More PCIe Slot s? Multiple PCIe Ex pansion Sy stem Configurations The PCI Express Local Bus Sp ecification defines the bus as hierarchical , where logical PCI to PCI Bridges (PPBs) may be used to add "levels" to the P CI bus hierarchy within a PCIe switch. Becaus e hierarchies are orga nized systems arranged into[...]

56 2. Most computers allo w multiple logical bridges (an d thus PCIe buses) to be correctly configured. S ome computers, unfortunately, place an arbitrar y limit on the number of bridge levels that can be traveled duri ng po wer-on configuration. Your computer “power-on-soft ware” should be compliant with the PCIe bus specification 1.1 in or de[...]

MA GMA 57 Fan-Out For reasons described in bu llet #3 above, we recomm end using a fan- out configuration when yo u need to add successive PCIe expa nsion systems to the host computer. This addition to the PCI bus hierarchy is at the "peer" level of other exis ti ng expansion buses, thus add ing "breadth" to the PCI bus hierarch[...]

58 Verify your configuration Before you start installing yo ur PCIe cards (refer to Chapter 4 Install Cards and Drives for more infor mation) , you should confirm that everything is in proper working order. Refer to Chapter 3 Verif y Installation for guidance i n verifying the prop er installation of your Expansion System. For exam ple, the followi[...]

MA GMA 59 Daisy-Chaining Recognizing the t ypical insignificance of the performa nce variance between the “Fan-Out” and “Dais y-Chain ing” configuratio ns, the primary reason for using this one would be limitatio ns on physical space. T his could be the number of availab l e slots on the host computer motherboard, or a lack of desk or rack [...]

60 Combination Configurations Depending on your business requirement s, and your ph ysical space limitations, you can ad d additional Expa nsion System in multiple configurations, such as thes e. These combin ati ons are only limited by the availability of PCIe slots (both in the host a nd in subsequent chasses). Wo r ks t at i o n Fan- O ut D ai s[...]

MA GMA 61 PCI e Card Conflicts If you determine that one PCIe card is int erfering with the operation of another card, first try reorganizing the cards on the motherboard. Moving the cards aroun d can change the or der in which th e cards are configured by the system du ring po wer-on. This will go a long way toward resolving module conflicts. Powe[...]

62[...]

MA GMA 63 Finding the Problem Card Windows If you need help to determi ne which PCIe card, or which expansi on chassis, has the problem, you can “right-click” on the c ard with the and check the information contained in the “L ocation:” field. Look for the “Error Code” in the box in the ce nter of the Properties Window and then go to th[...]

64 APPENDIX B Compliance FCC /C E /UL NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reasonable protection agai nst harmful interference when the equipment is operated in a commercial environment. This equipment generat[...]

MA GMA 65 500Watt Power Supply Specifications AC INPUT Operating Range: 90-264 VAC .99 power factor Frequency: 47-63Hz Current: 9A Efficiency: 82% EMI: FCC-B, CE DC OUTPUT Output: +5V @ 24A +12V@ 35A -12V @ 0.8A +3.3V @ 24A +5VSB @ 2.5A continuous power = 500W peak power = 550W Regulation: 5% (+3.3V, +5V, +12V) 10% (-12V) Ripple: 1% (p-p) Hold Time[...]

66 Temperature: 0° - 40°C Humidity: 10% - 90% RH Fan Type: 22 - 34 CFM ball-bearing Noise: 20 - 35dB(A) MISCELLANEOUS Compatibility: ATX12V (2.2), EPS12V M/B Connectors: 20/24-pin, 8-pin, 4-pin, 6-pin PCI-E, 6/8-pin PCI-E Drive Connectors: 13 (6 SATA, 1 mini) MTBF: 100,000 hrs Warranty: 5 Years[...]

MA GMA 67 09-09917-01- A Manual, USER, EB7-x8, ROHS Magma 9918 Via Pasar, San Diego, CA 9 2126, USA Phone (858) 530-2511 • Fax (858 ) 530-2733 www.magma.com[...]