ATTO Utilities Installation and Operation Manual

ATTO Configuration Tool for Windows, Linux and Mac OS X BIOS Utilities ATTO Utilities for Windows • Alamode • Benchmark • LUN Masking • FC API • Domain Validation

© 2007 ATTO Technology, Inc. All rights reserved. All brand or product names are trademarks of their respective holders. No part of this manual may be reproduced in any form or by any means without the express written permission of ATTO Technology, Inc. 4/2007. Document Control Number: PRMA-0267-000MD

Contents

Glossary 1.0 ATTO Configuration Tool ...... 1 Install from the ATTO website Install from CD Use the Configuration Tool Navigating the ATTO Configuration Tool About panel

1.1 Fibre Channel NVRAM settings ...... 6 BIOS PCI Memory Write/Invalidate Button PCI Latency Timer Hard Address Enable Button Hard Address Frame Size Device Discovery Connection Mode options Data Rate Node Name Port Name Interrupt Coalesce Additional Settings for ExpressPCI FCSW/3300/3305 adapters World Wide Name Duplex Mode IOCB Allocation Per Target Loop Reset Delay Execution Throttle Loop Arbitration Fairness Class 2 Options Enable LUNs

1.2 SCSI NVRAM settings ...... 9 Controller ID Termination Selection Timeout (ms) Fallback Sync Rate (MB/s) Bus Reset Delay (sec.) Quick Arbitrate & Select (Ultra320 only) Wide IDs Specified Target LUNs Allow Disconnect Tagged Command Queuing Sync Offset Sync Enabled for this ID Sync Rate (MB/s) Wide Transfers

ATTO Technology Inc. 1.3 SAS NVRAM settings ...... 11 SAS Address Boot Driver Heartbeat Device Wait Device Count Port Configuration (R348 only)

1.4 SAS RAID settings ...... 13 Preliminary steps Set up DVRAID Custom RAID setup Use Hot Spares Modify RAID groups Expand Capacity Change from one RAID level to a new RAID Level Delete group Rebuild group

1.5 RAID notifications ...... 19 Basic alerts Logging E-mail

1.6 Troubleshooting ...... 21 Messages from NVRAM Tab Actions An error occurred loading NVRAM data. Warning: NVRAM could not be read, defaults returned. An error occurred updating the NVRAM. Feature bounds checking Messages from Flash Tab Actions This is not a flash file, or it is corrupt. This HBA is not compatible with the selected flash file. A valid file was not selected. An error occurred reading from the flash file, the file may be corrupt. An error occurred updating the flash. Access the Fibre Channel Utility Access the SCSI Utility Common BIOS Configuration Utility functions Selectable Boot Device Update flash ROM Display device list Reset defaults Format disk drives Save parameters and exit Discard parameters and exit Configure Stripe groups

ATTO Utilities Installation and Operation Manual 2.1 FC BIOS Configuration Utility ...... 25 Adapter Node Name Adapter Number Class 2 Options Connect Speed Connection Mode options Current Boot Node Name Current Boot LUN Number Device Discovery Enable LUNs Enable Selectable Boot Execution Throttle Frame Size Hard Address Enable BIOS Interrupt Level Interrupt Coalesce I/O Address IOCB Allocation Per Target Loop Arbitration Fairness Loop Reset Delay PCI Latency Timer PCI Memory Write/Invalidate

2.2 SCSI BIOS Configuration Utility ...... 27 Configure Adapter Channels menu Bus Reset Delay Channel Number Firmware Version (Ultra320 only) BIOS Initiator ID Interrupt Level I/O Address Max Single-Ended Sync Rate PCI Burst Size (Ultra160, Ultra/WIDE only) PCI Bus Parity (Ultra160, Ultra/WIDE only) Quick Arbitrate & Select (Ultra320 only) Reset Bus on Startup SCSI Termination Selection Timeout SCSI device settings SCSI Device Settings menu Enable Disconnect Enable LUNs (Ultra160, Ultra/WIDE) Enable LUNs (Ultra320) Enable Synchronous SCSI Enable Wide SCSI Sync Offset Sync Rate Tagged Command Queuing

ATTO Technology Inc. 2.3 ExpressSAS BIOS Utility ...... 31 Access the SAS Utility Configure Adapter Settings menu Boot Driver Device Wait Time Device Wait Count Heartbeat Port Configuration (R348 only) Reset to Defaults Display Drive List menu Show Drive Detail Select Drive Scan Clean Hot Spare Remove Spare Configure RAID Groups menu View Selected RAID Group Create Delete Rebuild Partition Map RAID Groups Create a RAID group 3.0 ATTO Utilities for Windows ...... 35 Configuration Tools

3.1 Configuring Mode Pages: Alamode Utility ...... 36 Notes Using Alamode

3.2 ATTO Disk Benchmark ...... 37 Benchmark fields Performing multiple benchmark tests

3.3 FC LUN Masking Utility ...... 39 Add a new device to an adapter Use the Edit LUN Mask Dialog box Save and apply your changes

3.4 SNIA FC Host Adapter API ...... 41

3.5 Domain Validation Testing ...... 43 Run the SCSI Application

3.6 ExpressPCI SCSI Setup Utility ...... 45 Modify NVRAM settings

3.7 Troubleshooting ...... 47

ATTO Utilities Installation and Operation Manual Appendix A CLI provides an ASCII-based interface ...... i CLI error messages CLI summary CLI command explanations

Appendix B Contact ATTO Technology, Inc...... x

ATTO Technology Inc. ATTO Utilities Installation and Operation Manual Glossary Some terms used in the Fibre Channel industry are defined below. More information is available through the ATTO Technology website (www.attotech.com), the Fibre Channel Industry Association (www.fibrechannel.com), Cern (www.cern.ch), the Storage Area Networking Industry Association (www.snia.org), and the Fibre Channel Consortium (www.iol.unh.edu/consortiums, click on FC). Term Definition ANSI American National Standards Institute arbitrate process of selecting one L_Port from a collection of ports which ask for use of the arbitrated loop at the same time arbitrated loop a loop topology (FC-AL) in which two or more ports are interconnected, but only two ports can communicate at one time. Low-cost solution which may or may not use hubs and switches. autonegotiation hardware senses and automatically responds depending on configuration BER Bit Error Rate: a measure of transmission accuracy; the ratio of bits received in error to bits sent bit Smallest unit of data a computer can process: a single binary digit, either 0 or 1 bus a collection of unbroken signal lines used to transmit information from one part of a computer system to another. Taps on the lines connect devices to the bus. Byte an ordered set of 8 bits channel a point-to-point link which transports data from one point to another CPU Central Processing Unit: the portion of the computer that performs computations. CRC Cyclic Redundancy Check: an error-correcting code which calculates a numeric value for received and transmitted data. If no error has occurred during transmission, the CRC for both received and transmitted data should be the same. destination a value in the frame header of each frame which identifies the port in the node where address the frame is being sent device driver a program that allows a microprocessor to direct the operation of a peripheral device DMA Direct Memory Access: a way to move data from a storage device directly to RAM without using the CPU’s resources DMA bus master Allows a peripheral to control the flow of data to and from system memory by block as opposed to allowing the processor to control the data by bytes (PIO or programmed I/O) fabric A Fibre Channel switch or two or more Fibre Channel switches interconnected to physically transmit data between any two N_Ports on the switch or switches. FC Fibre Channel F_port A port in the Fibre Channel fabric where a N_port may attach FL_port A port in the Fibre Channel fabric where a NL_port may attach in an arbitrated loop frame an indivisible unit for transfer of information in Fibre Channel frame header the first field in the frame containing the address and other control information about the frame. full duplex a communication protocol which allows transmission in both directions at the same time half duplex a communication protocol which allows transmission in both directions, but only one direction at a time

ATTO Technology Inc. Term Definition host a processor, usually a CPU and memory, which communicates with devices over an interface initiator device A component which originates a command L_port a port in an arbitrated loop, either a NL_port or a FL_port LED Light-emitting diode: a type of diode that emits light when current passes through it. Visible LEDs are used as indicator lights on all sorts of electronic devices. LUN Logical Unit Number: an identifier for a logical unit (0-7) multi-mode fiber an optical fiber which can carry several beams of light at once. N_port a port attached to a node used with point-to-point or fabric configurations NL_ port a port attached to a node in Fibre Channel arbitrated loop or fabric loop configuration originator an initiating device; a component which originates a command parity checking A method which verifies the accuracy of data transmitted over the SCSI bus by adding one bit in the transfer to make the sum of all the bits either odd or even (for odd or even parity). An error message occurs if the sum is not correct. PCI Peripheral Component Interconnect. Allows peripherals to be connected directly to computer memory, bypassing the slower ISA and EISA busses. point-to-point a topology where two ports communicate port an access point in a device: see N_port, NL_port, etc. port address also port number. The address, assigned by the PCI bus, through which commands are sent to a host adapter board. receiver the ultimate destination of data transmission; a terminal device SCSI Small Computer Systems Interface: a processor-independent standard for system- level interface between a computer and intelligent devices including hard disks, floppy disks, CD-ROM, printers, scanners, etc. single-mode an optical fiber with a small core which supports one wavelength (ray of light). The core fiber radius is nearly equal to the wavelength of the source. topology logical layout of the parts of a computer system or network and their interconnections transceiver a transmitter/receiver module transfer rate the rate at which bytes or bits are transferred, as in megabytes or gigabits per second.

ATTO Utilities Installation and Operation Manual 1.0 ATTO Configuration Tool The ATTO Configuration Tool is a utility program that displays information about installed adapters, drivers and devices and provides a mechanism to configure installed adapters.

This program executes under f. Click on Click here to start your • Windows® XP/2000/Server 2003/Vista download. • Linux® 2.4 and 2.6 kernels, x86 and x64 2 After the download has completed, process the • Macintosh® OS X 10.2.4 or later downloaded file • On OS X: expand the .tgz file, then double Note click on the installer icon Java version 1.4 or later must be installed. • On Windows: run the downloaded .exe file The ATTO Configuration Tool displays • On Linux: double click on the .bin file. If the • The names of ATTO adapters installed in the executable bit is not set, run sh /path/to/bin system 3 Follow the instructions for installing the • Information about the drivers controlling the application. adapters, including version information for both the currently executing driver and the flash Install from CD image The version on the CD included with your adapter • Information about the devices attached to ATTO may be older than the version on web site. Please adapters. check for newer versions. You may also use the Configuration Tool to • On Windows: use the HTML menu to select the • Update the flash image when a new version is configuration tool installation. released by ATTO • On OS X: find the configuration tool folder and • Modify the NVRAM settings double click on the installer. Follow the • Manage RAID groups installation instructions. • Revert to default factory settings. • On Linux: use the HTML menu to select the • Configure RAID notifications configuration tool installation. • Update firmware on huge disk arrays The factory settings on your ATTO host adapter Use the Configuration Tool should provide excellent performance for a wide 1 Locate the application icon in the folder you range of applications. However, some created during installation. applications may benefit from modification of the 2 Double-click the icon to start the application. adapter NVRAM settings that tune the adapter for Note a specific performance range. ATTO host adapters are designed to operate Install from the ATTO website properly using factory settings. Entering invalid or incorrect settings when using an 1 From www.attotech.com, download the ATTO NVRAM configuration utility such as the ATTO Configuration Tool Configuration Tool may cause your host a. Click on Support adapter to function incorrectly. b. Click on Downloads c. Under Software, click on ATTO CAUTION Configuration Tool and Hardware Back up system data when installing or Flash Files. changing hardware configurations. d. Log in. e. Click on the configuration tool for your The main screen has three windows: Device Operating System. Listing, Configuration Options and Status. See Exhibit 1.0-1 on page 3.

1 ATTO Technology Inc. Navigating the ATTO Configuration Tool Click on the Browse button at the bottom of the The Device Listing window at the left of the tab to search for new flash files on your system such as FlashBundle_2004_02_20.21P. display screen lists all devices currently connected to the system. Click on the Update button to automatically update your host adapter. Expand the device tree to reveal additional detail • The Advanced tab rescans the SCSI busses on connected devices. attached to the adapter. You must unmount all The Configuration Options window in the right Volumes connected to the adapter before window pane.provides information and options rescanning. for a device highlighted in the device listing After the rescan is complete, all Volumes detected during the rescan are mounted. If an If you highlight a device in the Device Listing, OS or an adapter does not support this feature, tabs and panels display for that device. the panel displays a message. The following chart specifies the tabs that display When you select a specific channel under an for the indicated device type. ATTO host adapter in the Device Listing, the NVRAM panel displays the NVRAM parameters Tree node Tab(s) displayed applicable to the adapter and channel selected. Adapter Basic Info, Flash, Advanced, Refer to Fibre Channel NVRAM settings on RAID, CLI page 6, SCSI NVRAM settings on page 9, SAS Channel NVRAM, PCI info NVRAM settings on page 11 and SCSI Devices Basic Info, Flash Troubleshooting on page 21 for information Local Host Basic Info, Notifications about NVRAM settings. The following tabs display in the Configuration PCI information is displayed in the PCI Info tab. Options window when you select a specific See Exhibit 1.0-5 on page 5. adapter in the Device Listing window. The current status of the Configuration Tool is • The Basic Info tab provides basic information represented in the Status window at the bottom of about the device currently highlighted in the the display screen. device listing or the host if the local host is highlighted. About panel You cannot make changes from this screen. The About panel, selected from the About menu See Exhibit 1.0-2 on page 3 and Exhibit 1.0-3 item in the Help menu, is an informational screen on page 4. which displays a list of components installed for • The Flash tab provides information about the current revision of flash loaded on the the ATTO Configuration Tool, the tool’s version highlighted host adapter. See Exhibit 1.0-4 on number and ATTO Technology contact page 4. information.

2 ATTO Utilities Installation and Operation Manual Exhibit 1.0-1 The ATTO Configuration Tool opening screen

Exhibit 1.0-2 The Basic Info tab when you choose Local Host from the Device Listing.

3 ATTO Technology Inc. Exhibit 1.0-3 The Basic Info tab when a device is chosen from the Device Listing

Exhibit 1.0-4 The Flash tab

4 ATTO Utilities Installation and Operation Manual Exhibit 1.0-5 The PCI information page.

5 ATTO Technology Inc. 1.1 Fibre Channel NVRAM settings

The settings in the NVRAM tab vary depending upon the selected adapter and the operating system. Settings unsupported by that OS are not displayed. ATTO host adapters are designed to operate PCI Latency Timer properly using factory settings. Entering invalid Choices: 8, 16, 24, 32, 40, 48, 56, 64, 80, 96, 112, 128, or incorrect settings when using an NVRAM 160, 192, 224, 248 configuration utility such as the ATTO Default: see below Configuration Tool may cause your host adapter Specifies how long the host adapter maintains control of to function incorrectly. the PCI bus. Larger values allow the adapter to remain on the bus longer, improving performance, especially for CAUTION large files. However, controlling the PCI bus for too long can starve IO to other devices, adversely affecting their Back up system data when installing or performance. changing hardware configurations. As a default, the computer system firmware/BIOS Use caution when making changes to NVRAM automatically sets this value. However, adjusting the settings and only make changes to those with value for the ATTO adapter overrides the system default, which you are familiar. Once you have made the allowing you to achieve specific performance results. desired changes, click Commit to save the changes. Changes do not take effect until you Note reboot the system. Set the Latency timer to 32 for Media 100

If you do not want to make any changes, you may Hard Address Enable Button choose one of the following Choices: Enabled, Disabled • Defaults: restores the adapter to factory default Default: Disabled settings. The Commit button must be clicked to When a Fibre Channel loop is initialized, each device save any changes. selects and configures itself to an available ID. Hard • Restore: reverts to the NVRAM settings saved Address Enable permits the host to select the value the last time the Commit button was used. entered in the Hard Address field. Clicking Commit is not necessary. Hard Address BIOS Choices: None, 0-125 Choices: Enabled, Scan Only, Disabled Default: 0 Default: Disabled The value used as the FC-AL hard address. A value to If enabled and disk drives or a bootable CD are detected represent the address if hard addressing is enabled. during the bus scan, the BIOS driver remains resident. If Frame Size disabled, the BIOS starts, resets the adapter chip and Choices: 512, 1024, 2048 unloads the driver. Default: 1024 (FCSW); 2048 (all other models) If Scan Only is selected, the BIOS driver scans the bus Changes the size of the FC packet of information being and displays the devices attached, then unloads itself after sent. Typically, the initiator and target negotiates the a brief delay. desired frame size, starting with the largest value. The frame size should be set to the largest value for normal PCI Memory Write/Invalidate Button operation. Choices: Default, Disabled Default: Default Device Discovery The host’s BIOS setting is overwritten and the PCI Choices: Node WWN, Port WWN memory write/invalidate setting is disabled. Default: Node WWN

6 ATTO Utilities Installation and Operation Manual Specifies the type of device discovery the adapter methodology is chosen there is less overhead to service performs. Use the Port WWN when the adapter the interrupts. However, the coalescing time may delay requires separate paths to a device and the device is dual the delivery of the completion for a single interrupt. ported. A dual ported device has one path when the Node WWN is specified and two paths when the Port WWN Additional Settings for ExpressPCI is specified. FCSW/3300/3305 adapters The following parameters displays on NVRAM Connection Mode options panels when the adapter is an FCSW, 3300 or Choices: AL, PTP, AL Preferred, PTP Preferred, Auto Default: AL Preferred 3305. Auto (ExpressPCI FC 3321, 3322, 3342) • Arbitrated Loop (AL): Connects to either an FCAL World Wide Name Arbitrated Loop or a Fabric Loop Port (FL Port) on a Displays the IEEE (Institute of Electrical and Electronic switch. Engineers) World Wide Name assigned to the selected • Point-to-point (PTP): Connects to a direct Fabric host adapter. The IEEE is a professional standards connection, such as an F port on a switch. organization. • AL Preferred: Allows the card to determine what kind of connection to use, but tries to connect in loop mode Duplex Mode first, then point-to-point mode. Choices: Half, Full • PTP Preferred: Allows the card to determine what kind Default: Full of connection is to use, but tries to connect in point-to- Allows full or half duplex Fibre Channel communication point mode first, then Loop mode. between the adapter and other FC devices. • Auto: Allows the card to determine what kind of connection to use, with no preferences IOCB Allocation Per Target Choices: 1-512 Data Rate Default: 256 Choices: 1 Gb/sec., 2 Gb/sec., 4Gb/sec, Auto Specifies the number of concurrent I/Os or commands Default: Auto that remain outstanding in the buffer. Selects the Fibre Channel transmission rate. Auto indicates the adapter determines the rate based upon the Loop Reset Delay devices connected. Choices: 0-255 Default: 5 (sec.) Node Name Specifies the amount of time before accessing a device The Node WWN assigned to this channel of the adapter. after the previous access resulted in an error. Increase this value if some of your devices are not recognized by the Port Name system at startup. The Port WWN assigned to this channel of the adapter. Execution Throttle Interrupt Coalesce Choices: 1-255 Choices: None, Low, Medium, High Default: 16 Default: Low Specifies the maximum number of concurrent commands Specifies the time period an adapter chip delays an that can be active for a port. Increasing this value may interrupt. This allows the adapter chip to queue up more increase performance, but you may saturate a drive with than one interrupt before interrupting the CPU. When this commands, decreasing performance.

7 ATTO Technology Inc. Loop Arbitration Fairness configuration issues and drivers do not load or Choices: Enabled, Disabled performance is intermittent, change this setting. Default: Enabled Loop arbitration fairness is an algorithm that ensures that Class 2 Options all NL_Ports on an arbitrated loop have equal access to Choices: Disabled, ACK_1 Only, ACK_0 Capable the loop. Each L_Port has an arbitration priority assigned Default: Disabled to it based on its AL_PA (arbitrated loop physical Select the appropriate option if you choose to take address). The access fairness algorithm creates a window advantage of Class 2 Fibre Channel class of service. in which all L_Ports are given an opportunity to win access to the loop, regardless of assigned priority. Enable LUNs Some loops may require certain NL ports to have more Choices: Yes, No access to the loop than just one access per window. You Default: Yes may need to disable Loop Arbitration Fairness. Enables/disables Logical Unit Numbers (LUNs) for a Some Fibre Channel devices cannot execute arbitration particular ID. LUNs label multiple storage units that fairness algorithms. If you have exhausted the obvious share the same ID. Disabling LUNs affects all target IDs connected to the host adapter. If you are connecting devices that do not support LUNs, select No.

Exhibit 1-2 NVRAM screen when you highlight a channel in the Device Listing

8 ATTO Utilities Installation and Operation Manual 1.2 SCSI NVRAM settings

The settings in the NVRAM tab vary depending upon the selected adapter and the operating system. ATTO host adapters are designed to operate properly The upper part of the NVRAM Config panel contains using factory settings. Entering invalid or incorrect common NVRAM settings that pertain to the entire settings when using an NVRAM configuration utility channel. The lower part contains settings that can be such as the ATTO Configuration Tool may cause your set for each SCSI ID on the channel. adapter to function incorrectly. Controller ID CAUTION Choices: 0-15 Default: 7 Back up system data when installing or The ExpressPCI SCSI adapter is normally set to SCSI ID 7 changing hardware configurations. because ID 7 has the highest priority on the bus. The setting Use caution when making changes to NVRAM should remain at ID 7 unless you are instructed to change it settings and only make changes to those with which by an ATTO Technical Support representative. you are familiar. Once you have made the desired Termination changes, click Commit to save the changes. Changes Choices for PSC, PSCd, DC, UL3S, UL3D: do not take effect until you reboot the system. Auto, None, Upper 8, Full Default: Auto Choices for UL4S, UL4D, UL5D, UL5D-LP: Auto, High Default: Auto Set to Automatic unless there is narrow SCSI cable connected to either the internal or external connector. Selection Timeout (ms) Choices:1ms - 1 sec. Default: 250 ms Specifies the amount of time a device has to respond to being selected. The time value can be lowered to speed up the boot process. If the value is lower than the recommended 250 ms, some devices may not have enough time to respond. Fallback Sync Rate (MB/s) Choices: 40/20, 20/10 and 10/5 Default: 40/20 Specifies the maximum synchronous transfer rate to be negotiated when the adapter detects a Single-Ended SCSI bus. The bus is Single-Ended when UltraSCSI devices are connected to the bus. Bus Reset Delay (sec.) Read only; no choices Default: 3 If you do not want to make any changes, you may Sets the time delay between the reset of the SCSI bus and the scanning of the SCSI bus. This is a read only parameter. choose one of the following Quick Arbitrate & Select (Ultra320 only) • Defaults: restores the adapter to factory default Choices: Disabled, Enabled settings. The Commit button must be clicked to Default: Enabled save any changes. If enabled, improves performance by reducing the time • Restore: reverts to the NVRAM settings saved required to gain control of the SCSI bus. QAS can only be the last time the Commit button was used. enabled if all target settings are set to Sync DT-IU and all Clicking Commit is not necessary. devices on the bus support QAS. 9 ATTO Technology Inc. Wide IDs Sync Offset Choices: Enabled (targets 0-15), Disabled (targets 0-7) Choices for PSC, PSCd, DC: 1-16 Default: Enabled Default:16 This setting is available only in Mac OS X and for Ultra160 Choices for UL3S, UL3D:1-62 or Ultra/WIDE ExpressPCI host adapters. Default: 62 Choices for UL4S, UL4D, UL5D, UL5D-LP: 0-127 Specified Target Default: 127 Choices: 0 to 15 or 0 to 7 if WideID is disabled The defaults offer the best performance possible. The value Default: 0 should not be changed unless instructed by an ATTO Specifies the target ID to which settings are applied. Technical Support representative. LUNs Sync Enabled for this ID Choices: Disable ID, 0, 0-7, 0-63 Choices: Enabled, Disabled Default: 0-7 Default: Enabled Specifies the number of LUNs that the driver addresses Specifies whether the selected target transfers data at when scanning for devices, determined as follows. This synchronous transfer rates or at the asynchronous rate. The setting is not available in Mac OS X. maximum synchronous rate to negotiate is specified in the • Disable ID: Target ID is bypassed and not scanned Sync Rate parameter. • 0: Scan LUN 0 for this target ID • 0-7: Scan LUNs 0 to 7 for this target ID Sync Rate (MB/s) • 0-63: Scan LUNs 0 to 63 for this target ID Choices: varies by adapter, see diagram below Default: varies by adapter, see diagram below Allow Disconnect If synchronous transfers are enabled, the sync rate specifies Choices: Enabled, Disabled the maximum rate at which the ExpressPCI host adapter Default: Enabled negotiates with the selected target ID. Set the rate to the Specifies if a device is allowed to disconnect from the SCSI maximum value supported by the host adapter. If excessive bus during SCSI command processing. The device SCSI errors occur, if you have long cables or if there are determines when it disconnects. This setting does not force many devices on the bus, you may want to reduce the Sync the device to disconnect. Rate value. Slowing the transfer rate may increase the Tagged Command Queuing reliability of the SCSI bus. Choices: Enabled, Disabled Wide Transfers Default: Enabled Choices: Disabled, Enabled Specifies to the driver if SCSI commands can use the Tag Default: Enabled Command feature to send multiple commands to a device. Specifies if the initiator negotiates wide data transfers. If the parameter is disabled, narrow data transfers are negotiated. Wide Transfers is automatically set to enabled when the Sync Rate specifies a DT rate. The DT sync rates must have wide data transfers.

Exhibit 1.2-1 Possible sync rates for various ATTO host adapters.

Sync DT IU Sync DT Sync ST WIDE Sync ST Narrow Async 320 UL4D, UL4S, UL5D, UL5D-LP UL4D, UL4S, UL5D, UL3D, UL3S, UL4D, 160 UL5D-LP UL4S, UL5D, UL5D-LP UL3D, UL3S, UL4D, UL3D, UL3S, UL4D, 80 UL4S, UL5D, UL5D-LP UL4S, UL5D, UL5D-LP UL3D, UL3S UL4D, UL3D, UL3S, UL4D, All 40 UL4S, UL5D, UL5D-LP UL4S, UL5D, UL5D-LP 20 All All

10 All All SyncRate (MB/sec.) SyncRate

5 All 5 NA All NA

10 ATTO Utilities Installation and Operation Manual 1.3 SAS NVRAM settings The settings in the NVRAM tab vary depending upon the selected adapter and the operating system. ATTO host adapters are designed to operate which you are familiar. Once you have made the properly using factory settings. Entering invalid desired changes, click Commit to save the or incorrect settings when using an NVRAM changes. Changes do not take effect until you configuration utility such as the ATTO reboot the system. Configuration Tool may cause your adapter to If you do not want to make any changes, you may function incorrectly. choose one of the following CAUTION • Defaults: restores the adapter to factory default settings. The Commit button must be clicked to Back up system data when installing or save any changes. changing hardware configurations. • Restore: reverts to the NVRAM settings saved Use caution when making changes to NVRAM the last time the Commit button was used. settings and only make changes to those with Clicking Commit is not necessary.

Exhibit 1-4 The SAS NVRAM settings screen.

11 ATTO Technology Inc. SAS Address Device Wait Read only Choices: 1-255 seconds Displays the SAS address assigned to the adapter. The Default: 3 value cannot be modified Specifies the number of seconds that the driver waits for devices to appear. Boot Driver Choices: enabled, scan only, disabled Device Count Default: disabled Choices: 1-255 devices If enabled and disk drives are detected during the bus Default: 1 scan, the BIOS driver remains resident. If disabled, the Specifies the number of devices that must appear in order BIOS starts, resets the adapter chip and unloads the to cancel the Device Wait period. driver. Port Configuration (R348 only) If Scan Only is selected, the BIOS driver scans the bus Choices: 8 Internal or 4 Intrn, 4 Extrn and displays the devices attached, then unloads itself after Default: 8 Internal a brief delay. Indicates the active port configuration for the ExpressSAS RAID R348 adapter. The 8Internal Heartbeat parameter indicates that the two internal SAS connectors Choices: enabled, disabled are active and the external connector is not active. The Default: enabled 4Intrn, 4Extrn indicates that one internal connector is When enabled, requires the firmware to respond to active and one external connector is active. periodic activity. If the firmware does not respond, the system driver resets the firmware on the adapter.

12 ATTO Utilities Installation and Operation Manual 1.4 SAS RAID settings

The ATTO ExpressSAS RAID adapter provides the capability to configure disk storage into RAID groups or Hot Spare drives. Use the ATTO Configuration Tool to set up Each RAID group may be divided into one or RAID groups on your ExpressSAS RAID adapter more partitions; each partition appears to the host in one of the following RAID levels: operating system as a virtual disk. • JBOD You may use the RAID Command Line Interface • RAID Level 0 page from the RAID CLI tab in the ATTO • RAID Level 1 Configuration Tool to set up or modify various • RAID Level 4 • RAID Level 10 parameters (Refer to Appendix A). However, the • RAID Level 5 ATTO Configuration Tool procedures listed in • DVRAID this chapter are the preferred procedures for DVRAID may be set up automatically by the setting up RAID configurations for the ATTO ExpressSAS adapter firmware. All other types of ExpressSAS RAID adapter. RAID require customized input. Preliminary steps

1 Locate the Configuration Tool icon in the 4 Click on the RAID tab. folder you created during installation (Refer to ATTO Configuration Tool on page 1). 2 Double click on the icon to start the application. 3 The Configuration Tool main screen appears. See Exhibit 1.4-1 on page 14 for an overview of the screen. In the Device Listing panel on the left hand side of the screen, click on the ExpressSAS RAID adapter you wish to use to configure RAID. 5 Devices are displayed in the top panel and RAID groups and Hot Spares are displayed in the bottom panel. If you have not yet defined any RAID groups, selecting the RAID tab automatically starts a RAID wizard. The wizard is displayed in the bottom panel. If the RAID wizard does not start automatically, select the RAID Management menu item, then select the Create RAID group sub-menu item. 6 Select the appropriate button for setting up DVRAID automatically (continue with Set up DVRAID on page 14) or customizing a RAID setup (continue with Custom RAID setup on page 15).

13 ATTO Technology Inc. Exhibit 1.4-1 Configuration Tool main screen

Set up DVRAID The DVRAID wizard automatically sets up message box is displayed immediately after the DVRAID using all storage attached to the ATTO OK button is clicked. ExpressSAS adapter. If you do not want all storage set up in DVRAID, either unattach the storage or use Custom RAID setup . 1 After following Preliminary steps on page 13, select the DVRAID radio button. 2 Click on OK. The ATTO ExpressSAS adapter firmware automatically uses all unassigned disks to create a DVRAID configuration. A confirmation A message box displays while the RAID group is being created. When the RAID groups are created, the panels display the RAID groups.

14 ATTO Utilities Installation and Operation Manual Custom RAID setup

1 After following Preliminary steps on page 13, 4 Select the disk devices in the top panel and select the Custom RAID radio button. See drag them into the device area in the bottom Exhibit 1.4-1 on page 14 panel. See Exhibit 1.4-4 on page 16. If you want 2 Select the options to configure the new RAID the RAID group to be presented as one virtual group. See Exhibit 1.4-2 below disk (partition), click Finish. • RAID Group Name Assign a name to the If you want more than one virtual disk (partition), RAID group or use the one assigned by the click Next. Configuration Tool. The name must be a. Select one of the following unique and no more than 14 characters. • leave as one partition • RAID Group Type: select a RAID group • partition by count level from the drop-down box. • partition by size • RAID Group Interleave: select an b. Click Finish interleave value. The default value is 128 KB. 5 A confirmation dialog box asks you to confirm 3 Click Next. See Exhibit 1.4-3 on page 16. the configuration you have chosen. Click Yes.

Exhibit 1.4-2 Select the options to configure the new RAID group.

15 ATTO Technology Inc. Exhibit 1.4-3 Selecting a RAID group option

Exhibit 1.4-4 Selecting drives for a new RAID group.

16 ATTO Utilities Installation and Operation Manual Exhibit 1.4-5 A confirmation dialog box asks you to continue setting up your RAID group.

Use Hot Spares If a disk drive of a RAID group becomes degraded If the ATTO ExpressSAS RAID adapter detects a or faulted, you lose some redundancy in your faulted device: RAID group until a new member is rebuilt into the • The adapter searches the Hot Spare pool for the RAID group. Hot Spare devices may be smallest block device of sufficient size to designated to automatically replace faulted substitute for the faulted drive. devices. You may set up a pool of Hot Spare • The ExpressSAS RAID adapter replaces the faulted device with the device from the Hot devices of different sizes appropriate for your Spare pool. RAID groups. • The ExpressSAS RAID adapter begins an automatic rebuild of the RAID groups. Note Click on the menu item in the RAID Management Block devices in the Hot Spare pool should be tab and follow the instructions on the screen. of appropriate size to the RAID group so that smaller block devices are not replaced by much larger Hot Spare devices.

17 ATTO Technology Inc. Modify RAID groups The ATTO Configuration Tool interface may be Change from one RAID level to a new used to: replace a failed drive; add capacity to a RAID Level RAID group; or change a RAID configuration Changing from one RAID level to another RAID from the current configuration to a new level is called migration. The following migration configuration. levels are supported: CAUTION • JBOD to RAID Level 0 • JBOD to RAID Level 1 Data can be compromised or lost when • RAID Level 0 to RAID Level 10 deleting storage or rearranging storage • RAID Level 1 to RAID 10 configurations, • N-way mirroring: add additional redundancy to The ATTO Configuration Tool interface takes RAID Level 1 you step by step through many procedures which Click on the menu item in the RAID Management allow you to modify your storage and RAID tab and follow the instructions on the screen. configurations. Read all notes and cautions carefully as you go to ensure the best performance Delete group and use of your storage. Many of these procedures You may delete a group using the ATTO are only available with disks that are not currently Configuration Tool. Click on the menu item in the part of a RAID group, are not designated as a Hot RAID Management tab and follow the Spare, or were offline when you initially set up instructions on the screen. RAID configurations. CAUTION Note Data can be compromised or lost when deleting storage or rearranging storage An unallocated drive or unallocated storage is configurations, storage which is not part of a RAID group, not designated as a Hot Spare or was offline when you initially set up a RAID configuration using Rebuild group the ATTO Configuration Tool interface. If RAID groups become compromised you must rebuild the group. Click on the menu item in the Expand Capacity RAID Management tab and follow the Click on the menu item in the RAID Management instructions on the screen. tab and follow the instructions on the screen. Depending on the RAID configuration, you may Note need to add more than one device at a time. A RAID rebuild may take up to two hours to complete. CAUTION Adding drives to an existing RAID group may adversely impact performance. You cannot reverse this operation unless you delete the RAID group.

18 ATTO Utilities Installation and Operation Manual 1.5 RAID notifications

The ATTO Configuration Tool provides a mechanism to issue notifications when a RAID event occurs. RAID events are divided into three categories Audible alert uses the system speaker to sound an Critical events indicate that a serious problem alarm for 5 seconds. The alarm stops after 5 has occurred and the administrator of the RAID seconds. group should perform corrective action. Visual alert uses a system modal pop-up to display a message. You must close the pop-up Warning events are less serious but still warrant recording and notification at some level. using the pop-up’s button. Information alerts provide supportive Note information about warnings or critical events. Visual alert is not available on Linux systems. Drop-down boxes on the Notifications page allow you to choose the type of event which prompts an Logging alert. Logging notification records the type of event as Critical: only Critical events are reported text in a log file you specify. Select the location, Warning: all Warnings and Critical events are name and size of the file. reported An integer value is added to the log name. When All: all Critical, Warning and Information events the log file reaches its size limitation, a new file is are reported generated with a sequential integer value added to None: no event is reported. The None level is the log name. When the second log file reaches its useful in Email notification because you can set size limitation, logging overwrites the first log up E-mail addresses to which alerts might be sent file. The two log files are automatically rotated. at some future time You may choose any combination of notifications E-mail on the Notification page as needed. The E-mail notification sends an E-mail to the notifications are specified at the host system level designated E-mail address when the event level and apply to all ATTO RAID adapters installed in from the drop down box is reached. the host system. You may specify several notification addresses on each line in the Email section of the Notifications Basic alerts screen, each separated by commas, for any event You can select an audible alert, a visual alert, or level. both an audio and a visual alert for a particular You must complete the IP address or name of the category of events. Select a notification level server and sender. using the drop-down box next to the Audible and You may specify a user name and password for Visual labels on the Notifications screen. the mail server if one is required. Critical event E-mail notification is sent after a 10-second delay to allow several related events to be reported in the same E-mail. All other notification E-mails are sent at 15-minute intervals

19 ATTO Technology Inc. Exhibit 1.5-1 The Notifications screen in the ATTO Configuration Tool.

20 ATTO Utilities Installation and Operation Manual 1.6 Troubleshooting You may see an error message informing you about an unexpected event or incorrect information discovered by the application. Using the help text presented with the error message, correct the issue before proceeding. Warnings and error messages are posted in the Messages from Flash Tab Actions Status area of the configuration utility. This is not a flash file, or it is corrupt. The ATTO-created flash file is corrupt or the Messages from NVRAM Tab Actions Configuration Tool does not recognize the file as a An error occurred loading NVRAM data. flash file. Only ATTO-created flash files may be selected The first time a channel is highlighted, the application using the flash file dialog box. tries to read NVRAM from the card. This message This HBA is not compatible with the selected flash usually indicates that the application could not file. communicate with the driver, probably because the ATTO flash files are created based on the type of card application does not support the driver version in use. flashed. ATTO flash files are only compatible with Warning: NVRAM could not be read, defaults certain ATTO cards. When a flash file is selected, the returned. flash file is inspected to determine if it is compatible. NVRAM is corrupt and the driver returns to the default A valid file was not selected. configuration. The defaults are presented via the You clicked the Cancel button on the flash file selection graphical user interface. These defaults may be modified dialog. but the defaults or modifications must be committed An error occurred reading from the flash file, the (saved) in order to correct NVRAM. file may be corrupt. An error occurred updating the NVRAM. You selected a compatible flash file but the contents are The driver cannot put the new settings on the card; no corrupt. changes are made to the card. An error occurred updating the flash. Feature bounds checking You tried to flash a card when the firmware was not able When the Commit button is clicked, each NVRAM to accept a flash. feature is validated before being sent to the card. If any one of these features is deemed inappropriate based on The card has been prepared for firmware updating, but the the implemented checks, further NVRAM feature machine must be rebooted for the changes to take effect. validation checks are stopped and the message is You need to repeat this process after rebooting to actually update the firmware. displayed, for example: Some firmware upgrades need to prepare the existing Execution Throttle is greater than the maximum allowable firmware in order to successfully update the adapter. value of 255. No NVRAM configuration changes have been Rebooting allows the changes made during the made to your card. preparation process to take effect, and the same file The exact message varies based on the first field with an should be flashed again. out-of-range value.

21 ATTO Technology Inc. 22 ATTO Utilities Installation and Operation Manual 2.0 BIOS Configuration Utility The BIOS driver for all ATTO host adapters has a built-in BIOS Configuration Utility which manages the adapter and the devices connected to the adapter. The BIOS Configuration Utility for ATTO Refer to Common BIOS Configuration Utility host adapters uses a standard menu/choice model. functions . The Main Menu presents the functions available Other utility options for Fibre Channel adapters from the utility. Selecting an item on the menu are described in FC BIOS Configuration Utility may bring up a secondary menu or a dialog box. on page 25; for SCSI adapters in SCSI BIOS The dialog box displays the items managed by Configuration Utility on page 27, and that dialog box. parameters for ExpressSAS adapters are The menus for SCSI and Fibre Channel adapters described in ExpressSAS BIOS Utility on page contain many choices with similar functions. 31. Access the Fibre Channel Utility Options for Fibre Channel adapter configuration Configure Adapter Channels are described in FC BIOS Configuration Utility Selectable Boot Device on page 25. Reset All Parameters Display Device List 1 During the Fibre Channel BIOS driver startup, Format Disk Drives press Ctrl-F at the prompt after the adapter Update Flash ROM boot string displays. If you do not press Ctrl-F Configure Stripe groups within 3 seconds, you must reboot and start Save Parameters and Exit again. Discard Changes and Exit 2The Fibre Channel BIOS Configuration • Utility starts and displays the following menu Access the SCSI Utility Options for SCSI adapter configuration are 2The SCSI BIOS Configuration Utility starts described in SCSI BIOS Configuration Utility and displays the following menu on page 27. Adapter Menu Display Device List 1 During the SCSI BIOS driver startup, press Format Disk Drives Ctrl-Z at the prompt after the adapter boot Configure Stripe groups string displays. If you do not press Ctrl-Z within Save Parameters and Exit 3 seconds, you must reboot and try again. Discard Changes and Exit Common BIOS Configuration Utility functions

Selectable Boot Device selectable boot drive. The Operating System is loaded Allows you to select a disk drive or stripe group from from this drive. which the system BIOS loads the operating system. If a SCSI drive is selected as the Boot device, Enable Select the primary drive from any stripe set or any non- Selectable Boot value becomes Yes. To disable a SCSI striped drive. Changing from No to Yes displays boot device, starting from IDE drive, press the spacebar candidate disk drives. to change the value to No. To choose another SCSI boot If the selectable boot option is enabled, the BIOS driver device, change the Enable Selectable Boot to No, routes any drive 80h I/O requests to the designated 23 ATTO Technology Inc. then press the spacebar again to see the candidate 2 Press the Enter key. A confirmation message drives. displays. 3 Confirm the selected drives to be formatted. Update flash ROM During the formatting process, the check boxes Updates the flash ROM on your ATTO host adapter using turn into status fields, displaying either a floppy diskette. The floppy disk can be created from the Formatting (blinking, red) or Completed for CD or from the latest download from the ATTO web site. each drive. You must boot into Windows or DOS to create the floppy. When the format is complete, a message box After creating the floppy disk, choose the Update Flash displays. ROM from the appropriate menu. The host adapter flash Close the message box is closed; the is updated automatically after you confirm that you want application returns to the main menu. to proceed with the task. If an error occurs during the formatting, an error message Display device list displays and formatting for the drive which has the error Displays all devices detected in the bus scan. Scroll the does not complete. Formatting continues on all other list to see all devices. drives. Reset defaults More than one disk drive may be formatted at one time as long as each supports the SCSI disconnect feature. Resets all host adapter settings to the manufacturer’s defaults. Save parameters and exit The Fibre Channel Configuration Utility presents Saves all changes you have made and exits the utility. The this function on an adapter basis. All channels are host reboots. affected. Discard parameters and exit The SCSI Configuration Utility presents this Discards all changes you have made, defaulting back to function on the Configure Adapter Channels dialog previous settings, and exits the utility. The host reboots. box and applies to currently selected channel. Configure Stripe groups Format disk drives If the adapter has been enabled to manage stripe groups, 1 Select drives to format by checking boxes for each drive. creates or deletes stripe groups. To create a stripe group, supply a stripe group name, specify an interleave size be specified, and select disks to stripe.

24 ATTO Utilities Installation and Operation Manual 2.1 FC BIOS Configuration Utility

Default NVRAM settings work for most applications, but your particular hardware configuration may require some changes. Fibre Channel host adapter NVRAM settings may be changed from the BIOS Configuration Utility. The Configure Adapter Channels menu selection • Auto: Allows the card to determine what kind of connection displays a dialog that contains the parameters for a to use, with no preferences specific adapter. The parameters vary by Fibre Current Boot Node Name Channel adapter. Displays the IEEE worldwide address assigned to the Adapter Node Name current boot device. Displays the IEEE (Institute of Electrical and Electronic Current Boot LUN Number Engineers World Wide Name unique to each adapter. Displays the LUN address assigned to the current boot Adapter Number device. Choices: Variable Device Discovery Default: 0 Choices: Node WWN, Port WWN Choices depend upon the number of Fibre Channel Default: Node WWN adapters installed in your computer and the number of Specifies the type of device discovery the adapter channels per adapter. If one single channel adapter is performs. Use the Port WWN when the adapter requires installed, 0 is the only choice. If two dual channel separate paths to a device and the device is dual ported. A adapters are installed, choices are 0, 1, 2 and 3. dual ported device has one path when the Node WWN is Class 2 Options specified and two paths when the Port WWN is specified. Choices: Disabled, ACK_1 Only, ACK_0 Capable Enable LUNs Default: Disabled Choices: Yes, No Select the appropriate option if you choose to take Default: Yes advantage of Class 2 Fibre Channel class of service. Specifies the Logical Unit Numbers (LUNs) for a Connect Speed particular ID. LUNs label multiple storage units that Choices: 1 Gb/sec., 2 Gb/sec., 4Gb/sec, Auto share the same ID. Disabling LUNs affects all target IDs Default: Auto connected to the host adapter. Selects the Fibre Channel transmission rate. If Auto If you are connecting devices that do not support LUNs, chosen, the adapter determines the rate based upon the select No. devices connected. Enable Selectable Boot Connection Mode options Choices: Yes, No Choices: AL, PTP, AL Preferred, PTP Preferred, Auto Default: No Default: AL Preferred Specifies a boot device to use other than BIOS device 80. Auto (ExpressPCI FC 3321, 3322, 3342) If you select yes, a screen listing the devices connected to • Arbitrated Loop (AL): Connects to either an FCAL Arbitrated the host adapter displays. Select the device from which Loop or a Fabric Loop Port (FL Port) on a switch. you wish to boot and press Enter. • Point-to-point (PTP): Connects to a direct Fabric connection, such as an F port on a switch. Execution Throttle • AL Preferred: Allows the card to determine what kind of Choices: 1-255 connection to use, but tries to connect in loop mode first, Default: 16 then point-to-point mode. Specifies the maximum number of concurrent commands • PTP Preferred: Allows the card to determine what kind of active for a port. Increasing this value may increase connection is to use, but tries to connect in point-to-point performance, but you may saturate a drive with mode first, then Loop mode. commands, decreasing performance.

25 ATTO Technology Inc. Frame Size Loop Arbitration Fairness Choices: 512, 1024, 2048 Choices: Yes, No Default: 2048 Default: Yes Changes the size of the FC packet of information being Loop arbitration fairness is an algorithm that ensures that sent. Typically, the initiator and target negotiates the all NL_Ports on an arbitrated loop have equal access to desired frame size, starting with the largest value. The the loop. Each L_Port has an arbitration priority assigned frame size should be set to the largest value for normal to it based on its AL_PA (arbitrated loop physical operation. However, some older devices may not address). The access fairness algorithm creates an access properly negotiate frame size: use Frame Size to window in which all L_Ports are given an opportunity to specify the size rather than permitting negotiation. win access to the loop, regardless of assigned priority. Hard Address Enable Some loops may require certain NL ports to have more Choices: Yes, No access to the loop than just one access per window. You Default: No may need to disable Loop Arbitration Fairness. When a Fibre Channel loop is initialized, each device Some Fibre Channel devices cannot execute arbitration selects and configures itself to an available ID. Hard fairness algorithms. If you have exhausted the obvious Address Enable permits the host to select the value configuration issues and drivers do not load or entered in the Hard Address field. performance is intermittent, change this setting. BIOS Loop Reset Delay Choices: Enabled, Scan Only, Disabled Choices: 0-255 Default: Disabled Default: 5 (sec.) If enabled and disk drives or a bootable CD are detected Specifies the amount of time before accessing a device during the bus scan, the BIOS driver remains resident. If after the previous access resulted in an error. Increase this disabled, the BIOS starts, resets the adapter chip and value if some of your devices are not recognized by the unloads the driver. system at startup. If Scan Only selected, the BIOS driver scans the bus and displays the devices attached, then unloads itself after a PCI Latency Timer Choices: 8, 16, 24, 32, 40, 48, 56, 64, 80, 96, 112, 128, 160, brief delay. 192, 224, 248 Interrupt Level Default: see below Displays the interrupt level assigned by the BIOS to the Specifies how long the host adapter maintains control of adapter. the PCI bus. Larger values allow the adapter to remain on the bus longer, improving performance, especially for Interrupt Coalesce large files. However, controlling the PCI bus for too long Choices: None, Low, Medium, High Default: Low can starve I/O to other devices, adversely affecting their Specifies the time period an adapter chip delays an performance. interrupt. This allows the adapter chip to queue up more As a default, the computer system firmware/BIOS than one interrupt before interrupting the CPU. When this automatically sets this value. However, adjusting the methodology is chosen there is less overhead to service value for the ATTO adapter overrides the system default, the interrupts. However, the coalescing time may delay allowing you to achieve specific performance results. the delivery of the completion for a single interrupt. Note I/O Address Displays the PCI slot in which this host adapter is Set the Latency timer to 32 for Media 100 installed. Finish PCI Memory Write/Invalidate IOCB Allocation Per Target Choices: Enabled, Disabled Choices: 1-512 Default: Disabled Default: 256 Setting to disabled overrides the host’s BIOS setting. Specifies the number of concurrent I/Os or commands that remain outstanding in the buffer.

26 ATTO Utilities Installation and Operation Manual 2.2 SCSI BIOS Configuration Utility

The default NVRAM settings work for most applications, but your particular hardware configuration may require some changes. SCSI host adapter NVRAM settings may be changed Select the Adapter Menu and the following from the BIOS Configuration Utility. menu displays The default NVRAM settings work for most Select Adapter Channels applications, but your particular hardware Configure Adapter Channels configuration may require some changes. Selectable Boot Device Update Flash ROM

Configure Adapter Channels menu The Configure Adapter Channels menu Initiator ID displays the parameters that are managed for the Choices: 0-15 specific adapter. The parameters available vary by Default: 7 SCSI family and the specific adapter within a The ExpressPCI SCSI adapter is normally set to SCSI ID family. 7 because ID 7 has the highest priority on the bus. The setting should remain at ID 7 unless you are instructed to Bus Reset Delay change it by an ATTO technical support representative. Choices: 0-255 (seconds) Default: 3 Interrupt Level Sets the time delay between the reset of the SCSI bus and Displays the interrupt level assigned by the BIOS to the the scanning of the SCSI bus. You may need to modify if adapter. devices require a longer time to respond following reset. I/O Address Channel Number Displays the PCI I/O memory address assigned by the Choices: Variable BIOS to the adapter. Default: 0 Max Single-Ended Sync Rate Choices depend upon the number of ExpressPCI adapters Choices: Variable by adapter type installed in your computer and the number of channels Default: 20 (Narrow)/40 (Ultra/Wide) per adapter. If one single channel ExpressPCI adapter is Specifies the maximum synchronous transfer rate to be installed, 0 is the only choice. If two dual channel negotiated when the adapter detects a Single-Ended SCSI adapters are installed, choices are 0, 1, 2 and 3. bus. The bus is Single-Ended when UltraSCSI devices are Firmware Version (Ultra320 only) connected to the bus. Displays the version of firmware loaded in onboard flash. PCI Burst Size (Ultra160, Ultra/WIDE only) BIOS Choices: Disabled, 8, 16, 32, 64, 128, 256 or 512 bytes Choices: Enabled, Scan Only, Disabled Default: 512 bytes Default: Disabled Sets the burst rate threshold for SCSI operations when If enabled and disk drives or a bootable CD are detected moving data across the PCI bus. during the bus scan, the BIOS driver remains resident. If PCI Bus Parity (Ultra160, Ultra/WIDE only) disabled, the BIOS starts, resets the adapter chip and Choices: Yes, No unloads the driver. Default: Yes If Scan Only is selected, the BIOS driver scans the bus Indicates if an interrupt should be generated for a PCI Bus and displays the devices attached, then unloads itself after Parity error. If you choose Yes, the interrupt is generated a brief delay.

27 ATTO Technology Inc. Quick Arbitrate & Select (Ultra320 only) Selection Timeout Choices: Disabled, Enabled Choices:25ms - 1 sec. (Ultra160, Ultra/WIDE) Default: Enabled 1ms - 1 sec. (Ultra320) Reduces the time required to gain control of the SCSI bus Default:250 ms if all target settings are set to Sync DT-IU and all devices Specifies the amount of time a device has to respond to on the bus support QAS. being selected. Lower the setting to speed up the boot process. If the value is lower than the recommended 250 Reset Bus on Startup ms, it may be too fast for some devices to respond. Choices: Yes, No Default: Yes SCSI device settings If enabled, the SCSI bus is reset upon adapter Select SCSI Device Settings and press Enter to initialization. If disabled, the SCSI bus is still scanned for display parameters for each SCSI Target ID. Set devices, but the bus is not reset. individual configuration parameters for each possible SCSI Termination SCSI target for the current adapter from the SCSI Choices: Automatic, High Target Parameter screen. The dialog box displays a Default: Automatic table with 16 rows, each representing a specific target ID for the SCSI bus attached to the selected channel. Set to Automatic unless there is narrow SCSI cable connected to either the internal or external connector.

SCSI Device Settings menu The SCSI Device Settings menu displays the Enable LUNs (Ultra320) parameters that are managed for the specific Choices: Disable ID, 0, 0-7, 0-63 adapter. The parameters available vary by SCSI Default: 0-7 family and the specific adapter within a family. Specifies the number of Logical Unit Numbers (LUNs) the driver addresses when scanning for devices. The Enable Disconnect number of LUNs to scan is determined as follows: Choices: Yes, No Default: Yes • Disable ID: Target ID is bypassed and not scanned • 0: Scan LUN 0 for this target ID Yes allows the device to disconnect from the SCSI bus during SCSI command processing. The device • 0-7: Scan LUNs 0 to 7 for this target ID determines when it disconnects. This setting does not • 0-63: Scan LUNs 0 to 63 for this target ID force the device to disconnect. Enable Synchronous SCSI Enable LUNs (Ultra160, Ultra/WIDE) Choices: Async, Sync ST, Sync DT, Sync DT-IU Default: Variable by adapter type Choices: Checked, Unchecked Default: Checked Specifies whether the selected target transfers data at Indicates if the associated LUN scanned by ATTO synchronous transfer rates or at the asynchronous rate. drivers. Each available LUN has a check box; the default The maximum synchronous rate to negotiate is specified has a check in each LUN check box. Remove the check in the Sync Rate parameter. mark to leave a LUN undetected. Changes may be Enable Wide SCSI discarded and replaced with factory default settings by Choices: Yes, No choosing Reset to Defaults. Default: Yes If enabled, the ExpressPCI adapter tries to transfer SCSI data in a Wide mode to all devices to aid compatibility with older, narrow devices that do not respond to Wide transfer negotiation. If the synchronous SCSI parameter is set to Sync DT or Sync DT-IU, only WIDE negotiation is permitted.

28 ATTO Utilities Installation and Operation Manual Sync Offset Sync Rate Choices:1-16 for PSC, PSCd, DC Choices: varies by adapter, see Exhibit 2.2-1 1-62 for UL3S, UL3D Default: varies by adapter, see Exhibit 2.2-1 1-127 for UL4S, UL4D, UL5D, UL5D-LP, If synchronous transfers are enabled, sets the maximum UL5D rate at which the ExpressPCI host adapter negotiates with Default:16 for PSC, PSCd, DC each device attached to it. Set the rate to the maximum 62 for UL3S, UL3D value supported by the host adapter. If excessive SCSI 127 for UL4S, UL4D, UL5D, UL5D-LP, UL5D errors occur, you have long cables or there are many CAUTION devices on the bus, you may want to reduce the Sync The default values offer the best Rate value. Slowing the transfer rate may increase the performance possible. Do not change this reliability of the SCSI bus. setting unless instructed by an ATTO technical support representative. Tagged Command Queuing Choices: Yes, No Default: Yes Specifies to the driver that SCSI commands can use the Tag Command feature. The driver can send multiple commands to a device when tag commands are enabled.

Exhibit 2.2-1 Sync rate parameters for various ATTO host adapters

Sync DT IU Sync DT Sync ST WIDE Sync ST Narrow Async UL4D, UL4S, UL5D, 320 UL5D-LP UL4D, UL4S, UL5D, UL3D, UL3S, UL4D, 160 UL5D-LP UL4S, UL5D, UL5D-LP UL3D, UL3S, UL4D, UL3D, UL3S, UL4D, 80 UL4S, UL5D, UL5D-LP UL4S, UL5D, UL5D-LP UL3D, UL3S UL4D, UL3D, UL3S, UL4D, All 40 UL4S, UL5D, UL5D-LP UL4S, UL5D, UL5D-LP 20 All All

10 All All SyncRate (MB/sec.)

5 All 5 NA All NA

29 ATTO Technology Inc. 30 ATTO Utilities Installation and Operation Manual 2.3 ExpressSAS BIOS Utility

The BIOS driver for the ATTO ExpressSAS host adapters has a built-in BIOS Utility which manages the adapter and the devices connected to the adapter. The ExpressSAS BIOS Utility uses a standard an item on the menu may bring up a secondary menu/choice model. The Main Menu presents menu or a dialog box. The dialog box displays the the functions available from the utility. Selecting items managed by that dialog box.

Access the SAS Utility

1 During the ExpressSAS BIOS driver startup 2The SAS BIOS Configuration Utility starts after the adapter boot string displays, press and displays the following menu Ctrl-Z at the prompt. If you do not press Ctrl-Z 1. Configure Adapter Settings within 3 seconds, you must reboot and try 2. Display Drive List again. 3. Configure RAID Groups 4. Exit

Configure Adapter Settings menu The Configure Adapter Settings menu Select the following functions from this menu: displays Boot Driver 1 Edit Adapter Settings: customizes the SAS Choices: enabled, scan only, disabled RAID Adapter settings. Default: disabled 2 Reset All Parameters to Defaults: resets the If enabled and disk drives are detected during the bus SAS RAID Adapter settings to the factory scan, the BIOS driver remains resident. If disabled, the default. BIOS starts, resets the adapter chip and unloads the 3 Save Settings and Return to Main: driver. If Scan Only is selected, the BIOS driver scans the permanently saves the adapter settings and bus and displays the devices attached, then unloads itself returns to the Main Menu after a brief delay. 4 Discard Settings and Return to Main: discards any changes to the adapter settings Device Wait Time and retains the original settings Choices: 1-255 seconds Default: 3 Selecting the Configure Adapter Settings This field specifies the number of seconds that the driver screen displays information about the waits for devices to appear. ExpressSAS RAID adapter, including: Device Wait Count Adapter #: allows you to select a specific Choices: 1-255 devices ExpressSAS RAID adapter from a list of installed Default: 1 ExpressSAS RAID adapters This field specifies the number of devices that must Model: displays the model number of the appear in order to cancel the Device Wait period. selected ExpressSAS RAID adapter. Heartbeat FW Version: displays the firmware version of the Choices: enabled, disabled selected SAS RAID adapter. Default: enabled When enabled, requires the firmware to respond to SAS Addr: displays the SAS Address assigned to periodic activity. If the firmware does not respond, the the ExpressSAS RAID adapter. system driver resets the firmware on the adapter.

31 ATTO Technology Inc. Port Configuration (R348 only) are active and the external connector is not active. The Choices: 8 Internal or 4 Intrn, 4 Extrn 4Intrn, 4Extrn indicates that one internal connector is Default: 8 Internal active and one external connector is active. Indicates the active port configuration for the ExpressSAS RAID R348 adapter. The 8Internal Reset to Defaults parameter indicates that the two internal SAS connectors Returns all settings to the factory defaults.

Display Drive List menu Selecting the Display Drive List menu displays a accessed and its activity light blinks. Select the list of all devices that are connected to the adapter following functions from this menu: with the following information for each: Show Drive Detail Adp# indicates the adapter number for the Type Enter or D to display more information about the ExpressSAS RAID Adapter to which the drive is highlighted drive. connected. Select Drive ID displays the drive ID number within the Type Space Bar to allow multiple drives to be selected. adapter. The selection is removed by typing Space Bar a second Vendor ID displays the drive manufacture’s time. vendor name Scan Product ID displays the drives’ product name Type S to clear and refresh the drive list. Capacity displays the drive’s byte capacity RAID Group contains the name of the RAID Clean Group to which the drive is assigned. The field Type C to clean all metadata from the selected drives. may be blank or can indicate a RAID Group name Drives must be selected by typing Space Bar. or Hot Spare status. Hot Spare Member State displays the drive’s current state Type H to assign the selected drives to the Hot Spare The Display Drive List menu highlights the pool. Drives must be selected by typing Space Bar. first drive in the list. Use the up and down arrows Remove Spare to highlight other disks. The highlighted drive is Type R to remove the selected drives from the Hot Spare pool. Drives must be selected by typing Space Bar.

Configure RAID Groups menu Selecting the Configure RAID Groups menu View Selected RAID Group displays a list of all detected RAID Groups with Type Enter to display more information about the the following information for each: highlighted RAID group.If a RAID group is rebuilding, Group Name: RAID group name the command displays the completion percentage of the rebuild. Drives: number of drives in the RAID group Capacity: the RAID group’s total capacity Create Status: the RAID group’s current status Type Insert to build a new RAID group. RAID Level: the RAID group’s RAID level Delete The Configure RAID Groups menu highlights Type Delete to delete the highlighted RAID Group. A the first RAID group in the list. Use the up and confirmation prompt must be answered. down arrows to highlight other RAID groups. Select the following functions from this menu:

32 ATTO Utilities Installation and Operation Manual Rebuild 2 Select a RAID level: RAID 0, RAID 1, RAID 4, Type R to rebuild the highlighted RAID group. A RAID 5, RAID 10 or JBOD confirmation prompt must be answered to start the 3 Select an Interleave: 8KB, 16KB, 32KB, 64KB, rebuild. 128KB, 256KB, 512KB or 1MB. 4Type Insert to add drives into the RAID group. Partition Type P to change the current partitions of the RAID 5 A drive list box of available drives is displayed. Press the Space Bar to select the drives to group. The Partition function can split a selected partition include in the new RAID group. The selected or merge two partitions. Partitions that are currently drives are highlighted. mapped cannot be split or merged. 6Type Enter to create the RAID Group. Map RAID Groups CAUTION Type M to map or remove mapping of selected partitions. You may select automatic mapping of all unmapped A rebuild occurs after creating a RAID partitions, map or remove mapping from specific Level 4 or RAID Level 5 group, The length partitions, or remove mapping from all partitions. of time required for the rebuild depends upon the size of the RAID group. Do not Create a RAID group reboot the adapter until the rebuild process Selecting Create RAID Group starts a wizard. is complete. 1 Type a RAID group name 7Type Enter to map the partitions of the new RAID group.

33 ATTO Technology Inc. 34 ATTO Utilities Installation and Operation Manual 3.0 ATTO Utilities for Windows

The ATTO Utilities for Windows is a collection of programs that provide adapter management, device management and SAN management. These utilities execute on the Windows 2000/XP/Vista/Server 2003 for x86 and x64 platforms. The ATTO Utilities for Windows are included in Alamode configures disk mode pages the CD that was delivered with your adapter. Bench32, a disk benchmark program, measures The suite content varies according to the adapter disk performance purchased. The Fibre Channel specific utilities are SNIA FC AP installs the ATTO Vendor library not present in the SCSI suite and the SCSI specific needed to access the SNIA metrics for ATTO FC utilities are not present in the FC suite. adapters An easy-to-use HTML-based menu is launched FC LUN Masking selects devices on a SAN visible automatically upon inserting the CD in your to the system system CD-ROM drive. The adapter tools can be SCSI Domain Validation tests the connection installed from this menu. between an adapter and the devices on the SCSI bus Configuration Tools ATTO provides a full suite of configuration tools ExpressPCI Setup Utility sets up the NVRAM and supplemental utilities to enhance the parameters for SCSI ExpressPCI adapters, performance of ATTO host adapters. The suite is especially the UL3 adapter family comprised of the following utilities.

35 ATTO Technology Inc. 3.1 Configuring Mode Pages: Alamode Utility

Alamode.exe is a Windows utility to optimize disk drive performance by configuring mode pages without requiring specific knowledge of mode page parameters. A mode page or mode parameter page is a group Notes of related settings or parameters that govern • You cannot optimize IDE drives because they certain aspects of how a disk drive operates. Most don’t have mode pages. drives come from the factory set for maximum • You cannot optimize drives that are striped in a compatibility to work safely and reliably with the RAID group. You may optimize the drives widest range of hosts and systems. However, before striping them, or break up the group into these out-of-the-box settings may disable some individual drives, optimize them, and then high-performance features that your ATTO host rebuild the group. The second method, however, adapter could use. Depending on your destroys any data on the existing RAID volume. requirements, mode pages can be configured to • If you plan on formatting the drive and setting affect performance, computability, data integrity its mode pages, set the mode pages first using and other characteristics. Alamode. Alamode optimizes all mode pages at once. You Using Alamode do not have to select which pages to optimize or 1 Launch the application. which parameters to optimize. Changing mode 2 Select the drive you want to optimize. page settings is quite safe. However you may 3 Click the button corresponding to the type of change the drive’s mode pages back to Factory application that the drive uses: Defaults without losing data. • Digital Video • Pre-press • Default (return the drive to its factory default settings) You should shut down and restart the system before continuing to use the drive to ensure that the drive behaves according to the new settings.

Exhibit 3.1-1 The Alamode screen.

36 ATTO Utilities Installation and Operation Manual 3.2 ATTO Disk Benchmark

The ATTO Utilities for Windows suite includes a utility f to measure peak and sustained throughput for disk reads and disk writes. The ATTO Disk Benchmark measures peak and Benchmark fields sustained throughput for disk reads and writes. The benchmark fields include. 1 Launch the application. • Drive: Select the logical drive to benchmark. A test 2 Select the drive letter for the disk to benchmark. can be performed on any system drive. 3 Select the transfer sizes to test. • Transfer Size: Select the range of transfer sizes used 4 Select the I/O option. for reading and writing data to the test drive. Transfer speeds are displayed for each size in the range. If the 5 Click the Start button. first size is greater than the second size, the test is not 6 Wait for benchmark to run through the desired performed for any transfer size. transfer sizes. • Total Length: Select the total size of the data file to be 7The Test Results Display at the bottom of the created on the test drive. This file is deleted when window is updated as the test progresses. The y-axis testing completes. of the graph represents the transfer sizes in the • Direct I/O: If this option is checked, file I/O on the test selected range. The x-axis represents the transfer drive is performed with no system buffering or speeds in MB/sec. I/O speeds in KB/sec. for each caching. Combine this option with Overlapped I/O for transfer size are displayed textually to the right of the maximum asynchronous performance graph. • Radio Button Group 8 Click the Stop button to stop the test. • Overlapped I/O performs queued I/O. Upon selection, When the test completes, the results can be the Queue Depth option displays to select the saved or printed. maximum number of read or write commands that If errors were detected, a dialog box displays may be executed simultaneously. the errors in a table with the following four • I/O Comparison compares the data read from the test columns and a button: file to the data written on a per block basis. You can • Benchmark Transfer Size: transfer size at which select the data pattern for comparison from the Test the error occurred Pattern dropdown box. • Buffer Index: index into the data block at which • Run Continuously runs the test continuously for a the error occurred. specified number of minutes. The test stops before the specified time if any errors are detected. • Actual Value: the value read from the file. • Neither: Select if you do not want to perform • Expected Value: the value written to the file. overlapped I/O or I/O comparisons. • Log to File: Logs the error table to a *.log file and closes the dialog. The file is given the same name The following fields do not affect the benchmark but as the test file and saved in the same directory. If are informational, providing documentation of the test the test was not previously saved, errors are environment. logged to the generic file Bench32Error.log in the • Stripe Group: If the test drive is a stripe group, select root of the test drive. If the log file already exists, its name from the list box. The names and quantities the new errors are appended to the previously of drives in the stripe group are printed to the recorded errors. This is the only way to save Description box. Select Clear to clear the contents of detected errors. They are not saved in the test the Description box. document file. • Controlled by displays all ATTO host adapters on the If the I/O comparison option was selected and system. errors were not detected, the message No • Description: Enter additional information about the errors detected is displayed. test that can be saved or printed. Be sure to enter additional information after making a selection from Note the Stripe Group dropdown box, as this erases the Additional information on using Bench32 is current description. available by accessing the Help menu in the application.

37 ATTO Technology Inc. Performing multiple benchmark tests further tests from being executed. Error logging is the The ATTO Disk Bench supports four command line same as the command line parameter testfile, but all parameters for uninterrupted testing: errors generated from all tests in the list are logged to testfile opens and executes the test named testfile one file: textfile.log. with the extension .bmk or .tst (older versions of /p testfile: Same as testfile, only the test is printed to Disk Bench). the default system printer instead of being executed. textfile opens the text file named textfile. This file /p textfile: Same as textfile, only the tests in the list contains a list of test file names that have an extension are printed to the default system printer instead of of .bmk or .tst. Each test in this list is opened and being executed. executed in order. Stopping one test in the list prevents

Exhibit 3.2-1 The Bench 32 window before and after a test has been run.

38 ATTO Utilities Installation and Operation Manual 3.3 FC LUN Masking Utility

ATTO host adapter drivers allow you to select which devices and Logical Unit Numbers (LUNs) on a SAN are visible to Windows operating systems. Many devices, including RAID controllers and 3 Enter the Node Name (WWN) of the device or SCSI-to-Fibre Channel bridges, use LUNs to select a WWN from the drop down box allow access to multiple drive units through a 4 Select the type of WWN to use. single World Wide Name (WWN). However, you 5 Click OK. may not want to allow all users connected to one 6 The device name displays in that adapter’s device to have access to all devices. The ATTO Device List on the bottom half of the main LUN masking utility allows you, as the window. Click the Save Changes button on the administrator, to select which LUNs each user bottom of the windows. may access, allowing greater flexibility in Use the Edit LUN Mask Dialog box configuring a Fibre Channel SAN. 1 Double click the WWN of the device you wish to The utility gives information, allows you to add a edit in the Devices List or select it and click the new device to an adapter or allows LUN masking Edit LUN Mask button. If you do not see the device listed, you may need to add it. using three windows: 2Select Mask all LUNs or Mask LUN List to Main Window monitors and manages all LUN enter the specific LUNs you wish to mask. masking functions. The screen is divided into two 3 When you have completed configuring the LUN sub-sections: Adapters and Devices. mask for this device, click the OK button. • Adapter List displays information about all the Save and apply your changes adapters detected or configured on this system. 1 Click the Save Changes button on the bottom The first column displays the WWN of the of the windows. adapter. If the adapter is installed, the second column displays the model of the adapter if it is Note installed. Clicking on an adapter in the adapter You must have Write Access to the registry list updates the device list. key and all its sub-keys to save changes. • Device List displays information about all Consult your system administrator if you devices detected or configured for the adapter cannot save changes. selected in the adapter list. 2 If you want the changes to take effect The first column displays the Node WWN. The immediately, click the Apply Changes button second column displays the current LUN mask before exiting but after saving. This causes the configuration. If no LUNs are masked, the word driver to reread the registry settings and alter its none displays in this column. If the entire device internal device database. is masked, the word all displays. Note Add a new device to an adapter If Windows is unable to see devices or LUNs 1 Select the adapter in the Main Window adapter that you have just un-masked, you may need list. to reboot the system. 2 Click on the Add Device button at the bottom of In Windows 2000, you may need to run the screen Windows Volume Manager to see devices that you have just un-masked.

39 ATTO Technology Inc. Exhibit 3.3-1 ATTO LUN Masking Utility screen.

40 ATTO Utilities Installation and Operation Manual 3.4 SNIA FC Host Adapter API

API, or Application Programming Interface, is a set of commands used by an application directing the operating system to perform certain tasks. ATTO host adapters use API Version 1.0 as ATTO host adapters support the API on Windows defined by the Storage Network Industry XP/2000/Server 2003/Vista systems. Association (SNIA) Fibre Channel Work Group. The API has two major parts: the ATTO library The Common HBA API Version 1.0, released in and the registry key. October 2000, is a vendor-neutral format for The registry entry is made in reporting information about host adapters to KEY_LOCAL_MACHINE\Software\SNIA and upper level software applications. It is commonly points to the location of the ATTO library. used in applications that provide the following The ATTO vendor library is installed in the same • query information about adapter properties and location as the ExpressFC driver. A related port information component, the common library, is provided by • query information about attached storage the SAN-aware application provider. resource • event notification.

41 ATTO Technology Inc. 42 ATTO Utilities Installation and Operation Manual 3.5 Domain Validation Testing

Domain Validation tests the physical connection between host adapter and devices to ensure that the desired data transfer speeds can be achieved. Domain Validation verifies that the connection significantly degrading SCSI bus signals and thus between the host adapter and storage devices (i.e. lowering the signal margins. This can result in cables, connectors, targets, etc.) is capable of sudden subsystem failure or intermittent integrity handling high-speed data transfers. errors. The ATTO SCSIDV utility performs Domain Validation on your storage connection. The three Run the SCSI Application DV tests can be selected in the SCSIDV Main 1 Launch the application Screen. 2 Select the SCSI bus adapter channel Basic Integrity Test performs a simple integrity 3 Select the test(s) to be run check to determine the fastest valid mode of 4 Select the negotiation parameters located in operation between initiator and target, detecting the Fallback Scheme grouping. The SDV test most physical configuration problems such as starts with the highest values and, if a problem is detected, tests with the next lower set of • path width errors values. • expander errors 5 Select the target device(s). The test is • gross cable errors performed between the initiator and each target • incorrect termination device selected. • damaged transceiver 6 Press the Start button. Enhanced Integrity Test performs a more advanced integrity check. A data pattern intended When the test is complete, a message panel to stress the physical domain is written to and then displays. The panel shows the negotiated SCSI read from memory on the device and compared parameters for each device. The left side of the with the original data pattern. If data compare screen shows the negotiated value after the test errors are detected, fallback is attempted until a runs and the right side shows the value before the valid mode of operation is found. test being run. Problems detected include The column labeled Changed? indicates if the negotiated value changed as a result of the tests. If • cables with incorrect impedance the value changed, the connection between the • bad SCSI device spacing • poor termination initiator and the target device may not have been • marginal transceivers optimized. • excessive crosstalk The application help text provides useful • excessive system noise information about setting up the tests. Review the Margining Test varies driver signal strength by help text for more detailed explanation of the +/- 20% and verifies the integrity of the application. subsystem. Failure indicates that the subsystem is close to failure because inferior components are

43 ATTO Technology Inc. Exhibit 3.5-1 The Domain Validation Utility screen.

44 ATTO Utilities Installation and Operation Manual 3.6 ExpressPCI SCSI Setup Utility

The ExpressPCI Setup Utility changes the same NVRAM parameters as described for the ATTO Configuration Tool earlier in this manual. The ExpressPCI Setup Utility must be used for 3 Make the desired changed to the IDs. Multiple the UL3 family of adapters to change NVRAM IDs can be modified simultaneously using the parameters. buttons at the bottom of the Main Menu. Specific IDs may also be selected using the Modify NVRAM settings CTRL and SHIFT keys while left-clicking with the mouse. 1 Locate the ExpressPCI Setup Utility Additional information on using SCSI Utility is application icon on your hard drive. available by accessing the Help menu in the 2 Double-click the icon to start the application. application. 4 Save your changes and exit the application.

Exhibit 3.6-1 The SCSI Setup Utility screen.

45 ATTO Technology Inc. 46 ATTO Utilities Installation and Operation Manual 3.7 Troubleshooting

The following suggestions may help if you are having problems. • Using the Device Manager, ensure that all • If you are installing a SCSI boot drive, check drives are visible to the operating system. your CMOS setup and verify that your DRIVE • If drives are not visible, check all cable TYPE is set to NOT INSTALLED. connections and terminations on each device. • Have you partitioned your drive, and then • Make sure that each device is powered up and activated that partition? has completed its self check before booting your • Did you format the drive for your operating machine. system? • Reboot your system any time you make changes If problems persist, contact your ATTO to a stripe group. Technology technical support representative. • As a last resort, you may use the ATTO Boot Configuration Utility to low level format a troublesome device. However, this erases all information on the disk.

47 ATTO Technology Inc. 48 ATTO Utilities Installation and Operation Manual Appendix A CLI provides an ASCII-based interface

The command line interface (CLI) uses ASCII commands typed while in CLI mode. • Commands generally have three types of CAUTION operation: get, set and immediate. Do not use CLI unless you are directed to • The get form returns the value of a parameter or by an ATTO technician. setting and is an informational command. Changing parameters may cause loss of • Responses to get commands are followed by data and/or disruption to performance and Ready. reliability of the ExpressSAS Host Adapter. • The set form is an action that changes the value of a parameter or configuration setting. It may The ATTO Configuration Tool interface is require a SaveConfiguration command and a the preferred method to operate and restart of the system before it is implemented. manage the ExpressSAS Host Adapter. The restart can be accomplished using a Refer to SAS RAID settings on page 13 for separate FirmwareRestart command. A details. number of set commands may be issued before The command line interface (CLI) is a set of the SaveConfiguration command. ASCII-based commands which perform • Responses to set commands are either an error message or Ready. *. The asterisk indicates configuration and diagnostic tasks. Refer to SAS you must use a SaveConfiguration command RAID settings on page 13. to finalize the set command. • CLI commands are context sensitive and • Set commands which do not require a generally follow a standard format SaveConfiguration command, defined as immediate commands, are immediately [Get|Set] Command [Parameter1|Parameter2] executed. followed by the return or enter key • CLI commands are case insensitive: you may Note type all upper or all lower case or a mixture. Using certain CLI commands during normal Upper and lower case in this manual and the operation can cause a performance drop. help screen are for clarification only. Once command actions are complete, performance should return to normal levels.

Exhibit A-1 Symbols, typefaces and abbreviations used to indicate functions and elements of the command line interface used in this manual.

Symbol Indicates [ ] Required entry < > Optional entry | pick one of - a range (6 – 9 = 6, 7, 8, 9) BlockDevID index designation of a block device not assigned to any other RAID group; the index of a block device provided by the BlockDevScan CLI command. 0<=n<=63 DevIndex index designation of the RAID member GroupName the name of the RAID group to which the block device is assigned, or blank if the block device is available MemberIndex index designation of a RAID group member PartID index designation of a partition as found in the PartitionDisplay command tid Target ID 0<=n<=255

i ATTO Technology Inc. CLI error messages The following error messages may be returned by the Command line Interface ERROR. Invalid Command. Type 'Help' for command list. ERROR. Wrong/Missing Parameters Usage: ERROR Invalid RAID Group state ERROR Invalid Block Device index ERROR Invalid RAID Member index ERROR Maximum number of RAID Groups exceeded ERROR Insufficient number of RAID Group members ERROR Block Device at specified index no longer available ERROR Insufficient RAID Group members for RAID type

CLI summary The following chart summarizes the Command CAUTION Line Interface commands, their defaults, and an Do not use CLI unless you are directed to example of how to enter the commands. by an ATTO technician. Commands which have no default values have a blank entry in that column of the table. Changing parameters may cause loss of data and/or disruption to performance and reliability of the ExpressSAS adapter.

Command Default Example AutoMap automap AutoResume all enabled set autoresume erase disabled BlockDevClean blockdevclean 30 BlockDevIdentify blockdevidentify 30 BlockDevIDStop blockdevidstop BlockDevScan blockdevscan BootDelay 0 set bootdelay 125 ClearEventLog cleareventlog Date set date 03/03/2003 DefaultInterleave 128 set defaultinterleave 64 DeleteAllMaps deleteallmaps DriveTest drivetest begin DriveTestConfig not initiated set drivetestconfig read DriveTestList drivetestlist all DriveTestStatus get driveteststatus DumpConfiguration dumpconfiguration DumpEventLog dumpeventlog EventLog enabled set eventlog disabled ii ATTO Utilities Installation and Operation Manual Command Default Example EventLogFilter all all all set eventlogfilter gen info all Help help eventlog HSAdd hsadd 3 HSDisplay hsdisplay HSRemove hsremove 3 Info info IsReserved isreserved Metrics metrics display all Partition partition alpha1 6 4 GB PartitionDisplay partitiondisplay alpha1 PartitionMerge partitionmerge all PartitionSplit partitionsplit alpha1 22 2 RAIDCommandTimeout 30000 raidcommandtimeout 10000 RAIDRebuildPriority same set raidrebuildpriority low Reserve reserve RestoreConfiguration restoreconfiguration default RGAddStorage rgaddstorage g1 span commit RGCancelAddStorage rgcanceladdstorage g1 RGCommit rgcommit all RGCreate rgcreate g1 raid0 RGDisplay rgdisplay all RGErase rgerase g1 RGHaltConversion rghaltconversion g1 RGHaltErase rghalterase g1 RGHaltRebuild rghaltrebuild g1 RGMemberAdd rgmemberadd g1 22 RGMemberRemove rgmemberremove g1 22 RGRebuild rgrebuild g1 RGResumeConversion rgresumeconversion g1 RGResumeErase rgresumeerase g1 RGResumeRebuild rgresumerebuild g1 RGSpanDepth 1 set rgspandepth g1 22 RGSpeedRead disabled set rgspeedread g1 enabled RGUnmap rgunmap g1 RGWaitTimeout 3 rgwaittimeout 30 RMState set rmstate g1 online RMStatus rmstatus g1 Route route 1 raid alpha1 6 RouteDisplay routedisplay 03 124 SASTargets sastargets SaveConfiguration saveconfiguration SerialNumber get serialnumber Time set time 03:32:30 TimeZone EST set timezone pst VerboseMode enabled set verbosemode disabled iii ATTO Technology Inc. Command Default Example VirtualDriveInfo virtualdriveinfo WrapEventLog enabled set wrapeventlog disabled

CLI command explanations Command Line Interface commands are listed BlockDevIdentify alphabetically with explanations of what they are Causes the I/O LED of the drive to illuminate for one used for, their defaults and syntax. minute if it is accessible.

CAUTION CAUTION Using CLI without contacting an ATTO The BlockDevIdentify command is technician is not recommended because intended for diagnostic purposes only. changing parameters may cause loss of Executing this command may adversely data and/or disruption to performance and impact the performance and throughput reliability of the ExpressSAS adapter. of the ExpressSAS adapter for the time that the LED is illuminated.ts port. AutoMap BlockDevIdentify [BlockDevID | MemberIdx] Automatically maps a subset of source protocol LUNs to a subset of target destination devices visible to the unit. BlockDevIDStop The unit reports a 5-second delay while it scans for Turns off the IO LED of a previously identified disk devices. Pre-existing maps are not deleted. drive. AutoMap BlockDevIDStop

AutoResume BlockDevScan Regulates the automatic continue feature for interrupted Lists all currently connected physical drives along with rebuild, erase and write pattern operations at startup. If any potential RAID group association. Each block device AutoResume is enabled, all interrupted rebuild, erase listed is assigned a unique index at the time of the scan to and write pattern operations are continued at startup. If no identify drives for other CLI operations. The optional GroupName is specified, all existing RAID groups are flush parameter forces rediscovery of all block devices affected. and forces all existing RAID groups offline until member Default: all disabled block devices are discovered. set AutoResume [Rebuild | Erase | Write Pattern | all] [enabled BlockDevScan | disabled] BootDelay BlockDevClean Regulates the delay (in seconds) which the unit waits Removes any RAID configuration data from the block after startup before allowing hosts to detect discovered device with the specified BlockDevID. targets. The value 0 constitutes no delay.

CAUTION Default: 0 set BootDelay [0 | 15 | 30 | 45 | 60 | 75] All RAID group setup information is lost get BootDelay therefore all data is lost. Back up your files before performing this command. ClearEventLog BlockDevClean [BlockDevID] Clears the contents of the event log. No new entries are recorded until ClearEventLog has completed. ClearEventLog

iv ATTO Utilities Installation and Operation Manual Date DriveTestList Regulates the current date for this unit. The date range is Specifies drives to be run in the next drive test including 01/01/2000 to 12/31/2099. drives which are not part of a RAID group and not Hot set Date [MM] / [DD] / [YYYY] Spares. The all parameter automatically chooses eligible get Date drives. The test is not started until the DriveTest Begin command is given. DefaultInterleave set DriveTestList [drive [BlockDevID] | all] Assigns or retrieves the system-default interleave size for get DriveTestList new RAID groups, where the interleave size is expressed as the number of 512-byte blocks. If an interleave size is DriveTestStatus not explicitly specified when a RAID group is created, Displays the status of the currently running drive test but then the DefaultInterleave value is used. does not display performance metrics. If a block device ID is not running or cannot be found, its state is idle and CAUTION percent complete is 0. Changing the default interleave size may get DriveTestStatus degrade performance. Default: 128 DumpConfiguration set DefaultInterleave [16 | 32 | 64 | 128 | 256 | 512 | 1024 | 2048 ] Displays a unit’s configuration to the management get DefaultInterleave interface. DeleteAllMaps DumpConfiguration Removes all mapped devices from the map table. Upon the subsequent POST, if no maps are present the default DumpEventLog maps are loaded. Dumps the contents of the entire event log to the management interface. No events are recorded until the DeleteAllMaps command has been completed. DriveTest DumpEventLog Regulates a drive test with the previously specified configuration (refer to DriveTestConfig ) and drive list EventLog (refer to DriveTestList ). Drives being tested are not Regulates event logging. When enabled, records various available for RAID configuration or RAID operations. system errors to the event log. Only one test can be run at a time. Default: enabled set EventLog [enabled | disabled] DriveTest [Begin | Cancel] get EventLog DriveTestConfig EventLogFilter Configures the next drive test to perform one of the Filters data from specific unit subsystems and levels following operations: The test is not started until the when event logging is enabled. The specific entries DriveTest Begin command is given. supported are platform-dependent. For set commands, the init: initialize, destructive, write-only final parameter indicates whether or not events from the read: non-destructive, read-only specified subsystem and level are displayed. verify: destructive verify init-verify: destructive write-read-verify Default: all all all set DriveTestConfig [init | read | verify | init-verify] set EventLogFilter [subsys | all] [event level | all] [all |none] get DriveTestConfig get EventLogFilter [subsystem] [level]

Help Displays a list of available commands. If command name is specified, displays detailed command-specific information. Help v ATTO Technology Inc. HSAdd PartitionMerge Assigns a Block Device to the Hot Spare pool. Combines the specified contiguous partitions into one HSAdd [BlockDevID] partition. PartIdx is the index of a partition as found in PartitionDisplay . All indicates that all partitions in the HSDisplay RAID group are merged into a single Virtual Disk. The Lists all devices in the Hot Spare pool. RAID group must not be in a NEW state. None of the partitions to merge may be mapped. HSDisplay PartitionMerge [GroupName] [[[PartIdx] [2-128]] | All] HSRemove Removes a Block Device from the Hot Spare pool PartitionSplit Divides the specified partition into one or more partitions HSRemove [BlockDevID] whose capacities are evenly distributed among the capacity of the original partition. The partition to split Info cannot be mapped and the RAID group must not be in a Displays version numbers and other production NEW state. information for key components. PartitionSplit [GroupName] [PartIdx] [1-128] Info RAIDCommandTimeout IsReserved Specifies the maximum time in milliseconds that RAID Displays the reservation status of the current unit. commands to physical destination devices are allowed to IsReserved remain outstanding before they are aborted.

Metrics CAUTION Controls the collection of standard data metrics within a If you set this value too low, failures may product based on the command parameters. occur during normal operation. Metrics [Start | Stop | Display] [drive [BlockDevID] | all | running] Default: 30000 set RAIDCommandTimeout [100 - 3600000] Partition get RAIDCommandTimeout Creates a specified partition to the specified capacity in Gigabytes (GB), Megabytes (MB), or blocks. The RAIDRebuildPriority specified capacity must be smaller than the specified Sets or displays the RAID rebuild priority. A RAID partition’s current capacity. A new partition is created to rebuild priority set to high gives higher priority to RAID acquire the remainder of the original partition’s space. rebuilds and lower priority to the processing of VirtualDriveInfo displays characteristics and statistics simultaneous I/O transactions. A RAID rebuild priority for all the available virtual drives or any available virtual set to low gives lower priority to the rebuild and a higher drive identified by its virtual drive ID. priority to I/O transactions. Set same, the RAID rebuild and processing of I/O transactions is the same. Partition [GroupName] [PartIdx] [capacity] [GB | MB | blocks] Default: same PartitionDisplay set RAIDRebuildPriority [high | low | same] Lists all the partitions available in the specified RAID get RAIDRebuildPriority group. The partitions are listed contiguously (as opposed Reserve to index order). Reports the state of CLI reservation for the current CLI PartitionDisplay [GroupName] session. If the command reports that Reservations are enabled, then another CLI session has control of parameter modification on the unit. Reserve

vi ATTO Utilities Installation and Operation Manual RestoreConfiguration RGDisplay Issued with the default option, forces the unit NVRAM Displays status information for a single RAID group, or if settings to their original defaults. The saved option All is used, all available RAID groups. undoes any changes made to this session since the last RGDisplay [GroupName | all ] save. RestoreConfiguration [Default | Saved] RGErase Erases the data from the specified existing RAID group. RGAddStorage Adds additional storage to an existing RAID group. CAUTION Mirror|Stripe|Span specifies the method used to All data is lost if you use the RGErase expand the storage. Optional parameter commit command. specifies that the RGCommit command is run RGErase [GroupName] automatically. RGHaltConversion Note Stops the conversion on the specified existing RAID Mirrors cannot be added to a RAID 5 group. group. RGAddStorage [GroupName] [Mirror | Stripe | Span] RGHaltConversion [GroupName] RGHaltErase RGCancelAddStorage Stops the erase on the specified existing RAID group. Cancels the RGAddStorage command. RGHaltErase [GroupName] RGCancelAddStorage [GroupName] RGHaltRebuild RGCommit Stops the rebuild(s) on the specified existing RAID Stamps a NEW RAID group’s configuration to its group. MemberIndex specifies the RAID member whose member drives. After this command, a RAID group can rebuild is stopped. If no MemberIndex is specified, all be considered operational and transitions from the NEW rebuilds on that RAID group are stopped. state to the Online, Degraded, or Offline state depending on the health of the selected member drives. RGHaltRebuild [GroupName] RGCommit also stamps an existing RAID group’s RGMemberAdd configuration to its member drives as storage is being Adds up to 10 available block devices to a new RAID added. If the init option is specified, previous user group (the RAID group cannot have been saved using the configuration information is erased from each member RGCommit command). If all is specified, then all drive. unused blocks will be added to the RAID group until the RGCommit [GroupName | all] [init] maximum number of RAID group members has been met. The command resets the number of RAID group RGCreate partitions to 1. Creates a new empty RAID group. The optional value after the RAID group type parameter represents the RGMemberAdd [GroupName| all] [BlockDevID] desired interleave for the RAID group, where the RGMemberRemove interleave size is expressed as the number of 512-byte Removes a RAID member from a new RAID group (the blocks. If this value is not provided then the system- RAID group cannot have been saved using the default interleave size is used (refer to RGCommit command).Resets the number of partitions DefaultInterleave ). to 1. RGCreate [GroupName] [RAID [ 0 | 1 | | 4 | 10 | 5 ] | JBOD] <16 RGMemberRemove [GroupName] [BlockDevID] | 32 | 64 | 128 | 256 | 512 | 1024 | 2048 >

vii ATTO Technology Inc. RGRebuild RGWaitTimeout Rebuilds the specified existing RAID group. If no Regulates the maximum time in seconds that the system member is specified, all degraded members are rebuilt. waits to discover previously-configured RAID groups Optional parameter BlockDevID allows an available attached to the unit. The timeout is used during system block device to be substituted for the RAID Member boot time and when the BlockDevScan command is currently assigned to the MemberIndex. issued. RGRebuild [GroupName] Default: 5 set RGWaitTimeout [1-3600] RGResumeConversion get RGWaitTimeout Continues the stopped conversion on the specified existing RAID group. RMState Regulates the state of the specified existing RAID group RGResumeConversion [GroupName] member(s). The RAID group may not be in the new state. If no MemberIndex is specified, the status of all members RGResumeErase of the specified RAID group is set. Continues the erase on the specified existing RAID group. Note RGResumeErase [GroupName] Members undergoing rebuild are not changed. Rebuilds on these members must first be RGResumeRebuild stopped. Continues the rebuild(s) on the specified existing RAID set RMState [GroupName] [Online | Degraded group. If no MemberIndex is specified, all stopped | Unavailable | Faulted] rebuilds on that RAID group are continued. RGResumeRebuild [GroupName] RMStatus Displays the status of all RAID group members within the RGSpanDepth specified RAID group or a specific RAID member within Regulates the span depth on the specified existing RAID the specified RAID group. group. The RAID group must be RAID Level 0, RAID RMStatus [GroupName] Level 1, RAID Level 5, or RAID Level 10. Default: 1 Route set RGSpanDepth [GroupName] [SpanDepth [1-32]] Assigns a host protocol address to a target partition. If you get RGSpanDepth [GroupName] try to map a new partition to the same host LUN, the previous map is overwritten. Use the Delete identifier to RGSpeedRead remove the map. In verbose mode, overwriting a map Performs look-ahead during reads from RAID group requires a secondary confirmation of the action. member disks for all or the specified RAID group. Route [host] [tid] [RAID] [GroupName] [Partidx] ] | Delete] Default: disabled set RGSpeedRead [GroupName | all] [enabled | disabled] RouteDisplay get RGSpeedRead [GroupName | all] Displays a list of host protocol address to target destination device mappings. RGUnmap Removes all mapped partitions for a RAID group from RouteDisplay [host] the routing table. The partitions themselves are unaffected but they are inaccessible to initiators. SASTargets Lists the physical devices that are connected to all SAS RGUnmap [GroupName | all] ports. SASTargets

viii ATTO Utilities Installation and Operation Manual SaveConfiguration TimeZone Issued with the restart option, cycles unit power after Controls or displays the time zone or an offset from GMT saving configuration changes. The norestart option for the unit. saves changes without restarting. Default: EST set TimeZone [[EST | CST | MST | PST] | [+/-HH:MM]] Note get TimeZone Certain modifications require a system restart. SaveConfiguration VerboseMode Controls the level of detail in CLI Help output and SerialNumber command response output. Reports the unique serial number for the unit using a 13- Default: enabled character field. The first seven alphanumeric characters set VerboseMode [enabled | disabled] represent the product name; the last six digits are the get VerboseMode unit’s unique number. VirtualDriveInfo get SerialNumber Displays characteristics and statistics for all the available virtual drives or any available virtual drive identified by Time its virtual drive ID. Controls or displays the current time as clocked by the unit in 24 hour format. VirtualDriveInfo set Time [HH: MM: SS] WrapEventLog get Time When enabled, the unit logs up to 2,048 event entries before wrapping (overwriting the first entries). If disabled, the unit stops logging event entries when the buffer is full. Default: enabled set WrapEventLog [enabled | disabled] get WrapEventLog

ix ATTO Technology Inc. Appendix B Contact ATTO Technology, Inc. Customer service, sales information and technical support are available by phone Monday through Friday, Eastern Standard Time 8:00 a.m. to 8:00 p.m., or by e-mail and web site 24-hours a day.

ATTO Technology, Inc. 155 CrossPoint Parkway Amherst, New York 14068 (716) 691-1999 • voice (716) 691-9353 • fax http://www.attotech.com

ATTO Technology can also be reached via e-mail at the following addresses:

Sales Support: [email protected] Technical Support: [email protected]

x ATTO Utilities Installation and Operation Manual