LabResources:FiberChannel - Revision history

Scsong at 21:30, 11 September 2008

2008-09-11T21:30:16Z

← Older revision		Revision as of 21:30, 11 September 2008
Line 58:		Line 58:

	<pre>		<pre>
	[root@naraapp01 root]# ./naviserverutilcli		[root@naraapp01 root]# ./naviserverutilcli
	Welcome to Navisphere Server Utility - version : 6.20.0.3.12		Welcome to Navisphere Server Utility - version : 6.20.0.3.12

Scsong at 21:29, 11 September 2008

2008-09-11T21:29:49Z

← Older revision		Revision as of 21:29, 11 September 2008
Line 36:		Line 36:
	==Storage Devices==		==Storage Devices==
	===ACNC RAID===		===ACNC RAID===
	'''Connecting'''		''Connecting''

	On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.		On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.

	'''Adding lun and wwn wwn-mapping'''		''Adding lun and wwn wwn-mapping''

	Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.		Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.
Line 49:		Line 49:
	The dual controllers are available on the san network as nara-ax150-1 and nara-ax150-2. Access is through an http interface. The password is the same as the naraapp account.		The dual controllers are available on the san network as nara-ax150-1 and nara-ax150-2. Access is through an http interface. The password is the same as the naraapp account.

	~~====~~Adding new devices ~~====~~		''Adding new devices''
	Before you can assign disks to a server, you must introduce the server to the ax150, this is accomplished by adding the 150 to the lun in linux		Before you can assign disks to a server, you must introduce the server to the ax150, this is accomplished by adding the 150 to the lun in linux
	<pre>		<pre>

Scsong at 21:29, 11 September 2008

2008-09-11T21:29:21Z

← Older revision		Revision as of 21:29, 11 September 2008
Line 37:		Line 37:
	===ACNC RAID===		===ACNC RAID===
	'''Connecting'''		'''Connecting'''

	On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.		On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.

	'''Adding lun and wwn wwn-mapping'''		'''Adding lun and wwn wwn-mapping'''

	Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.		Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.

Scsong at 21:29, 11 September 2008

2008-09-11T21:29:05Z

← Older revision		Revision as of 21:29, 11 September 2008
Line 36:		Line 36:
	==Storage Devices==		==Storage Devices==
	===ACNC RAID===		===ACNC RAID===
	~~====~~Connecting~~====~~		'''Connecting'''
	On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.		On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.
	~~====~~Adding lun and wwn wwn-mapping~~====~~
			'''Adding lun and wwn wwn-mapping'''
	Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.		Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.

Scsong at 21:28, 11 September 2008

2008-09-11T21:28:31Z

← Older revision		Revision as of 21:28, 11 September 2008
Line 36:		Line 36:
	==Storage Devices==		==Storage Devices==
	===ACNC RAID===		===ACNC RAID===
	*connecting		====Connecting====

	On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.		On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.
			====Adding lun and wwn wwn-mapping====
	*Adding lun and wwn wwn-mapping
	Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.		Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.

Line 46:		Line 44:

	===AX150===		===AX150===

	The dual controllers are available on the san network as nara-ax150-1 and nara-ax150-2. Access is through an http interface. The password is the same as the naraapp account.		The dual controllers are available on the san network as nara-ax150-1 and nara-ax150-2. Access is through an http interface. The password is the same as the naraapp account.

	*Adding new devices		====Adding new devices ====
	Before you can assign disks to a server, you must introduce the server to the ax150, this is accomplished by adding the 150 to the lun in linux		Before you can assign disks to a server, you must introduce the server to the ax150, this is accomplished by adding the 150 to the lun in linux
	<pre>		<pre>

Scsong at 21:27, 11 September 2008

2008-09-11T21:27:51Z

← Older revision		Revision as of 21:27, 11 September 2008
Line 41:		Line 41:

	*Adding lun and wwn wwn-mapping		*Adding lun and wwn wwn-mapping
	\Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.		Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.

	Now map the host to lun by '3 Fibre Params -> 33 SAN Mask -> 332 SAN Mapping -> 3321 Port1 ->' Select host then lun to allow/disallow. Esc back and save nvram. You can now use view san mapping to see if changes stuck. No raid reboot should be necessary.		Now map the host to lun by '3 Fibre Params -> 33 SAN Mask -> 332 SAN Mapping -> 3321 Port1 ->' Select host then lun to allow/disallow. Esc back and save nvram. You can now use view san mapping to see if changes stuck. No raid reboot should be necessary.

Scsong at 21:26, 11 September 2008

2008-09-11T21:26:31Z

New page

'''Fiber Channel Tips'''

==Fiber Channel HBA's==
===Emulex/LSI HBA===
Naraapp01 has an LSI-based hba. It's a bit different from the adaptec HBA's in that information regarding the device (wwn, etc) is found in /proc/mpt/* rather than in /proc/scsi/_hba_. The driver that is used to support these cards is the mptscsih shipped w/ RHEL 3. There is no additional management software installed.
<pre>
[root@naraapp01 ioc0]# cat /proc/mpt/ioc0/info
ioc0:
ProductID = 0x1001 (LSIFC919)
FWVersion = 0x01000600 (fw_size=218452)
MsgVersion = 0x0101
FirstWhoInit = 0x00
EventState = 0x01
CurrentHostMfaHighAddr = 0x00000000
CurrentSenseBufferHighAddr = 0x00000000
MaxChainDepth = 0x4f frames
MinBlockSize = 0x20 bytes
RequestFrames @ 0xd52e0000 (Dma @ 0x152e0000)
{CurReqSz=128} x {CurReqDepth=1023} = 130944 bytes ^= 0x20000
{MaxReqSz=128} {MaxReqDepth=2047}
ReplyFrames @ 0xd532c000 (Dma @ 0x1532c000)
{CurRepSz=64} x {CurRepDepth=128} = 8192 bytes ^= 0x2080
{MaxRepSz=128} {MaxRepDepth=2047}
MaxDevices = 32
MaxBuses = 32
PortNumber = 1 (of 1)
LanAddr = 00:06:2B:0C:5A:64
WWN = 200000062B0C5A64:100000062B0C5A64
</pre>
On any host with this card, you should also install the MyStorage software from [[http://www.lsilogic.com][LSI Logic]]. The card in naraapp01 is the LSIFC919.

===EMC LPe111-E 4Gb PCIe Fibre Channel Adapter===
Naraapp's11-15 have these installed for chronopolis.
Emulex tools: [[http://www.emulex.com/support/linux/linux_tools.html][link]]

==Storage Devices==
===ACNC RAID===
*connecting

On narafs01, run 'minicom S0', hit ctrl-D and enter the default password.

*Adding lun and wwn wwn-mapping
\Select '3 Fibre Params -> 33 SAN Mask -> 333 Edit WWN table'. Edit an unused host mask and add the new WWN. You can use 'View WWN table' to locate an empty entry. After editing, esc back to the main menu and 'NVRAM -> Update NVRAM'. Now, map the lun you want, '3 Fibre Params -> 31 Primary FC -> 315 LUN Map' select lun to map, then array/slice to map to. When done, esc back and save NVRAM.

Now map the host to lun by '3 Fibre Params -> 33 SAN Mask -> 332 SAN Mapping -> 3321 Port1 ->' Select host then lun to allow/disallow. Esc back and save nvram. You can now use view san mapping to see if changes stuck. No raid reboot should be necessary.

===AX150===

The dual controllers are available on the san network as nara-ax150-1 and nara-ax150-2. Access is through an http interface. The password is the same as the naraapp account.

*Adding new devices
Before you can assign disks to a server, you must introduce the server to the ax150, this is accomplished by adding the 150 to the lun in linux
<pre>
echo "scsi add-single-device 2 0 3 0" > /proc/scsi/scsi
</pre>

followed by running Navisphere util program. (look in /opt on narafs01 for it)

<pre>
[root@naraapp01 root]# ./naviserverutilcli
Welcome to Navisphere Server Utility - version : 6.20.0.3.12

Select from one of the following options: or Select '0' to exit the application

1. Update Server Information - Select this option to send information about the
server to all connected storage systems

2. Start a Snapshot (Navisphere Express only) - Select this option to start a sn
apshot. Starting a snapshot begins the point-in-time copy of the virtual disk

3. Stop a Snapshot (Navisphere Express only) - Select this option to stop a snap
shot. Stopping a snapshot ends the point-in-time copy of the virtual disk

4. Allow Access to a Snapshot (Navisphere Express only) - Select this option to
allow access to a snapshot

5. Remove Access to a Snapshot (Navisphere Express only) - Select this option to
remove access to a snapshot

6. Display help for the application

1

Connected Storage Systems:

HBA/NIC Port Storage System SP Port SP IP Address
-------------------------------------------------------
0 FCNPR070300149 A 0 192.168.88.18

There are currently no volumes from external storage systems.

Please verify the information above. If it is correct, you can update
the server with the attached storage systems. If the information
is incorrect you can scan again and then update.

Please select [u]pdate, [s]can, [c]ancel: u

The update succeeded.
</pre>

You should now see the new server listed on the web interface under Servers of connections. If not, you'll have to manually add it. You can do this by clicking 'Connections', selecting the wwn of the server you are adding, click modify and enter the name and ip of the server.

==Kernel Tweaking==
In /etc/modules.conf the following line usually needs added to probe all available luns:

<pre>
options scsi_mod max_scsi_luns=255
</pre>

After adding that line, or additional hba's to a machine, you should rebuild the initrd so the modules will be available on boot:

<pre>
[root@naraapp01 ~]# cd /boot
[root@naraapp01 boot]# mv initrd-2.4.21-32.0.1.ELsmp.img initrd-2.4.21-32.0.1.ELsmp.img.bak
[root@naraapp01 boot]# mkinitrd initrd-2.4.21-32.0.1.ELsmp.img 2.4.21-32.0.1.ELsmp
</pre>