« カンテサンスの思い出 | メイン | Fusion I/Oの取り外し(IBM High IOPS SD class »

fusion-io (IBM high iops driver)取り付けと評価

　　　　　　　　　

とりあえず導入時のメモ。

　　　　　　　　　

unzip ./ibm_dd_highiop_ssd-2.2.3_rhel5_x86-64.zip
cd rhel5/
rpm -Uvh ./iomemory-vsl-2.6.18-194.el5-2.2.3.66-1.0.x86_64.rpm
rpm -Uvh ./libf*

[root@test5 rhel5]# rpm -Uvh ./iomemory-vsl-2.6.18-194.el5-2.2.3.66-1.0.x86_64.rpm
準備中... ########################################### [100%]
1:iomemory-vsl-2.6.18-194########################################### [100%]
[root@test5 rhel5]#
[root@test5 rhel5]# rpm -Uvh ./libf*
準備中... ########################################### [100%]
1:libfio ########################################### [ 50%]
2:libfusionjni ########################################### [100%]

rpm -Uvh ./fio-*
先に必要
　net-snmp.x86_64

[root@test5 rhel5]# rpm -Uvh ./fio-*
準備中... ########################################### [100%]
1:fio-common ########################################### [ 20%]
2:fio-util ########################################### [ 40%]
3:fio-firmware-highiops ########################################### [ 60%]
4:fio-snmp-agentx ########################################### [ 80%]
5:fio-sysvinit ########################################### [100%]

#modprobe iomemory-vsl
　しばらくまつ。

dmesgでみるとできてるようだ。

iomemory_vsl: module license 'Proprietary' taints kernel.
fioinf Using Linux I/O Scheduler
fioinf
fioinf Copyright 2006-2010 Fusion Multisystems, Inc. dba Fusion-io. All rights reserved.
fioinf For Terms and Conditions see the License file included
fioinf with this driver package.
fioinf
fioinf ioDrive driver 2.2.3.66 hovenweep@b63c56987a64 loading...
ACPI: PCI Interrupt 0000:1d:00.0[A] -> GSI 37 (level, low) -> IRQ 201
PCI: Setting latency timer of device 0000:1d:00.0 to 64
fioinf ioDrive 0000:1d:00.0: mapped controller on BAR 5
fioinf ioDrive 0000:1d:00.0: Firmware version 5.0.6 101583 (0x500006 0x18ccf)
fioinf ioDrive 0000:1d:00.0: MID: reduced write threshold 95.0%
fioinf ioDrive 0000:1d:00.0: Mfr bad-block allowance 2.0%
fioinf ioDrive 0000:1d:00.0: Default sector size 512 bytes
fioinf ioDrive 0000:1d:00.0: Default capacity 160.001 GBytes
fioinf ioDrive 0000:1d:00.0: Rated endurance 75.00 PBytes
fioinf ioDrive 0000:1d:00.0: MID: dual_plane disabled
fioinf ioDrive 0000:1d:00.0: board serial number is 459720
fioinf ioDrive 0000:1d:00.0: board part number is 2774
fioinf ioDrive 0000:1d:00.0: board id (serial 459720 part 2774 revision 3)
fioinf ioDrive 0000:1d:00.0: using legacy interrupts
fioinf ioDrive 0000:1d:00.0: Resetting NAND controller
fioinf ioDrive 0000:1d:00.0: enabling 4-bit hardware ECC corrections.
fioinf ioDrive 0000:1d:00.0: using v2 packetizer interface.
fioinf ioDrive 0000:1d:00.0: powercut flush supported.
fioinf ioDrive 0000:1d:00.0: Slices supported.
fioinf ioDrive 0000:1d:00.0: Nand DCM Lock = 1
fioinf ioDrive 0000:1d:00.0: reduced-write threshold 95.0%
fioinf ioDrive 0000:1d:00.0: capacity warning thresh 10.0%
fioinf ioDrive 0000:1d:00.0: read-only threshold 94.0%
fioinf ioDrive 0000:1d:00.0: PCIe power monitor enabled (master). Limit set to 24.750 watts.
fioinf ioDrive 0000:1d:00.0: Thermal monitoring: enabled
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Found device 0000:1d:00.0
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: flushed write pipeline.
fioinf 0000:1d:00.0: found LEB map revision 6 in EB 0.
fioinf 0000:1d:00.0: found LEB map revision 6 in EB 1.
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Scanning for NV data...
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Retrieving latest mgmt data from block 8190
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Copied NV data to active buffer
fioinf Waiting for /dev/fct0 to be created
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: probed fct0
ACPI: PCI Interrupt 0000:1e:00.0[A] -> GSI 39 (level, low) -> IRQ 209
PCI: Setting latency timer of device 0000:1e:00.0 to 64
fioinf ioDrive 0000:1e:00.0: mapped controller on BAR 5
fioinf ioDrive 0000:1e:00.0: Firmware version 5.0.6 101583 (0x500006 0x18ccf)
fioinf ioDrive 0000:1e:00.0: MID: reduced write threshold 95.0%
fioinf ioDrive 0000:1e:00.0: Mfr bad-block allowance 2.0%
fioinf ioDrive 0000:1e:00.0: Mfr bad-block allowance 2.0%
fioinf ioDrive 0000:1e:00.0: Default sector size 512 bytes
fioinf ioDrive 0000:1e:00.0: Default capacity 160.001 GBytes
fioinf ioDrive 0000:1e:00.0: Rated endurance 75.00 PBytes
fioinf ioDrive 0000:1e:00.0: MID: dual_plane disabled
fioinf ioDrive 0000:1e:00.0: board serial number is 459730
fioinf ioDrive 0000:1e:00.0: board part number is 2774
fioinf ioDrive 0000:1e:00.0: board id (serial 459730 part 2774 revision 3)
fioinf ioDrive 0000:1e:00.0: using legacy interrupts
fioinf ioDrive 0000:1e:00.0: Resetting NAND controller
fioinf ioDrive 0000:1e:00.0: enabling 4-bit hardware ECC corrections.
fioinf ioDrive 0000:1e:00.0: using v2 packetizer interface.
fioinf ioDrive 0000:1e:00.0: powercut flush supported.
fioinf ioDrive 0000:1e:00.0: Slices supported.
fioinf ioDrive 0000:1e:00.0: Nand DCM Lock = 1
fioinf ioDrive 0000:1e:00.0: reduced-write threshold 95.0%
fioinf ioDrive 0000:1e:00.0: capacity warning thresh 10.0%
fioinf ioDrive 0000:1e:00.0: read-only threshold 94.0%
fioinf ioDrive 0000:1e:00.0: PCIe power monitor enabled (slave). Limit set to 24.750 watts.
fioinf ioDrive 0000:1e:00.0: Thermal monitoring: enabled
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Found device 0000:1e:00.0
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: flushed write pipeline.
fioinf 0000:1e:00.0: found LEB map revision 6 in EB 0.
fioinf 0000:1e:00.0: found LEB map revision 6 in EB 1.
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: sector_size=512
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: setting channel range data to [1 .. 8190]
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: setting up object store: data
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Attaching log data (512 byte sectors)...
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: 312501952 sectors vol f4782730-9ffc-459f-b63d-6a0c618c421d
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Scanning for NV data...
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Attach succeeded for data
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Retrieving latest mgmt data from block 8190
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Copied NV data to active buffer
fioinf Waiting for /dev/fct1 to be created
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Found metadata in EBs 3-3, loading...
blk_queue_max_segment_size: set to minimum 4096
fioinf enable_discard set but discard not supported on this linux version
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1d:00.0: Creating block device fioa: major: 252 minor: 0 sector size: 512...
fioa: unknown partition table
fioinf Waiting for /dev/fioa to be created
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: probed fct1
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: sector_size=512
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: setting channel range data to [1 .. 8190]
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: setting up object store: data
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Attaching log data (512 byte sectors)...
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: 312501952 sectors vol 5288f31d-ef0b-4edb-abac-8dd12d38c2ea
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Attach succeeded for data
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Found metadata in EBs 3-3, loading...
blk_queue_max_segment_size: set to minimum 4096
fioinf enable_discard set but discard not supported on this linux version
fioinf IBM 320GB High IOPS SD Class SSD PCIe Adapter 0000:1e:00.0: Creating block device fiob: major: 252 minor: 16 sector size: 512...
fiob: unknown partition table
fioinf Waiting for /dev/fiob to be created

チェックもできるようになる。
# fio-status

Found 2 ioDrives in this system with 1 ioDrive Duo
Fusion-io driver version: 2.2.3 build 66

Adapter: ioDrive Duo
IBM 320GB High IOPS SD Class SSD PCIe Adapter, Product Number:81Y4520 SN:46XXXX
External Power: NOT connected
PCIE Power limit threshold: 24.75W
Sufficient power available: Unknown
Connected ioDimm modules:
fct0: IBM 320GB High IOPS SD Class SSD PCIe Adapter, Product Number:81Y4520 SN:45XXXX
fct1: IBM 320GB High IOPS SD Class SSD PCIe Adapter, Product Number:81Y4520 SN:45XXXX

fct0 Attached as 'fioa' (block device)
IBM 320GB High IOPS SD Class SSD PCIe Adapter, Product Number:81Y4520 SN:45XXXX
Located in slot 0 Upper of ioDrive Duo SN:46XXXX
PCI:1d:00.0
Firmware v5.0.6, rev 101583
160.00 GBytes block device size, 203 GBytes physical device size
Sufficient power available: Unknown
Internal temperature: avg 47.7 degC, max 48.2 degC
Media status: Healthy; Reserves: 100.00%, warn at 10.00%

fct1 Attached as 'fiob' (block device)
IBM 320GB High IOPS SD Class SSD PCIe Adapter, Product Number:81Y4520 SN:45XXXX
Located in slot 1 Lower of ioDrive Duo SN:46XXXX
PCI:1e:00.0
Firmware v5.0.6, rev 101583
160.00 GBytes block device size, 203 GBytes physical device size
Sufficient power available: Unknown
Internal temperature: avg 53.2 degC, max 53.6 degC
Media status: Healthy; Reserves: 100.00%, warn at 10.00%

RAIDコントローラのインスト
yum install mdadm

RAIDデバイスの作成
mdadm --create /dev/md0 --chunk=256 --level=0 --raid-devices=2 /dev/fioa /dev/fiob

デバイスの進捗チェック
mdadm -D /dev/md0


ファイルシステムの作成
mkfs.xfs /dev/md0
meta-data=/dev/md0 isize=256 agcount=16, agsize=4882880 blks
= sectsz=512 attr=0
data = bsize=4096 blocks=78125440, imaxpct=25
= sunit=64 swidth=128 blks, unwritten=1
naming =version 2 bsize=4096
log =internal log bsize=4096 blocks=32768, version=1
= sectsz=512 sunit=0 blks, lazy-count=0
realtime =none extsz=524288 blocks=0, rtextents=0

仮マウント
mkdir /var/lib/mysql3
mount -t xfs /dev/md0 /var/lib/mysql3

検証環境の構築

SATA接続状況
[root@test5 ohba]# cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 02 Id: 00 Lun: 00
Vendor: IBM Model: ServeRAID M1015 Rev: 2.0.
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi0 Channel: 02 Id: 01 Lun: 00
Vendor: IBM Model: ServeRAID M1015 Rev: 2.0.
Type: Direct-Access ANSI SCSI revision: 05
Host: scsi0 Channel: 02 Id: 02 Lun: 00
Vendor: IBM Model: ServeRAID M1015 Rev: 2.0.
Type: Direct-Access ANSI SCSI revision: 05


普通にhdparm
hdparm -Tt /dev/md0

FusionI/O RAID-0
hdparm -Tt /dev/md0
/dev/md0:
Timing cached reads: 22160 MB in 2.00 seconds = 11090.34 MB/sec
Timing buffered disk reads: 1184 MB in 3.00 seconds = 394.26 MB/sec
バッファなし
hdparm -tf /dev/md0
/dev/md0:
Timing buffered disk reads: 1210 MB in 3.00 seconds = 403.33 MB/sec

ちなみにSSD RAID-1
hdparm -Tt /dev/sdb1
/dev/sdb1:
Timing cached reads: 23140 MB in 2.00 seconds = 11581.29 MB/sec
Timing buffered disk reads: 152 MB in 3.03 seconds = 50.17 MB/sec
バッファなし
hdparm -tf /dev/sdb1
/dev/sdb1:
Timing buffered disk reads: 280 MB in 3.01 seconds = 93.06 MB/sec

LVM領域
hdparm -Tt /dev/mapper/VolGroup00-LogVol00
/dev/mapper/VolGroup00-LogVol00:
Timing cached reads: 21948 MB in 2.00 seconds = 10983.22 MB/sec
Timing buffered disk reads: 272 MB in 3.02 seconds = 90.22 MB/sec

hdparm -tf /dev/mapper/VolGroup00-LogVol00
/dev/mapper/VolGroup00-LogVol00:
Timing buffered disk reads: 270 MB in 3.00 seconds = 89.98 MB/sec

日時: 2012年02月03日 20:05 |

トラックバック

このエントリーのトラックバックURL:
http://www.ostl.net/blog/mt-tb.cgi/671

コメントを投稿

(いままで、ここでコメントしたことがないときは、コメントを表示する前にこのブログのオーナーの承認が必要になることがあります。承認されるまではコメントは表示されません。そのときはしばらく待ってください。)

検索


About

2012年02月03日 20:05に投稿されたエントリーのページです。

ひとつ前の投稿は「カンテサンスの思い出」です。

次の投稿は「Fusion I/Oの取り外し(IBM High IOPS SD class」です。

他にも多くのエントリーがあります。メインページやアーカイブページも見てください。

このブログのフィードを取得
[フィードとは]
Powered by
MT3系