solaris10与emccx3-10c实现fc-san实施手册v2

'Solaris10与EMCCX3-10c实现FC-SAN实施手册现场背景：服务器3台，2台SunFireV490，1台SunFireV250。存储为DELL|EMCCX3-10c，配备8TB硬盘，一台BrocadeSW200E光纤交换机。目的：实现FC-SAN构架。拓扑图：实施步骤：1、先完成Dell|EMCCX3-10c初始化，配置两个管理IP，分别为：XX.XX.XX.XX。2、建立服务器、光纤交换机、存储之间的链路。3、初始化光纤交换机，配置管理地址：XX.XX.XX.XX4、在NavisphereManager管理界面发现链路。5、在服务器端安装Navisphere26 agent注册，安装PowerPath多链路管理软件。具体安装操作如下：lNavisphereagent的安装与配置先将光盘mount上后，再执行下面的命令：pkgadd-dNAVIAGNT.pkg会出现下述提示信息，按照提示信息选择安装即可。Selectthepackagesthatyouwanttoinstallbydoingoneofthefollowing:??Enter1(toinstallthehostagent)or??Enter2(toinstallCLI)orEnterAll(toinstallboththehostagentandCLI)Enteryandytobegintheinstallation.Theinstallationprogramlooksforanyagentconfigurationfilesyoumayalreadyhaveonyoursystem.Iftheprogramdoesnotfindanyagentconfigurationfiles,thenyouhavefinishedinstallingtheagent;gotostep10q.Iftheprogramdoesfindanyexistingconfigurationfiles,itdisplaysamessagelikethefollowing:AtLeast1savedconfigfileexistsforNavisphere26 Agent.Pleaseselect1ofthefollowing:[1]Restore/etc/Navisphere/.Naviagent-config.000120:1059[2]Restore/etc/Navisphere/.Naviagent-config.000121:1408[3]QuitSelectnumber1-3.修改agent.config配置文件，主要方法如下：修改/etc/Navisphere/agent.configVi/etc/Navisphere/agent.config修改内容为：#Navisphereagent.config#---------------------#ThisfileisusedbyNavisphereAgenttoconfigure#sitespecificvalues.##Allentriesinthisfilehavethisform:##objectvalue-list26 ##Where"object"tellswhatsortofinformationisto#beconfigured,and"value-list"isa#whitespace-separatedlistofvaluestobeconfigured.#Samples,whichshouldbeedited,appearbelowforall#permissibletypesofobjects.##Whitespace(tabs,space,line-feeds,#carriage-returns)andblanklinesareignored;#Tocontinuealineontothenextline,use""asthe#lastcharacterofthatline.The""isdroppedwhen#thenextlineisconcatenatedtothecontinuedline.##############################Descriptionspecification#-------------------------##The"clarDescr"objecttakesarbitrarytextvalues#intendedtodescribetheagentanditslocation.#26 clarDescrNavisphereAgent##The"clarContact"objecttakesarbitrarytextvalues#intendedtodescribewhoisresponsibleforthe#configuredagent,andhowtoreachthem.#clarContactJohnSmith,800-555-1212##Devicespecification.#----------------------##Theformatof"device"objectsforCLARiiONdevices#is:#devicedevice-specname"description"##wherethedevice-specificationisthedevicenameto#opentoaccesstheCLARiiONdevice.Itcanbea#SCSI-2filename.Ifthisis"auto",allattached#arrayswithboundLUNswillbeautomatically#configured.(Currently,dummyargumentsarerequired#fornameanddescription,whenusing#auto-configuration.)ThiscanNOTbedefaulted.26 ##ThenameistheperCLARiiONnamethatcanbeusedto#identifyeachCLARiiONtothemanagerapplication.#ThenameisREQUIREDandcannotcontainspaces(even#ifsurroundedbyquotes).ThiscanNOTbedefaulted.##Thedescriptionisaquotedstringthatcontainsa#briefdescriptionoftheCLARiiONchassisbeing#managed.Itdefaultsto""ifnotspecified,andto#thedevicenameforauto-configuration.##SAMPLES:#devicec0t0d0NAVISPHERE-1"NAVISPHERE-1"##automaticallydetectmanageabledevicesdeviceautoauto##UserSpecification.#------------------##Theformatof"user"objectsis"#userlocalUserId26 #OR#useruserId@hostname在此处添加存储系统SPA和SPB管理地址即可usersystem@XX.XX.XX.XXusersystem@XX.XX.XX.XX#Thesebuildalistofuserswhoareallowedtoperform#WRITEoperationstotheCLARiiONdevicesmanagedby#thisagent.Bydefault,asspecifiedbelow,onlyroot#onthismachinehasWRITEaccess.Otherscanbe#grantedaccessbyincludingtheirloginnameandhost#whichtheycanaccessfrom.Anulllistprevents#anyone,includingadmin,fromhavingwriteaccess.In#ordertogetwriteaccess,thisfilewouldhavetobe#modifiedandtheAgentstoppedandrestartedto#re-readtheconfigurationfile,oranappropriate#remoteconfigurationfilewouldhavetobesenttothe#agentfromanalready-priviledgeduser.userroot#onlyonthismachine#usersblue@picasso#individualuser"sblue"on#host"picasso"#userlgreen@hannibal#individualuser"lgreen"on#host"hannibal"#26 #Pollspecification#------------------#The"poll"objecttakesanumericalcountofseconds.##Thisspecifieshowoftentheagentsolicits#informationfromthearray,ratherthanusingcached#information.Theminimumis"10".#poll60##Eventlogspecification#----------------------#Theeventlogobjecttakesanumericalcountoflog#entries.##ThisdefinesthemaximumnumberofSPlogevents#receivedbytheagentonstartup,andreceivedby#clientsperpoll.Avalueof0causesthedevice’s#entirelogtobereadatstartup.Aminimumof100#eventswillbereadonserial,and2048onfibre,#overridinganylowervalueconfiguredbelow.#26 eventlog100##BaudRatespecification#-----------------------#Iftheagentisusingaserialporttomanagea#device,thenextentrycanspecifyeither9600baud#or19200baud.#baud9600#####endofconfigurationfile###保存配置文件，然后可以启动/停止agent服务。命令如下：bash3.00#/etc/init.d/agentstopbash3.00#/etc/init.d/agentstart如果安装配置正常，启动agent服务后在NavisphereManager管理界面中的Connective中会看到链路状态register为yes。如register显示为no，可以考虑重启服务器或者重启agent服务，或者在NavisphereManager界面中进行手动注册也可以。注册完成后会在链路状态中显示主机名称等信息。26 lPowerPath的安装与注册PowerPath的安装1、MountCDROM2、bash3.00#mkdir/unload3、bash3.00#cd/unload4、bash3.00#cp/.从光盘将安装文件拷贝到新建的目录下面。5、bash3.00#gunzip解压缩文件6、bash3.00#tar-xvf解压缩文件7、bash3.00#pkgadd–d.安装PowerPath按照下述提示操作：SPARChost:Thefollowingpackagesareavailable:EMCpowerEMCPowerPath(sparc)5.2.x_bxxxSelectpackage(s)youwishtoprocess(or"all"toprocessallpackages).(default:all)[?,??,q]:x86(i386)host:Thefollowingpackagesareavailable:EMCpowerEMCPowerPath(i386)5.2.x_bxxxSelectpackage(s)youwishtoprocess(or"all"to26 processallpackages).(default:all)[?,??,q]:Enter1andpressENTER.Enterpackagebasedirectory(default:/opt):PressENTERtoacceptthedefaultbasedirectory(/opt),ortypethepathtoanalternatebasedirectoryandpressENTER.Thispackagecontainsscriptswhichwillbeexecutedwithsuper-userpermissionduringtheprocessofinstallingthispackage.Doyouwanttocontinuewiththeinstallationof[y,n,?]EnteryandpressENTER.Installationofwassuccessful.8、安装完成后需要进行PowerPath的注册注册方法如下：bash3.00#/etc/emcpreg-installYouseethefollowingoutput:============EMCPowerPathRegistration=============Doyouhaveanewregistrationkeyorkeystoenter?[n]26 TypeyandpressENTER.Youseethefollowingoutput:Entertheregistrationkey(s)foryourproduct(s),oneperline,pressingEnteraftereachkey.Aftertypingallkeys,pressEnteragain.Key(Enterifdone):EnterthePowerPathregistrationkeyandpressENTER.Youcanalsoaddkeysforothertechnologies,suchasPowerPathMigrationEnablerorPowerPathEncryptionwithRSA.Ifyouenteredavalidkey,youseethefollowingoutput:1key(s)successfullyadded.Keysuccessfullyinstalled.Key(Enterifdone):PressENTER.Youseethefollowingoutputifyouenteredonekey:1key(s)successfullyregistered.在PowerPath软件安装注册完成后重启服务器，输入下述命令可以看到服务器与存在之间的两条链路：bash3.00#powermtdisplaydev=all会显示链路情况。26 还需要将Solaris主机的MPxIO功能关闭。（主要是由于Solaris自带的MPxIO功能与PowerPath的多路径功能相冲突）具体修改文件如下：修改/kernel/drv/fp.conf，修改内容如下：mpxio-disable="yes"修改/kernel/drv/scsi_vhci.conf，修改内容如下：mpxio-disable="yes"修改完成后，运行如下命令：powermtdisplaydev=allpowermtcheck(Choose"A"forall.Clearthedeadpaths.)devfsadm–C(ScantheSCSIbus.)powercf-q(Rebuildthelogicallinklayer.)powermtconfig(Bringthedevicepaths intoPowerPathcontrol.)powermtsave(Savethecurrentconfiguration.)完成配置保存等工作后PowerPath软件即可正常使用。1、存储建立RAIDGroup，StorageGroup，将服务器与LUN映射关系对应上。2、服务器端识别存储，格式化硬盘以及做文件系统。具体操作如下：sh-3.00#format26 Searchingfordisks...doneAVAILABLEDISKSELECTIONS:0.c0t0d0/pci@1d,700000/scsi@4/sd@0,01.c0t8d0/pci@1d,700000/scsi@4/sd@8,02.c3t0d0/pci@1d,700000/QLGC,qlc@2/sd@0,03.c3t1d0/pci@1d,700000/QLGC,qlc@2/sd@1,04.emcpower0a/pseudo/emcp@0Specifydisk(enteritsnumber):4selectingemcpower0a[diskformatted]FORMATMENU:disk-selectadisktype-select(define)adisktypepartition-select(define)apartitiontable26 current-describethecurrentdiskformat-formatandanalyzethediskrepair-repairadefectivesectorlabel-writelabeltothediskanalyze-surfaceanalysisdefect-defectlistmanagementbackup-searchforbackuplabelsverify-readanddisplaylabelsinquiry-showvendor,productandrevisionvolname-set8-charactervolumename!-execute,thenreturnquitformat>pPARTITIONMENU:0-change`0"partition1-change`1"partition2-change`2"partition3-change`3"partition4-change`4"partition5-change`5"partition6-change`6"partitionselect-selectapredefinedtable26 modify-modifyapredefinedpartitiontablename-namethecurrenttableprint-displaythecurrenttablelabel-writepartitionmapandlabeltothedisk!-execute,thenreturnquitpartition>pCurrentpartitiontable(original):Totaldisksectorsavailable:3076627422+16384(reservedsectors)PartTagFlagFirstSectorSizeLastSector0rootwm34128.00MB2621771swapwu262178128.00MB5243212unassignedwm0003unassignedwm0004unassignedwm0005unassignedwm0006usrwm5243221.43TB307662742126 8reservedwm30766274228.00MB3076643805partition>labelReadytolabeldisk,continue?ypartition>qFORMATMENU:disk-selectadisktype-select(define)adisktypepartition-select(define)apartitiontablecurrent-describethecurrentdiskformat-formatandanalyzethediskrepair-repairadefectivesectorlabel-writelabeltothediskanalyze-surfaceanalysisdefect-defectlistmanagementbackup-searchforbackuplabelsverify-readanddisplaylabelsinquiry-showvendor,productandrevisionvolname-set8-charactervolumename!-execute,thenreturnquitformat>q26 创建文件系统，Solaris默认格式bash-3.00#newfs/dev/rdsk/emcpower0gnewfs:建构新的文件系统/dev/rdsk/emcpower0g:(y/n)？y警告：最后一个未分配柱面中的1104扇区/dev/rdsk/emcpower0g:在500668磁道上，48扇区的128柱面的3076103088扇区1502003.5MB在3502柱面群组(143c/g,429.00MB/g,448i/g)超块(fsck-Fufs-ob=#)备份在：32,878752,1757472,2636192,3514912,4393632,5272352,6151072,7029792,7908512,初始化柱面组：.....................................................................最后10个柱面组的超级块备份位置：3068047904,3068926624,3069805344,3070684064,3071562784,3072441504,3073320224,3074198944,3075077664,3075956384,文件系统做完。挂载硬盘bash-3.00#mkdiremcdiskbash-3.00#mount/dev/dsk/emcpower0g/mnt/emcdisk/其它链路也如上述操作，完成后运行下面命令可以看到磁盘大小以及利用情况。26 bash-3.00#df-kh文件系统大小用了可用容量挂接在/dev/dsk/c0t0d0s032G1.1G30G4%//devices0K0K0K0%/devicesctfs0K0K0K0%/system/contractproc0K0K0K0%/procmnttab0K0K0K0%/etc/mnttabswap2.1G1.0M2.1G1%/etc/svc/volatileobjfs0K0K0K0%/system/object/dev/dsk/c0t0d0s323G4.3G19G19%/usrfd0K0K0K0%/dev/fd/dev/dsk/c0t8d0s767G743M66G2%/varswap2.1G312K2.1G1%/tmpswap2.1G24K2.1G1%/var/run26 /dev/dsk/c0t0d0s61.2G83M1.1G7%/temp/dev/dsk/c0t0d0s710G1.9G8.2G19%/export/home/dev/dsk/emcpower0g1.4T64M1.4T1%/mnt/emcdisk1、硬盘自动挂载，修改配置文件，配置文件在/etc/vfstab具体修改参考下面文档：bash-3.00#vi/etc/vfstab#devicedevicemountFSfsckmountmount#tomounttofsckpointtypepassatbootoptions#fd-/dev/fdfd-no-/proc-/procproc-no-/dev/dsk/c0t0d0s1--swap-no-/dev/dsk/c0t0d0s0/dev/rdsk/c0t0d0s0/ufs1no-/dev/dsk/c0t0d0s3/dev/rdsk/c0t0d0s3/usrufs1no-/dev/dsk/c0t8d0s7/dev/rdsk/c0t8d0s7/varufs1no26 -/dev/dsk/c0t0d0s7/dev/rdsk/c0t0d0s7/export/homeufs2yes-/dev/dsk/c0t0d0s6/dev/rdsk/c0t0d0s6/tempufs2yes-/devices-/devicesdevfs-no-ctfs-/system/contractctfs-no-objfs-/system/objectobjfs-no-swap-/tmptmpfs-yes-/dev/dsk/emcpower0g/dev/rdsk/emcpower0g/mnt/emcdiskufs1yes-1、光纤交换机配置zone光纤交换机主要配置管理ip地址，zone等，在初始化时已经完成了ip地址的配置，配置zone的方法如下：SW200E:admin>switchshow查看交换机信息switchName:SW200EswitchType:34.0switchState:OnlineswitchMode:NativeswitchRole:PrincipalswitchDomain:1switchId:fffc0126 switchWwn:10:00:00:05:1e:5b:f7:3ezoning:ON(XXXX)switchBeacon:OFFAreaPortMediaSpeedStateProto=====================================00idN4OnlineF-Port21:00:00:1b:32:08:2a:d411idN4OnlineF-Port50:06:01:69:41:e0:b2:5f22idN4OnlineF-Port50:06:01:61:41:e0:b2:5f33idN4OnlineF-Port21:00:00:e0:8b:8f:57:b344idN4OnlineF-Port21:00:00:e0:8b:8f:a8:b355idN4No_Light66idN4No_Light77idN4No_Light88--N4No_Module(NoPODLicense)Disabled99--N4No_Module(NoPODLicense)26 Disabled1010--N4No_Module(NoPODLicense)Disabled1111--N4No_Module(NoPODLicense)Disabled1212--N4No_Module(NoPODLicense)Disabled1313--N4No_Module(NoPODLicense)Disabled1414--N4No_Module(NoPODLicense)Disabled1515--N4No_Module(NoPODLicense)DisabledSW200E:admin>alicreate“SPA_0”,”50:06:01:69:41:e0:b2:5f”//创建WWN的别名SW200E:admin>alicreate“SPB_0”,”50:06:01:61:41:e0:b2:5f”SW200E:admin>alicreate“mailbak”,”21:00:00:e0:8b:8f:57:b3”SW200E:admin>alicreate“student_mail”,”21:00:00:1b:32:08:2a:d4”SW200E:admin>alicreate“v490”,”21:00:00:e0:8b:8f:a8:b3”SW200E:admin>zonecreate“bak”,”SPA_0;SPB_0;mailbak”//创建zone26 SW200E:admin>zonecreate“mail”,”SPA_0;SPB_0;v490”SW200E:admin>zonecreate“st_mail”,”SPA_0;SPB_0;student_mail”SW200E:admin>cfgcreate"XXXX","bak;mail;st_mail"//创建cfgSW200E:admin>cfgsave“XXXX”//保存cfgSW200E:admin>cfgenable“XXXX”//enablecfg配置完成。可以通过switchshow、fabricshow、zoneshow、cfgshow等查看配置。一定要注意创建别名时WWN的准确性。其它注意事项以及特殊情况处理：1、PowerPath链路不正常情况下的处理PowerPath链路不正常主要有几种情况：A、链路识别不了解决办法：重启服务器。或者使用如下命令：bash3.00#powermtcheckbash3.00#powermtrestore扫描通道bash3.00#powercf–qbash3.00#powermtconfigbash3.00#powermtsave26 在NavisphereManager上检查链路发现情况，如发现不了，进行扫描，检查HBA卡状态，如果状态不对，需要安装HBA卡驱动。A、链路数量状态不对当链路数量状态不对时可以使用A中所提到的命令进行链路通道扫描，同时结合NavisphereManager检查链路情况，可以运行CTRL+ALT+SHIFT+F12进入工程师配置模式，密码是messner.检查链路以及StorageGroup主机配置信息是否勾选。同时也可以检查光纤交换机配置信息。1、修改Solaris配置文件系统不能启动的问题在修改vfstab等文件造成系统启动不起来，需要采用单用户模式将配置文件修改后再重启即可。主要方法如下：1．插入Solaris10光盘2．利用光盘启动到单用户模式okbootcdrom-s3．装配/（root）文件系统到/a目录，以允许对磁盘上的文件系统的访问。#mount/dev/dsk/c0t0d0s0/a4．设置并且输出TERM变量允许vi编辑器进行工作#TERM=sun#exportTERM5．编辑/etc/vfstab文件并且纠正问题。然后退出保存文件#vi/a/etc/vfstab26 ：wq！6．卸载文件系统#cd/#umount/a7．重新启动系统#reboot26'