參考案例suse鏡像008ceph deepsean for storage

DeployingwithDeepSeaandceph------關(guān)于DeepSea資料 關(guān)閉#sudo/sbin/SuSEfirewall2 IPV6#vim/etc/sysctl.confnet.ipv6.conf.all.disable_ipv6#vim/etc/sysctl.confnet.ipv6.conf.all.disable_ipv6=1net.ipv6.conf.default.disable_ipv6=net.ipv6.conf.lo.disable_ipv6=1#sysctl–pLinux（如32k，如果您遇到了這類(lèi)問(wèn)題，可以把kernel.pid_max值調(diào)高些。理論最大值是。例如把下列這行加入/etc/sysctl.conf文件##vim/etc/sysctl.confkernel.pid_max=adminapparmor#systemctlstop#systemctlstop#systemctldisableapparmor.service#systemctlstatusapparmor.service#cat 0 1 -98e4-4715-b73d-1395b72feb7e 1/iso/SUSE-Enterprise-Storage-5-Internal-x86_64-tone6-DVD.iso/mnt/storage5iso9660defaults,ro0tone7-DVD1.isotone7iso966000tone8-DVD1.isotone8iso966000#lltotal-rw-r--r-1-rw-r--r-1-rw-r--r-1-rw-r--r-1-rw-r--r-1#zypper#zypperRepositoryprioritiesarewithouteffect.Allenabledrepositoriessharethesamepriority.#|+1|SES5_5-2|SES5_5-3|SES5_5-|+|SES55-|SES55-|SES55-|Enabled|GPGCheck|+|||+|(r)|(r)|(r)+|||44|SLES12-SP3-12.3-0|SLES12-SP3-12.3-0|5| | ||(r)Yes||(p)Yes|##cat/etc/zypp/repos.d/SES5_5-0.reponame=SES55-0SUSE12SP3系統(tǒng)升級(jí)(所有4個(gè)節(jié)點(diǎn)和admin節(jié)點(diǎn)) #zypper-npatch#zypper-npatch#zypper-n#zypper-npatch#zypper-npatch#zypper-n3##DeepSeadeepsea和#zypper-ninRetrievingpackagelibzmq3-4.0.4-6.1.x86_64Retrievingpackagesalt-2015.8.7-17.1.x86_64Retrievingpackage#zypper-ninRetrievingpackagelibzmq3-4.0.4-6.1.x86_64Retrievingpackagesalt-2015.8.7-17.1.x86_64Retrievingpackagesalt-minion-2015.8.7-17.1.x86_64Retrievingpackagesalt-master-2015.8.7-17.1.x86_64Retrievingpackagedeepsea-0.6.10-1.3.noarch2cephnode001node002node003salt-#zypper-ninsalt-#zypper-ninsalt-#vim/etc/salt/minion#master:saltmaster:#vim/etc/salt/minion#master:saltmaster:04SaltMaster#viminterface:#viminterface: 5#systemctlstartsalt-master.service#systemctl#systemctlstartsalt-master.service#systemctlenablesalt-master.service#systemctlstatussalt-master#lltotal-r-------1-rw-r--r-1drwxr-x--267drwxr-x--267drwxr-x--267drwxr-x--2drwxr-x--267#systemctlstartsalt-minion.service#systemctl#systemctlstartsalt-minion.service#systemctlenablesalt-#ll#ll/etc/salt/pki/minion/total8-r--------1rootroot1674Jun2820:53-rw-r--r--1rootroot450Jun2820:53#ll#ll-rw-r--r--1rootroot34Jun2820:40/srv/pillar/ceph/master_minion.sls#cat/srv/pillar/ceph/master_minion.sls6#salt-AcceptedKeys:DeniedKeys:Unaccepted#salt-AcceptedKeys:DeniedKeys:UnacceptedKeys:Rejected#salt-key#salt-key--accept-all#salt-keyAcceptedDeniedKeys:UnacceptedKeys:RejectedKeys:#salt-key--Deleteall-D,--delete-Deletethespecifiedkey.Globsare-dDELETE,--Acceptallpending -A,--accept-#ll/etc/salt/pki/minion/total12-r--------#ll/etc/salt/pki/minion/total12-r--------1rootroot1674Jun2820:53-rw-r--r--1rootroot450Jun2820:53-rw-r--r--1rootroot450Jun2821:09#salt'*'nnn::::6SaltRunners：類(lèi)似于執(zhí)行模塊，在Master端執(zhí)行minion##salt-runmanage.status-nnnsalt-runsalt-runstate.orchceph.stage.0（可選2、發(fā)現(xiàn)##salt-runstate.orch#salt-runstate.eventpretty=True #salt-runstate.eventpretty=True "_stamp":"2017-06-"fun":"jid": "user":}#salt-runproposal.populate#cd/srv/pillar/ceph/proposals/profile-test001/stack/default/ceph/minions/#vimn #salt-runproposal.populate#cd/srv/pillar/ceph/proposals/profile-test001/stack/default/ceph/minions/#vimn db:'/dev/sdb'db_size:500mencryption:''format:bluestorewal:'/dev/sdb'wal_size:500mdb:db_size:db_size:encryption:''format:bluestorewal:'/dev/sdb'wal_size:500m#cp .yml#cp .yml注意：node004deepsea4、新建.cfg文Thefileisdividedintofoursections4Role#vim#vim#Clusterassignment#Hardwareprofile-profile-#Common#Role##Roles#role-#role-#role-role- #MGR(mgrsareusuallycolocatedwithrole- ##role-#role-#role-stage4openattic系統(tǒng)自帶的#lltotal-rw-r--r-1.cfg--rw-r--r-1.cfg--rw-r--r-1.cfg-#vim-#vim-{uid:"admin",name::"admin@demo.nil",system:True{uid:"user1",name: :"user1@demo.nil"{uid:"user2",name: :"user2@demo.nil"#salt-runstate.orchceph.stage.2##salt-runstate.orchceph.stage.2#salt'*'saltutil.pillar_refresh#salt'*'pillar.items#sed#sed-i's/if(notself.in_dev_envandlen(storage)<4/ifself.in_dev_envandlen(storage)<2/g'/srv/modules/runners/validate.py#salt-runstate.orchceph.stage.3#ceph-#cephosdnode001:~#MAJ:MIN0SIZEROTYPE20G000000000020G00part/var/lib/ceph/osd/ceph-00020G00part/var/lib/ceph/osd/ceph-00#salt-runstate.orch#salt-runstate.orch#netstat-Active#netstat-ActiveInternetconnections(onlyProtoRecv-QSend-QLocalForeign 0 #vim .rgw.node001#vim .rgw.node001rgwfrontends="civetwebport=80"rgwdnsname=n#ll-rw-------1rootroot88Jul313:38 #cephauthkey:caps:[mon]allowrwxcaps:[osd]allowkey:AQA18FpZAAAAABAAVb+kpZVrrxs/mQE7jUTDKg==caps:[mon]allowrwxcaps:[osd]allowkey:AQD1wVhZAAAAABAA/zFfLelW89Fhs6W2qnWFnw==caps:[mon]allowrw#ceph--admin-daemongrep.rgw.node001.asokconfigshow"keyring":"/var/lib/ceph/radosgw/ceph-##ll/var/lib/ceph/radosgw/ceph--rw-------1cephceph139Jul313:39/var/lib/ceph/radosgw/ceph-#cat/var/lib/ceph/radosgw/ceph-rgw.node001/keyring key=capsmon="allowrwx"capsosd="allow##radoslspools ##radosgw-adminusercreate--uid="testuser2"-- y-name="Second{"user_id": y_name":"SecondUser", ":"","suspended":"max_buckets":"auid":0,"subusers":[],"keys":[{"user":"access_key":"secret_key":}##radosgw-adminsubusercreate--uid=testuser2--subuser=testuser2:swift--{"user_id": y_name":"SecondUser", ":"","suspended":"max_buckets":"auid":"subusers":{"id":"testuser2:swift","permissions":"full-control"}"keys":{"user":"access_key":"secret_key":}"swift_keys":{"user":"secret_key":}"caps":##radosgw-adminuser#radosgw-adminuserinfo--#radosgw-adminuserinfo--S3swift#vim#vims3test.pyimportbotoimportboto.s3.connectionaccess_key='FKKZNIX716C9DBJNFAGC'secret_key='evjmzeACxyN6IqY8u2qprL9OVOsoMX3iRD2rxICd'conn=boto.connect_s3(aws_access_key_id=access_key,aws_secret_access_keyaws_access_key_id=access_key,aws_secret_access_key=secret_key,host='21',port=80,calling_format=)bucket=conn.create_bucket('my-new-bucket')forbucketinconn.get_all_buckets():print"{name}\t{created}".format(name=,created=)#radosgw-admin#radosgw-adminuserinfo--#zypperinpython- #swift- -Utestuser2:swift-'zxxQr7zPnfGDMu0c6D1vpTiBsLPFpBXtcINNrk6z'list8、配置#zypperinstage4#zypperin#oaconfig#oaconfig#salt-callstate.applyceph.salt-#cp.openattic.keyringopenattic#RADOSGatewayManagement#systemctl#systemctlrestart#systemctlrestartopenattic-#lltotal#lltotal-rw-------1rootroot151Jul409:35#sudochgrpopenattic #sudo od644/etc/ceph/ceph. #lltotal-rw-r--r--1rootopenattic151Jul409:35 admin:~#admin:~#ceph-health:mon:3daemons,quorumnode001,node002,node003mgr:node002(active),standbys:node001,node003osd:6osds:6up,6in 6pools,104objects:205objects,2984 9183MBused,113GB/122GBavail 104active+cleanadmin:~#cephosdTYPE-root-host03-host14-host2up5up#vim24#vim24#zypper-n#zypper-ninsalt-#vim#vim/etc/salt/minion#master:saltmaster:#systemctlstartsalt-minion.service#systemctl#systemctlstartsalt-minion.service#systemctlenablesalt-admin:~#admin:~#salt-keyAcceptedKeys:DeniedKeys:UnacceptedKeys:nRejected#salt-key--accept-all#salt'*'test.#salt-run#salt-runstate.orchceph.stage.0#salt-runstate.orchsalt-runproposal.populate profile-test001#cd注意：記 #cd##vimprofile-db:'/dev/sdb'db_size:500mencryption:''format:bluestorewal:'/dev/sdb'wal_size:500mdb:'/dev/sdb'db_size:500mencryption:''format:bluestorewal:'/dev/sdb'wal_size:修改.cfg文##HardwareProfi