分布式對(duì)象存儲(chǔ)的運(yùn)維

1、新存儲(chǔ)，新運(yùn)維分布式對(duì)象存儲(chǔ)的運(yùn)維分布式對(duì)象存儲(chǔ)的運(yùn)維數(shù)據(jù)增剛需和對(duì)象存儲(chǔ)技術(shù)OpenStack Swift開(kāi)源分布式對(duì)象存儲(chǔ)系統(tǒng)Swift跨地域部署和存儲(chǔ)池 Swift志分析Swift監(jiān)控報(bào)警數(shù)據(jù)增剛需和對(duì)象存儲(chǔ)技術(shù)數(shù)據(jù)量持續(xù)快速增90%以上是結(jié)構(gòu)化數(shù)據(jù)海量小件與體積件共存數(shù)據(jù)訪問(wèn)模式變化虛擬化、云化、互聯(lián)訪問(wèn)這些數(shù)據(jù)不太冷數(shù)據(jù)共享數(shù)據(jù)管理式變化基于件夾的管理被 基于元數(shù)據(jù)的管理取代GIS融 醫(yī)療數(shù)據(jù)增剛需和對(duì)象存儲(chǔ)技術(shù)Object Store S3-like storagebuckets Objects are stored incontainersDataRESTful HTTP API

2、DELETE從根本上解決傳統(tǒng)件系統(tǒng)在件數(shù)量很多、存儲(chǔ)規(guī)模較時(shí)性能衰減、可擴(kuò)展性差、共享能差的問(wèn)題GETPUT簡(jiǎn) 潔 ！ 易擴(kuò)展！ 易共享！5OpenStack Swift開(kāi)源對(duì)象存儲(chǔ)data 1data 1data 1data 2data 2data 2data 3data 3data 3異地節(jié)點(diǎn)分布式，軟件定義服務(wù)器+硬盤(pán) 取代集中存儲(chǔ)設(shè)備data 1多副本機(jī)制，硬件故障不影響數(shù)據(jù)存儲(chǔ)的 可靠性和可性跨地域，實(shí)現(xiàn)我容災(zāi)、訪問(wèn)加速datadata32域絡(luò)Swift跨地域部署和存儲(chǔ)池Region 1data 1data 1Region 2data 1data 2data 2data 2data

3、3data 3data 3域絡(luò)Swift跨地域部署和存儲(chǔ)池存儲(chǔ)策略/存儲(chǔ)池Storage PolicyRequestsRead AffinityWrite AffinityOnly affect object PUTSwift志分析Swift志分析Jul 27 01:32:50 node2 account-replicator: 2 successes, 0 failuresJul2701:32:50node2account-replicator:no_change:2ts_repl:0diff:0rsync:0diff_capped:0hashmatch:0 empty:0Jul 27 01

4、:32:51 node2 container-server: 30 - - 26/Jul/2016:17:32:51 +0000 PUT /sdb/ 826/AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 201 - PUT 0:8080/sdb/734/AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 tx87955217f57444bfaa9e6-0057979ec3 object-server 2079 0.0004 - 5108 0Jul 27 01:32:51

5、 node2 object-server: 32 - - 26/Jul/2016:17:32:51 +0000 PUT /sdc/ 734/AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 201 - PUT 0:8080/v1/AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56tx87955217f57444bfaa9e6-0057979ec3 proxy-server 5111 0.0163 - 5110 0Jul 27 01:32:51 node2 proxy-ser

6、ver: 41 41 26/Jul/2016/17/32/51 PUT /v1/ AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 HTTP/1.0 201 - python-requests/ 2.7.0%20CPython/2.7.6%20Linux/3.13.0-32-generic AUTH_tk031c8ad99. 10240 - - tx87955217f57444bfaa9e6-0057979ec3 - 0.0232 - - 1469554371.622150898 1469554371.645317078 0Jul

7、27 01:32:51 node2 Keepalived_vrrp4499: VRRP_Instance(LVS) Received higher prio advert Jul 27 01:32:51 node2 Keepalived_vrrp4499: VRRP_Instance(LVS) Entering BACKUP STATEJul 27 01:32:53 node2 account-server: 30 - - 26/Jul/2016:17:32:53 +0000 HEAD /sdb/ 151/AUTH_test 204 - HEAD 0:8080/v1/AUTH_test txc

8、467dba681f34a4e818fa-0057979ec5 proxy-server 2082 0.0014 - 5109 -Jul 27 01:32:55 node2 object-auditor: Begin object audit forever mode (ZBF)Jul 27 01:32:55 node2 object-auditor: Object audit (ZBF). Since Tue Jul 26 17:32:55 2016: Locally:1 passed, 0 quarantined, 0 errors, files/sec: 702.33, bytes/se

9、c: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00Jul 27 01:32:56 node2 object-replicator: Starting object replication pass.Jul 27 01:33:00 node2 object-replicator: 920/920 (100.00%) partitions replicated in 3.76s (244.37/ sec, 0s remaining)Swift志分析Jul 27 01:32:50 node2 account-replicator: 2

10、 successes, 0 failuresJul2701:32:50node2account-replicator:no_change:2ts_repl:0diff:0rsync:0diff_capped:0hashmatch:0 empty:0Jul 27 01:32:51 node2 container-server: 30 - - 26/Jul/2016:17:32:51 +0000 PUT /sdb/ 826/AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 201 - PUT 0:8080/sdb/734/AUTH_te

11、st/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 tx87955217f57444bfaa9e6-0057979ec3 object-server 2079 0.0004 - 5108 0Jul 27 01:32:51 node2 object-server: 32 - - 26/Jul/2016:17:32:51 +0000 PUT /sdc/ 734/AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 201 - PUT 0:8080/v1/AUTH_test/nacho/c80a8

12、1ee-7705-4866-b363-618d3e9849f8-56tx87955217f57444bfaa9e6-0057979ec3 proxy-server 5111 0.0163 - 5110 0Jul 27 01:32:51 node2 proxy-server: 41 41 26/Jul/2016/17/32/51 PUT /v1/ AUTH_test/nacho/c80a81ee-7705-4866-b363-618d3e9849f8-56 HTTP/1.0 201 - python-requests/ 2.7.0%20CPython/2.7.6%20Linux/3.13.0-3

13、2-generic AUTH_tk031c8ad99. 10240 - - tx87955217f57444bfaa9e6-0057979ec3 - 0.0232 - - 1469554371.622150898 1469554371.645317078 0Jul 27 01:32:51 node2 Keepalived_vrrp4499: VRRP_Instance(LVS) Received higher prio advert Jul 27 01:32:51 node2 Keepalived_vrrp4499: VRRP_Instance(LVS) Entering BACKUP STA

14、TEJul 27 01:32:53 node2 account-server: 30 - - 26/Jul/2016:17:32:53 +0000 HEAD /sdb/ 151/AUTH_test 204 - HEAD 0:8080/v1/AUTH_test txc467dba681f34a4e818fa-0057979ec5 proxy-server 2082 0.0014 - 5109 -Jul 27 01:32:55 node2 object-auditor: Begin object audit forever mode (ZBF)Jul 27 01:32:55 node2 objec

15、t-auditor: Object audit (ZBF). Since Tue Jul 26 17:32:55 2016: Locally:1 passed, 0 quarantined, 0 errors, files/sec: 702.33, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00Jul 27 01:32:56 node2 object-replicator: Starting object replication pass.Jul 27 01:33:00 node2 object-replic

16、ator: 920/920 (100.00%) partitions replicated in 3.76s (244.37/ sec, 0s remaining)Swift志分析志拆分結(jié)構(gòu)化構(gòu)造搜索條件Swift志分析志拆分if $programname = swift then /var/log/swift/swift.logif $programname = account-server then /var/log/swift/account-server.logif $programname = account-replicator then /var/log/swift/accoun

17、t-replicator.log if $programname = account-auditor then /var/log/swift/account-auditor.logif $programname = account-reaper then /var/log/swift/account-reaper.logif $programname = container-server then /var/log/swift/container-server.logif $programname = container-replicator then /var/log/swift/conta

18、iner-replicator.log if $programname = container-updater then /var/log/swift/container-updater.logif $programname = container-auditor then /var/log/swift/container-auditor.logif $programname = container-sync then /var/log/swift/container-sync.log if $programname = object-server then /var/log/swift/ob

19、ject-server.logif $programname = object-replicator then /var/log/swift/object-replicator.logif $programname = object-updater then /var/log/swift/object-updater.log if $programname = object-auditor then /var/log/swift/object-auditor.logSwift志分析結(jié)構(gòu)化Aug 4 14:33:47 swift11 proxy-server: 1 1 04/Aug/ 2016/

20、06/33/47 PUT /v1/AUTH_94cc9b871be647f2bd505aba2f71374e/test/ etc/apparmor.d/abstractions/ldapclient HTTP/1.0 201 - python- s w i f t c l i e n t - 3 . 0 . 0 1 6 2 5 3 a 1 d 1 6 b 4 4 3 3 a . . . 6 8 6 - -tx82d631d7e2a94d2dada82-0057a2e1cb-0.0482-1470292427.7015080451470292427.749711037 0系統(tǒng)時(shí)間戳，主機(jī)名，服務(wù)

21、名，客戶端IP，遠(yuǎn)端節(jié)點(diǎn)IP，代理服務(wù)時(shí) 間戳，HTTP請(qǐng)求法，HTTP請(qǐng)求路徑，HTTP版本，響應(yīng)狀態(tài)碼， HTTP referer，戶代理，認(rèn)證令牌，接收數(shù)據(jù)量，發(fā)送數(shù)據(jù)量，客 戶端etag，Transaction ID，頭信息，延遲時(shí)間，HTTP source， 志信息，請(qǐng)求開(kāi)始時(shí)間，請(qǐng)求結(jié)束時(shí)間，存儲(chǔ)策略編號(hào)。構(gòu)造搜索條件Swift志分析結(jié)構(gòu)化Aug 4 14:33:47 swift11 proxy-server: 1 1 04/Aug/ 2016/06/33/47 PUT /v1/AUTH_94cc9b871be647f2bd505aba2f71374e/test/ etc/apparmor.d/abstractions/ldapclient HTTP/1.0 201 - python- s w i f t c l i e n t - 3 . 0 . 0 1 6 2 5 3 a 1 d 1 6 b 4 4 3 3 a . . . 6 8 6 - -tx82d631d7e2a94d2dada82-0057a2e1cb-0.0482-1470292427.7015080451470292427.749711037 0系統(tǒng)時(shí)間戳，主機(jī)名，服務(wù)名，客戶端IP，遠(yuǎn)端節(jié)點(diǎn)IP，代理服務(wù)時(shí) 間戳，HTTP請(qǐng)求法，HTTP請(qǐng)求路徑，HTTP版本，響應(yīng)狀態(tài)碼， HT