Array APV負載均衡培訓

1、2022-6-18APV Technical TrainingConfidential: Array Internal Use Only2022-6-182內(nèi)容內(nèi)容 Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹 APV負載均衡器工作原理負載均衡器工作原理 APV初始化安裝與基本配置初始化安裝與基本配置 集群配置集群配置 典型組網(wǎng)典型組網(wǎng)Confidential: Array Internal Use Only2022-6-183Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹APV 1200 4*1000M ports 1000 Mbps t

2、hroughput Intel Celeron Processor 1GB RAM Confidential: Array Internal Use Only2022-6-184Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹APV 2200 4*1000M ports 2*1000M SFP 1500 Mbps throughput Intel P4 Processor 2GB RAM Confidential: Array Internal Use Only2022-6-185Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹APV 3200

3、8*1000M ports 2*1000M SFP 2Gbps throughput Intel P4 Processor 4GB RAM Confidential: Array Internal Use Only2022-6-186Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹APV 5200 8*1000M ports 4*1000M SFP 8Gbps throughput AMD Quad-Core Processor 4GB RAM Confidential: Array Internal Use Only2022-6-187Array Appvelocit

4、y（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹APV 6200 8*1000M ports 4*1000M SFP 2*10G ports(可選) 10Gbps throughput AMD Quad-Core Processor 8GB RAM Confidential: Array Internal Use Only2022-6-188Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹APV 6250 8*1000M ports 4*1000M SFP 2*10G ports12Gbps throughput AMD Quad-Core Processor 8GB RAM

5、Confidential: Array Internal Use Only2022-6-189內(nèi)容內(nèi)容 Array Appvelocity（簡稱（簡稱APV）產(chǎn)品介紹）產(chǎn)品介紹 APV負載均衡器工作原理負載均衡器工作原理 APV初始化安裝與基本配置初始化安裝與基本配置 集群配置集群配置 典型組網(wǎng)典型組網(wǎng)Confidential: Array Internal Use Only2022-6-1810SLB Terminology Real Service (“Real”)- Represents a physical service which will handle client reques

6、ts Real Service Group (“Group”)- Represents a group of real services which traffic will be distributed to- Defines which load balancing algorithm to use Virtual Service (“Virtual”)- Represents a virtual service that clients can connect to Policy- Associates real service groups with virtual servicess

7、ervice 1service 5service 4service 3service 2Real 1Real 3Real 4Real 5Real 2Group 1Group 2Virtual 1Virtual 2InternetConfidential: Array Internal Use Only2022-6-1811Server Load Balancing Example Basic Server Load balancingInternetService GroupReal servicesVirtual IP012345User enters in their

8、browser. Hostname sent to DNS for resolution.1DNS resolves to the Virtual IP address (VIP) of 0.2Client sends request to VIP.3Array proxies request to selected real service.4Further requests from the client may be sent to the same or a different real service, depending on persistency confi

9、guration.5DNSConfidential: Array Internal Use Only2022-6-1812SLB Modes Server Load Balancing can be performed in three modes:- Reverse Proxy ModeArray APV proxies all client connections to real services.- Transparent ModeArray APV transparently proxies all client connections to real services.- Trian

10、gle ModeArray APV transparently proxies all client connections to real services.Confidential: Array Internal Use Only2022-6-1813Reverse Proxy Mode Packet Flow1.Client connects to VIP on Array APV and sends request to Array APV.2.Array APV opens a new connection to real service and sends request to s

11、ervice.3.service responds to Array APV.4.Array APV responds to Client.VirtualInternetservice1 service2Inside InterfaceOutside Interface1234Confidential: Array Internal Use Only2022-6-1814Reverse Proxy Mode TranslationsVirtualInternetservice1 service2Inside InterfaceOutside Interface1234Step Source I

12、P Source PortDestination IPDestination Port1Client-IPClient-PortVirtual-IP Virtual-Port2Inside-IP Inside-PortReal-IPReal-Port3Real-IPReal-PortInside-IP Inside-Port4Virtual-IP Virtual-PortClient-IPClient-PortConfidential: Array Internal Use Only2022-6-1815Transparent Mode Packet Flow1.Client sends re

13、quest to VIP on Array APV.2.Array APV forwards request to real service, maintaining the clients IP.3.Real service returns response via client IP (handled by Array APV).4.Array APV forwards response to Client.Virtual IPInternetservice1 service2235461Confidential: Array Internal Use Only2022-6-1816Tra

14、nsparent Mode TranslationsVirtual IPInternetservice1 service2235461Step Source IP Source PortDestination IPDestination Port1Client-IPClient-PortVirtual-IP Virtual-Port23Client-IPClient-PortReal-IPReal-Port4Real-IPReal-PortClient-IPClient-Port56Virtual-IP Virtual-PortClient-IPClient-PortConfidential:

15、 Array Internal Use Only2022-6-1817Triangle Transmission ModeTriangle Transmission Arrays Triangle Transmission is specially designed for low-inbound/high-outbound applications such as Video On Demand (VOD), and to accommodate requests in the quickest and most efficient manner. A new system mode “tr

16、iangle mode” is added for this new feature.For triangle transmission, when selecting a proper real server from a group, administrators can use Round Robin (rr), Persistent IP (pi), Hash IP (hi), Consistent Hash IP (chi), Least connections (lc and SNMP (snmp) group method.Confidential: Array Internal

17、 Use Only2022-6-1818Working Flow 1.Client sends a request to a Virtual IP 0 on Array APV by the router.2.Array APV forwards the request to a real service. The Virtual IP 0 has been configured as the loopback interface on the real service, so that the request can be received by the

18、real service.3.The real service returns response to the router directly. Since the default route IP on the real service is set to be , the response will be sent to the router directly 4.The request will pass through APV, the response will be sent from the real server to the client directly

19、without hitting APV.Notes: triangle transmission SLB health is based on the system IP addresses of the real servers, not the loopback IP addresses. This means when health check is up, the real service might not be available. Triangle Transmission ModeConfidential: Array Internal Use Only2022-6-1819負

20、載均衡算法負載均衡算法非保持性算法非保持性算法 1, Round Robin(RR) 2, Least Connection(LC) 3, Fastest Response Time(FRT)保持性算法保持性算法 1, Persistent IP(PI) 2, Hash IP(HI) 3, Consistent Hash IP(CHI) 4, Hash Header(HH) 5, Persistent Hostname(PH) 6, Persistent URL(PU) 7,SSL Session ID(SSLID) 8, Persistent Cookie(PC) 9, Rewirte Co

21、okie(RC) 10, Insert Cookie(IC) 11,Hash Cookie(HC) 12,Embed Cookie(EC) 13,Confidential: Array Internal Use Only2022-6-1820Round Robin (rr) Distributes new connections sequentially between available real services.- Example: Connections are distributed to the real services in the following order:1, 2,

22、3, 4, 5, 1, 2, 3 The “granularity” option may be configured so that each real service handles a specific number of new connections before the next service is selected.- Example: Granularity value of “3” illustrates the distribution:1, 1, 1, 2, 2, 2, 3, 3, 3, etc.InternetConfidential: Array Internal

23、Use Only2022-6-1821Round RobinClientsRouterAPVServersClient requests are distributed evenly12345678InternetRound Robin (rr)Confidential: Array Internal Use Only2022-6-1822Least Connections (lc) Distributes new connections to the real service that has the least number of current connections.- Example

24、: real service 5 has the fewest current connections, so the next connection will go to real service 5. The “granularity” option can be used to treat real services within the same connection count range as the same; a new real service will not be chosen until this range is exceeded for the current on

25、e.InternetConfidential: Array Internal Use Only2022-6-1823ClientsRouterServers12InternetDistributes new connections to the real service that has the least number of current connections.462460455465Current ConnectionsLeast Connections (lc)Confidential: Array Internal Use Only2022-6-1824Real Service W

26、eighting (rr, lc) Weighting allows you to change the distribution between real services in the group.- Example: You may set one service to handle twice as many connections as another service. Use weighting if you have a mix of backend services with different performance capabilities. - Example: If y

27、ou add new services that have faster CPUs, you could weight them higher so they receive more connections.Server 1Weight 3Server 5Weight 1Server 4Weight 1Server 3Weight 2Server 2Weight 3Real 1Real 3Real 4Real 5Real 2Group 1Connection 2Connection 3Connection 4Connection 5Connection 1VIP 1Public IPPoli

28、cy 1Method Round RobinInternetIncomingTraffic from theInternetConnection 6Connection 7Connection 8Connection 11Connection 10Connection 9Connection 12Connection 13Connection 14InternetConfidential: Array Internal Use Only2022-6-1825ClientsRouterServersAdministrator sets ratio for distributing Client

29、requests 3:1:1:114567101112Internet2389Real Service Weighting (rr, lc)APVXConfidential: Array Internal Use Only2022-6-1826ClientsRouterServers12Internet10ms5ms20ms17msCurrent Response TimesFastest Response time (frt)Distributes new connections to the real service that has the shortest response time.

30、Confidential: Array Internal Use Only2022-6-1827the same IP request should be assigned to the same server. 123123Persistent IP (pi)Confidential: Array Internal Use Only2022-6-1828Hash IP (hi) Distributes new connections to a real service based on a hash of the source IP address.- Client sends a requ

31、est to the virtual service.- Array hashes source IP address of request to select a real service.- Array forwards all requests with same hash value to the same real service. Note- If a real service fails, persistence will not be maintained for existing clients on healthy services.- Consistent mapping

32、s of client IP to real service across multiple Arrays during failover is not guaranteed.Confidential: Array Internal Use Only2022-6-1829Consistent Hash IP (chi) Distributes new connections to a real service based on a hash of the source IP address.- Client sends a request to the virtual service.- Ar

33、ray hashes source IP address of request to select a real service.- Array forwards all requests with same hash value to the same real service. Note- If a real service fails, persistence will be maintained for existing clients on healthy services.- Mappings of client IP to real service are consistent

34、across all Arrays so that clients will continue to go to the same real service on failover.Confidential: Array Internal Use Only2022-6-1830Hash Header (hh) Distributes new connections to a real service based on a hash of a non-standard/standard HTTP Header - Non-standard header = headers not defined

35、 in RFC 2616 (HTTP/1.1) Example:- X-MSISDN header generated by WAP gatewaysAll wireless clients (mobile phones) proxied through a WAP gateway have the same source IP address.Problem for client-IP persistence methods!Options include cookie-persistence and Hash Header methods.WAP gateway can receive M

36、SISDN (phone number) of user from Radius and insert it into proxied HTTP request as X-MSISDN header.Hash Header on this header provides good load distribution across the real services while maintaining client persistence.Confidential: Array Internal Use Only2022-6-1831Persistent Hostname (ph) Distri

37、butes new connections to a real service based on a hash of the hostname found in the HTTP requests Host header sent from the client.- Client sends a request to the virtual service with a Host: header.- Array examines Host: header value to select a real service.- Array forwards all requests with same

38、 Host: header value to the same real service.Confidential: Array Internal Use Only2022-6-1832Persistent URL (pu) Distributes new connections to a real service based on a static match of a URL Tag and Value.- Client sends a request to the virtual service with a Tag and Value included in the URL.- Arr

39、ay hashes Value to select a real service.- Array forwards all requests with same Tag and Value to the same real service.Confidential: Array Internal Use Only2022-6-1833SSL Session ID (sslsid) SSL Session ID (negotiated during SSL connection setup) is used to maintain a client-to-service binding.- Cl

40、ient opens an HTTPS connection to the virtual service.- Array selects a real service and forwards request to it.- Response from real service contains an SSL Session ID.- Array tracks SSL SID and real service combination.- Next request from client contains SSL SID.- Array examines SSL SID and sends r

41、equest to the same real service that was chosen earlier. May only be used when load balancing SSL connections.Confidential: Array Internal Use Only2022-6-1834Persistent Cookie (pc) Real service is selected based on a static match of the cookie name/value pair. - Client sends a request to the virtual

42、 service.- Array selects a real service and forwards request to it.- Response from real service contains a specific cookie with a value denoting that service.- Client receives cookie in response.- Next request from client includes cookie.- Array examines cookie and sends request to proper real servi

43、ce. Each real service within a group must be configured with a unique cookie value.Confidential: Array Internal Use Only2022-6-1835ClientServerHTTP request (no cookie)TCP handshakeTCP handshakeHTTP request (no cookie)HTTP reply (with special cookie)HTTP reply (with special cookie)pickserver HTTP req

44、uest (with same cookie)TCP handshakeTCP handshakeHTTP request (with same cookie)HTTP reply (with special cookie)HTTP reply (with special cookie)cookiespecifiesserver First HitSecond HitAPVPersistent Cookie (pc)Confidential: Array Internal Use Only2022-6-1836Rewrite Cookie (rc) Array rewrites (modifi

45、es) a named cookies value in the service response.- Client sends a request to the virtual service.- Array selects a real service and forwards request to it.- Response from real service contains a specific cookie with a generic value.- Array rewrites cookie value based on the real service.- Client re

46、ceives cookie in response.- Next request from client includes cookie.- Array examines cookie and sends request to indicated real service. Used to simplify cookie based persistence configuration. All backend services within a group must set the same name=value pair.Confidential: Array Internal Use On

47、ly2022-6-1837ClientServerHTTP request (no cookie)TCP handshakeTCP handshakeHTTP request (no cookie)HTTP reply (with simple cookie)HTTP reply (with rewritten cookie)pickserver HTTP request (with same cookie)TCP handshakeTCP handshakeHTTP request (with same cookie)HTTP reply (with simple cookie)HTTP r

48、eply (with updated cookie)cookiespecifiesserver First HitSecond HitAPVRewrite Cookie (rc)Confidential: Array Internal Use Only2022-6-1838Insert Cookie (ic) Array automatically inserts a Cookie in the service response- Client sends a request to the virtual service.- Array selects a real service and f

49、orwards request to it.- Response from real service does not contain a cookie, but cookie persistence is needed.- Array creates a cookie based on the real service and inserts it in the response.- Client receives cookie in response.- Next request from client includes cookie.- Array examines cookie, st

50、rips out cookie, and sends request to same real service as first request. Used in cases where the web site does not have built-in cookie support.Confidential: Array Internal Use Only2022-6-1839ClientServerHTTP request (no cookie)TCP handshakeTCP handshakeHTTP request (no cookie)HTTP reply (no cookie

51、)HTTP reply (with inserted cookie)pickserver HTTP request (with same cookie)TCP handshakeTCP handshakeHTTP request (no cookie)HTTP reply (no cookie)HTTP reply (updated cookie)cookiespecifiesserver First HitSecond HitAPVInsert Cookie (ic)Confidential: Array Internal Use Only2022-6-1840Hash Cookie (hc

52、) Real service selection is based on a hash of the specified cookies value. Used when each client browser session to the web site results in a unique cookie value for that browser session.Confidential: Array Internal Use Only2022-6-1841ClientServerHTTP request (no cookie)TCP handshakeTCP handshakeHT

53、TP request (no cookie)HTTP reply (with cookie)HTTP reply (with cookie)pickserver HTTP request (with same cookie)TCP handshakeTCP handshakeHTTP request (with same cookie)HTTP reply (with cookie)HTTP reply (with cookie)cookie hash specifiesserver First HitSecond HitThird HitServerTCP handshakeHTTP req

54、uest (with same cookie)HTTP reply (with cookie)cookie hash specifiesserver TCP handshakeHTTP request (with same cookie)HTTP reply (with cookie)APVHash Cookie (hc)Confidential: Array Internal Use Only2022-6-1842Embed Cookie（ec） Embed cookie allows us to embed a section of a cookie value to the cookie

55、 can be sent back to the same server. - Client sends a request to the virtual service.- Array selects a real service and forwards request to it.- Response from real service contains a cookie.- Array embeds a specific value based on the real service.- Client receives cookie in response.- Next request

56、 from client includes cookie.- Array examines cookie and removes the embedded value, then sends request to indicated real service. Unlike rewrite cookie, we will strip out the modifications that the ArrayOS has made in the request. so the backend will see the original cookie.Confidential: Array Inte

57、rnal Use Only2022-6-1843Embed Cookie（ec）ClientServerHTTP request (no cookie)TCP handshakeTCP handshakeHTTP request (no cookie)HTTP reply (with cookie)HTTP reply (with embedded cookie)pickserver HTTP request (with same cookie)TCP handshakeTCP handshakeHTTP request (with original cookie)HTTP reply (wi

58、th cookie)HTTP reply (with embedded cookie)cookiespecifiesserver First HitSecond HitAPVConfidential: Array Internal Use Only2022-6-1844幾種算法的區(qū)別幾種算法的區(qū)別SideHitCookie MethodMethodicrcecpcHc服務器端服務器端First HitNo CookieOrigin Server CookieOriginServerCookieOrigin ServerOrigin ServerSecond HitWritten Cookie客

59、戶端客戶端Array Insert CookieArray Written CookieArrayEmbedCookieOrigin ServerOrigin ServerInsert CookieInsert Cookie ：Array會自動插入一個Cookie。Re-Write CookieRe-Write Cookie：Array在Response時重寫Cookie的值，服務器看到的已經(jīng)是修改后的Cookie。Embed CookieEmbed Cookie：Array在Response時在服務器回應的Cookie里，插入一段值。Persistent CookiePersistent Cookie：根據(jù)服務器的Cookie的值進行保持（靜態(tài)匹配）Hash CookieHash Cookie：根據(jù)服務器的Cookie的值進行保持（不需要靜態(tài)匹配，Hash Cookie的值）Confidential: Array Internal Use Only2022-6-1845SLB Virtual Services The following parameters are associated with a virtual service:- Virtual service protocol (udp, tcp, ftp, http; tcps and https for SSL)-