Redhat5下haproxy+keepalived+nginx配置笔记
Redhat5下haproxy+keepalived+nginx配置筆記
----by knight
?HA:高可用性
keepalived個(gè)人簡單理解就是實(shí)現(xiàn)一個(gè)虛IP在keepalived主從服務(wù)器之間切換的功能，當(dāng)主的keeplived掛掉，從機(jī)會(huì)無縫接管該虛IP。
keepalived它作為一個(gè)輔助實(shí)現(xiàn)高可用性工具，一般都會(huì)配合某個(gè)具體服務(wù)工作，例如mysql,drbd，haproxy等，本篇介紹的就是haproxy,在前期做好keepalived配置后，做一個(gè)切換腳本，當(dāng)haproxy掛掉后，腳本會(huì)立即執(zhí)行keepalived關(guān)閉操作，從而讓從機(jī)接管,該虛IP其實(shí)會(huì)和本機(jī)的物理IP做綁定，訪問虛IP其實(shí)就可以理解為訪問本機(jī)物理IP，該虛IP會(huì)在腳本被觸發(fā)后切換到從機(jī)，而后訪問虛IP也就是在訪問從機(jī)物理IP，從而實(shí)現(xiàn)haproxy的高可用性。
這個(gè)實(shí)驗(yàn)?zāi)M的功能其實(shí)就是利用haproxy實(shí)現(xiàn)apache服務(wù)器間的負(fù)載均衡，緩解并發(fā)壓力，并保證haproxy-master若掛掉,haproxy-backup能無縫接管，實(shí)現(xiàn)WEB站點(diǎn)負(fù)載均衡+高可用性。保證客戶端無縫獲取網(wǎng)站資源。
解決方案：
系統(tǒng)環(huán)境：centos5
nginx: nginx-1.2.8
haproxy: haproxy-1.4.8
keepalived：keepalived-1.2.7
haproxy VIP(虛擬ip): ? ? ? ? ? ? ? ? 192.168.1.120
haproxy-master(haproxy1): ? ?192.168.1.108 ? ?www1.example.com
haproxy-backup(haproxy2): ? ? 192.168.1.109 ? www2.example.com
nginx1: ? ? ? ? ? ? ? ? ? ? 192.168.1.108 ? www1.example.com
nginx2: ? ? ? ? ? ? ? ? ? ? 192.168.1.109 ? www2.example.com
由于我只開了兩個(gè)虛擬機(jī)，所以loadbalancer(負(fù)載均衡器)也做web。
192.168.1.108 ==192.168.7.71
192.168.1.109 ==192.168.7.72
192.168.1.108 == 192.168.7.73 web1
192.168.1.109 == 192.168.7.74
(haproxy1)為僅haproxy1配置
(haproxy2)為僅haproxy2配置
(haproxy1，haproxy2)為haproxy1和haproxy2都得配置
部署環(huán)境：
1.關(guān)閉iptables和SELINUX
# service iptables stop
# setenforce 0
# vi /etc/sysconfig/selinux
---------------
SELINUX=disabled
---------------
2.nginx安裝
這里不做介紹。
安裝完畢只需配置客戶端瀏覽器訪問根頁面顯示本機(jī)IP地址。
一.haproxy安裝配置：(haproxy1，haproxy2)
# wget http://haproxy.1wt.eu/download/1.4/src/haproxy-1.4.8.tar.gz
# tar zxvf haproxy-1.4.8.tar.gz
# cd haproxy-1.4.8
# uname -a ? ? ? ? ?//查看linux內(nèi)核版本
# make TARGET=linux26 PREFIX=/usr/local/haproxy
# make install PREFIX=/usr/local/haproxy
# useradd -s /sbin/nologin haproxy
# passwd haproxy
# chown -R haproxy.haproxy /usr/local/haproxy
配置：
# vi /usr/local/haproxy/haproxy.cfg
-----------------
global
log 127.0.0.1 local0
maxconn 5120 ?
chroot /usr/local/haproxy ?
user haproxy ?
group haproxy ?
daemon ?
quiet ?
nbproc ?1 ?
pidfile /usr/local/haproxy/haproxy.pid
#啟動(dòng)服務(wù)后后會(huì)滾動(dòng)日志，生產(chǎn)環(huán)境建議注釋掉
debug ?
defaults
log 127.0.0.1 local3 ?
mode http ?
option httplog
option httpclose
option ?dontlognull
#option ?forwardfor ?
option ?redispatch
retries 2
maxconn 2000
balance source ?
contimeout ? ? ?5000 ?
clitimeout ? ? ?50000 ?
srvtimeout ? ? ?50000 ?
listen 192.168.1.120 :81//由于負(fù)載均衡器和web是同一臺(tái)所以不能用80，會(huì)端口沖突。
? ? server www1 192.168.1.108:80 ?weight 5 check inter 2000 rise 2 fall 5
? ? server www2 192.168.1.109:80 ?weight 5 check inter 2000 rise 2 fall 5
listen stats :8888 ? //監(jiān)控頁面端口
mode http ?
#transparent ?
stats uri / haproxy-stats ?
stats realm Haproxy \ statistic
#認(rèn)證
stats auth haproxy:password ? //haproxy監(jiān)控頁面的帳密
-----------------
啟動(dòng)haproxy
# /usr/local/haproxy/sbin/haproxy -f/usr/local/haproxy/haproxy.cfg &
注：這里加上“&”是為了讓haproxy服務(wù)后臺(tái)運(yùn)行，去掉“&”可實(shí)時(shí)查看其滾動(dòng)日志
日志：
------------------------
Available polling systems :
? ?sepoll : pref=400, test result OK
? ? epoll : pref=300, test result OK
? ? ?poll : pref=200, test result OK
? ?select : pref=150, test result OK
Total: 4 (4 usable), will use sepoll.
Using sepoll() as the polling mechanism.
00000000:web_proxy.accept(0004)=0007from [192.168.7.129:5752]
00000000:web_proxy.clireq[0007:ffff]:GET / HTTP/1.1
00000000:web_proxy.clihdr[0007:ffff]:Accept: text/html, application/xhtml+xml, */*
00000000:web_proxy.clihdr[0007:ffff]:Accept-Language: zh-CN
00000000:web_proxy.clihdr[0007:ffff]:User-Agent: Mozilla/5.0 (compatible; MSIE
9.0; Windows NT 6.1; WOW64; Trident/5.0)
00000000:web_proxy.clihdr[0007:ffff]:Accept-Encoding: gzip, deflate
00000000:web_proxy.clihdr[0007:ffff]:Host: 192.168.7.71
00000000:web_proxy.clihdr[0007:ffff]:If-Modified-Since: Tue, 28 May 2013 18:22:10
GMT
00000000:web_proxy.clihdr[0007:ffff]:If-None-Match: "10-4ddcb57ecf1ee"
00000000:web_proxy.clihdr[0007:ffff]: Connection:Keep-Alive
00000000:web_proxy.srvrep[0007:0008]:HTTP/1.1 304 Not Modified
00000000:web_proxy.srvhdr[0007:0008]:Date: Tue, 28 May 2013 19:48:35 GMT
00000000:web_proxy.srvhdr[0007:0008]:Server: Apache/2.4.4 (Unix)
00000000:web_proxy.srvhdr[0007:0008]:Connection: close
00000000:web_proxy.srvhdr[0007:0008]:ETag: "10-4ddcb57ecf1ee"
00000000:web_proxy.srvcls[0007:0008]
00000000:web_proxy.clicls[0007:0008]
00000000:web_proxy.closed[0007:0008]
------------------------
查看是否啟動(dòng)
# ps -ef|grep haproxy
重啟haproxy
# pkill haproxy
# /usr/local/haproxy/sbin/haproxy -f/usr/local/haproxy/haproxy.cfg
其中：
haproxy代理：192.168.1.120:81
nginx1： ? ?192.168.1.108:80
nginx2： ? ?192.168.1.109:80
統(tǒng)計(jì)頁面監(jiān)聽的端口：8888
訪問頁面：
http://192.168.1.108:8888
認(rèn)證賬號(hào)/密碼：haproxy/password
總結(jié)：
通過日志可以看出，客戶端192.168.1.103連接haproxy192.168.7.71的80端口，且客戶端無論如何刷新頁面，haproxy都只會(huì)把訪問請(qǐng)求跳轉(zhuǎn)到nginx的192.168.1.109地址，這是因?yàn)閎alance source這個(gè)參數(shù)會(huì)保持會(huì)話ID,如果改成balance roundrobin模式，那么客戶端會(huì)輪流連接兩臺(tái)web服務(wù)器，線上還是建議使用balance source,這樣會(huì)保持某一客戶端在長時(shí)間內(nèi)保持他的會(huì)話，不會(huì)來回跳轉(zhuǎn)。
這里其實(shí)已經(jīng)利用haproxy完成了對(duì)兩臺(tái)nginx服務(wù)器的負(fù)載均衡功能，但如何保證負(fù)載均衡的高可用性，這里就得利用keepalived的熱備功能，保證haproxy1如果掛掉，haproxy2能實(shí)時(shí)接管，實(shí)現(xiàn)網(wǎng)站前端負(fù)載均衡高可用，這也是我們目前比較流行的組合haproxy+keepalived。
二.keepalived安裝配置：(haproxy1，haproxy2）
# wget http://www.keepalived.org/software/keepalived-1.2.7.tar.gz
# tar zxvf keepalived-1.2.7.tar.gz
# cd keepalived-1.2.7
# ./configure--prefix=/usr/local/keepalived --with-kernel-
dir=/usr/src/kernels/2.6.32-279.el6.x86_64
# make && make install
設(shè)置keepalived啟動(dòng)腳本
# cp/usr/local/keepalived/etc/rc.d/init.d/keepalived /etc/rc.d/init.d/
# cp/usr/local/keepalived/etc/sysconfig/keepalived /etc/sysconfig/
# mkdir /etc/keepalived
# cp/usr/local/keepalived/sbin/keepalived /usr/sbin/
# chkconfig keepalived on
(haproxy1）
# vi /etc/keepalived/keepalived.conf
----------------------
! Configuration File for keepalived
global_defs {
router_id LVS_DEVEL
}
vrrp_instance VI_1 {
state MASTER
interface eth0
virtual_router_id 51
priority 150
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.1.120
}
}
----------------------
(haproxy2）
# vi /etc/keepalived/keepalived.conf
----------------------
! Configuration File for keepalived
global_defs {
router_id LVS_DEVEL
}
vrrp_instance VI_1 {
state BACKUP
interface eth0
virtual_router_id 51
priority 120
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.1.120
}
}
----------------------
啟動(dòng)keepalived
# service keepalived start
# ps -ef |grep keepalived
----------------------
注：在沒有做haproxy+keepalived的腳本（check_haproxy.sh）是沒有紅色框那一行
-----------------------
創(chuàng)建haproxy+keepalived腳本：
實(shí)現(xiàn)當(dāng)haproxy掛掉后，能再次啟動(dòng)haproxy,若無法再次啟動(dòng)則徹底關(guān)閉keepalived將VIP交給
從機(jī)處理。
(haproxy1，haproxy2）
# vi /etc/keepalived/check_haproxy.sh
---------------------
#!/bin/bash
while :
do
hapid=`ps -C haproxy --no-header |wc -l`
?if [ $hapid -eq 0 ];then
?/usr/local/haproxy/sbin/haproxy-f /usr/local/haproxy/haproxy.cfg
?sleep 5
? ?if [ $hapid -eq 0 ];then
? ?/etc/init.d/keepalivedstop
? ?fi
?fi
?sleep 5
done
--------------------
改執(zhí)行權(quán)限
# chmod 755 /etc/keepalived/check_haproxy.sh
強(qiáng)制后臺(tái)執(zhí)行（關(guān)閉客戶端連接也會(huì)繼續(xù)運(yùn)行）
# nohup sh /etc/keepalived/check_haproxy.sh
三.測試：
1.在兩臺(tái)機(jī)器上分別執(zhí)行ip add，目前顯示VIP在haproxy1上與本機(jī)網(wǎng)卡綁定
(haproxy1）
# ip add
-----------------------
-----------------------
(haproxy2）
# ip add
-----------------------
-----------------------
在瀏覽器訪問該虛IP:
http://192.168.1.120
返回如圖：
證明，keepalived讓haproxy1接管負(fù)載均衡，將頁面跳轉(zhuǎn)到nginx1上
2.停掉haproxy1上的haproxy服務(wù)，5秒后keepalived會(huì)自動(dòng)將其再次啟動(dòng)
（haproxy1）
# pkill haproxy
等5秒
# ps -ef |grep haproxy
--------------
--------------
3.停掉主的keepalived，備機(jī)馬上接管服務(wù)
（haproxy1）
# service keepalived stop
# uname -a
---------------
---------------
（haproxy2）
# ip add
現(xiàn)已跳轉(zhuǎn)到haproxy2,在瀏覽器再次訪問該虛IP:
http://192.168.7.70
返回如圖：
OK
轉(zhuǎn)載于:https://blog.51cto.com/zlong37/1377495
總結(jié)
以上是生活随笔為你收集整理的Redhat5下haproxy+keepalived+nginx配置笔记的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。
- 上一篇： 转：模态对话框的支持 （IE,Firef
- 下一篇： chrome调试、移动端调试