日韩av黄I国产麻豆传媒I国产91av视频在线观看I日韩一区二区三区在线看I美女国产在线I麻豆视频国产在线观看I成人黄色短片

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 运维知识 > Ubuntu >内容正文

Ubuntu

ubuntu16.0 安装 openstack

發(fā)布時間:2024/4/17 Ubuntu 48 豆豆
生活随笔 收集整理的這篇文章主要介紹了 ubuntu16.0 安装 openstack 小編覺得挺不錯的,現(xiàn)在分享給大家,幫大家做個參考.

主要參考官方文檔:https://docs.openstack.org/liberty/zh_CN/install-guide-ubuntu/environment-nosql-database.html

檢查是否有如下命令:

root@hett-virtual-machine:/# command
root@hett-virtual-machine:/# prompt
The program 'prompt' is currently not installed. You can install it by typing:
apt install libmodglue1v5
root@hett-virtual-machine:/# sudo apt-get install libmodglue1v5
Reading package lists... Done
Building dependency tree????? ?
Reading state information... Done
The following NEW packages will be installed:
? libmodglue1v5
0 upgraded, 1 newly installed, 0 to remove and 265 not upgraded.
Need to get 68.8 kB of archives.
After this operation, 338 kB of additional disk space will be used.
Get:1 http://cn.archive.ubuntu.com/ubuntu xenial/universe amd64 libmodglue1v5 amd64 1.19-0ubuntu3 [68.8 kB]
Fetched 68.8 kB in 0s (134 kB/s)? ?
Selecting previously unselected package libmodglue1v5.
(Reading database ... 182546 files and directories currently installed.)
Preparing to unpack .../libmodglue1v5_1.19-0ubuntu3_amd64.deb ...
Unpacking libmodglue1v5 (1.19-0ubuntu3) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up libmodglue1v5 (1.19-0ubuntu3) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
root@hett-virtual-machine:/# prompt
prompt (built on Tue Aug 4 16:53:30 UTC 2015)
Copyright (C) 2001-2006? Kasper Peeters <kasper.peeters@aei.mpg.de>

Usage: prompt [program] [args]
沒有的話請安裝如上命令

系統(tǒng)的要求是: 內存8g,硬盤 20g

sudo apt-get update

root@hett-virtual-machine:/# sudo apt-get dist-upgrade

一、搭建基礎環(huán)境

192.168.30.145?? controller【2vCPU、4G內存、40G存儲、雙網(wǎng)卡】

192.168.30.146?? compute【2vCPU、4G內存、40G存儲、雙網(wǎng)卡】


1.安裝ssh并配置root密碼
$ sudo apt install ssh
$ sudo passwd root
Enter new UNIX password:
Retype new UNIX password:
passwd: password updated successfully

2.獲取臨時認證令牌
# openssl rand -hex 10
bdb5cad50653d4e85b7d

3.添加阿里云鏡像
# cp /etc/apt/sources.list /etc/apt/sources.list.bak
# vim /etc/apt/sources.list
deb-src http://archive.Ubuntu.com/ubuntu xenial main restricted
deb http://mirrors.aliyun.com/ubuntu/ xenial main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial main restricted multiverse universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted multiverse universe
deb http://mirrors.aliyun.com/ubuntu/ xenial universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates universe
deb http://mirrors.aliyun.com/ubuntu/ xenial multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse
deb http://archive.canonical.com/ubuntu xenial partner
deb-src http://archive.canonical.com/ubuntu xenial partner
deb http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted multiverse universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-security universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-security multiverse

4.配置網(wǎng)絡接口IP
# ip addr
# vim /etc/network/interfaces
auto ens33
iface ens33 inet static
address 192.168.30.145
netmask 255.255.255.0
gateway 192.168.30.2
dns-nameserver 114.114.114.114
# The provider network interface(配置第二個接口為提供者接口)
auto ens34
iface ens34 inet manual
up ip link set dev $IFACE up
down ip link set dev $IFACE down

5.配置host
# vim /etc/hosts
192.168.30.145?? controller
192.168.30.146?? compute

6.配置NTP時間協(xié)議
# dpkg-reconfigure tzdata??????????????? ##修改時區(qū)
Current default time zone: 'Asia/Chongqing'
Local time is now:????? Tue Mar 28 20:54:33 CST 2017.
Universal Time is now:? Tue Mar 28 12:54:33 UTC 2017.
# apt -y install chrony?????????????? ##安裝chrony時間同步軟件

?

Controller Node
# vim /etc/chrony/chrony.conf
allow 192.168.30.0/24????????????? ##設置允許該網(wǎng)段與自己同步時間
# service chrony restart

Compute Node
# vim /etc/chrony/chrony.conf
# pool 2.debian.pool.ntp.org offline iburst
server 192.168.30.145 iburst?????? ##設置時間同步服務器地址
# service chrony restart
# chronyc sources
210 Number of sources = 1
MS Name/IP address???????? Stratum Poll Reach LastRx Last sample
===============================================================================
^* controller??????????????????? 3?? 6?? 377??? 33?? -375us[ -422us] +/-?? 66ms

7.在所有節(jié)點啟用openstack庫、安裝openstack客戶端
# apt -y install software-properties-common
# add-apt-repository cloud-archive:ocata
# apt -y update && apt -y dist-upgrade
# apt -y install python-openstackclient

8.安裝并配置數(shù)據(jù)庫服務(Controller Node)
# apt -y install mariadb-server python-pymysql
# vim /etc/mysql/mariadb.conf.d/99-openstack.cnf
[mysqld]
bind-address = 192.168.30.145
default-storage-engine = innodb
innodb_file_per_table = on
max_connections = 4096
collation-server = utf8_general_ci
character-set-server = utf8
# service mysql restart
# mysql_secure_installation
##運行該腳本來保證數(shù)據(jù)庫安全,為root賬戶設置一個合適的密碼

9.安裝并配置Rabbitmq消息隊列服務(Controller Node)
# apt -y install rabbitmq-server
# rabbitmqctl add_user openstack openstack??????? ##添加OpenStack用戶并配置密碼
Creating user "openstack" ...
##允許openstack用戶的配置、寫、讀權限
# rabbitmqctl set_permissions openstack ".*" ".*" ".*"
Setting permissions for user "openstack" in vhost "/" ...
# rabbitmqctl list_users?????????? ##列出用戶
Listing users ...
guest[administrator]
openstack[]
# rabbitmqctl list_user_permissions openstack???? ##列出該用戶權限
Listing permissions for user "openstack" ...
/.*.*.*
# rabbitmqctl status???????? ##查看RabbitMQ相關信息
# rabbitmq-plugins list????? ##查看RabbitMQ相關插件
?Configured: E = explicitly enabled; e = implicitly enabled
?| Status:?? * = running on rabbit@openstack1
?|/
?......
# rabbitmq-plugins enable rabbitmq_management?? ##啟用該插件
The following plugins have been enabled:
? mochiweb
? webmachine
? rabbitmq_web_dispatch
? amqp_client
? rabbitmq_management_agent
? rabbitmq_management
Applying plugin configuration to rabbit@openstack1... started 6 plugins.

瀏覽器輸入http://localhost:15672,默認用戶名密碼都是guest。

10.安裝并配置Memcached緩存服務【對認證服務進行緩存】(Controller Node)
# apt -y install memcached python-memcache
# vim /etc/memcached.conf
#-l 127.0.0.1
-l 192.168.30.145
# service memcached restart

二、配置 Keystone 認證服務(Controller Node)

1.創(chuàng)建 keystone 數(shù)據(jù)庫
# mysql
MariaDB [(none)]> CREATE DATABASE keystone;?????? ##創(chuàng)建 keystone 數(shù)據(jù)庫
##對 keystone 數(shù)據(jù)庫授權[用戶名@控制節(jié)點...BY 密碼]
MariaDB [(none)]> GRANT ALL PRIVILEGES ON keystone.* TO 'keystone'@'192.168.30.145' \
???? IDENTIFIED BY 'keystone';
MariaDB [(none)]> GRANT ALL PRIVILEGES ON keystone.* TO 'keystone'@'%' \
???? IDENTIFIED BY 'keystone';
MariaDB [(none)]> flush privileges;

2.安裝并配置 Keystone
# apt -y install keystone
# vim /etc/keystone/keystone.conf
[database]---配置數(shù)據(jù)庫訪問[用戶名:密碼@控制節(jié)點]
connection = mysql+pymysql://keystone:keystone@192.168.30.145/keystone
[token]---配置Fernet UUID令牌的提供者
provider = fernet
# grep ^[a-z] /etc/keystone/keystone.conf
connection = mysql+pymysql://keystone:keystone@192.168.30.145/keystone
provider = fernet

3.初始化身份認證服務數(shù)據(jù)庫
# su -s /bin/sh -c "keystone-manage db_sync" keystone

4.初始化Fernet keys
# keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone
# keystone-manage credential_setup --keystone-user keystone --keystone-group keystone

5.配置引導標識服務
# keystone-manage bootstrap --bootstrap-password qaz123 \
? --bootstrap-admin-url http://192.168.30.145:35357/v3/ \
? --bootstrap-internal-url http://192.168.30.145:5000/v3/ \
? --bootstrap-public-url http://192.168.30.145:5000/v3/ \
? --bootstrap-region-id RegionOne

6.配置 HTTP 服務器
# vim /etc/apache2/apache2.conf
ServerName controller
# service apache2 restart???????????????? ##重啟Apache服務
# service apache2 status
# rm -f /var/lib/keystone/keystone.db???????? ##刪除默認的SQLite數(shù)據(jù)庫

7.配置管理賬戶
# export OS_USERNAME=admin
# export OS_PASSWORD=qaz123
# export OS_PROJECT_NAME=admin
# export OS_USER_DOMAIN_NAME=Default
# export OS_PROJECT_DOMAIN_NAME=Default
# export OS_AUTH_URL=http://192.168.30.145:35357/v3
# export OS_IDENTITY_API_VERSION=3

8.創(chuàng)建 service 項目
# openstack project create --domain default \
? --description "Service Project" service
+-------------+----------------------------------+
| Field?????? | Value??????????????????????????? |
+-------------+----------------------------------+
| description | Service Project????????????????? |
| domain_id?? | default????????????????????????? |
| enabled???? | True???????????????????????????? |
| id????????? | 945e37831e74484f8911fb742c925926 |
| is_domain?? | False??????????????????????????? |
| name??????? | service????????????????????????? |
| parent_id?? | default????????????????????????? |
+-------------+----------------------------------+

9.配置普通(非管理)任務項目和用戶權限

a.創(chuàng)建 demo 項目
# openstack project create --domain default \
? --description "Demo Project" demo
+-------------+----------------------------------+
| Field?????? | Value??????????????????????????? |
+-------------+----------------------------------+
| description | Demo Project???????????????????? |
| domain_id?? | default????????????????????????? |
| enabled???? | True???????????????????????????? |
| id????????? | 2ef20ce389eb499696f2d7497c6009b0 |
| is_domain?? | False??????????????????????????? |
| name??????? | demo???????????????????????????? |
| parent_id?? | default????????????????????????? |
+-------------+----------------------------------+

b.創(chuàng)建 demo 用戶
# openstack user create --domain default \
? --password-prompt demo
User Password:
Repeat User Password:
+---------------------+----------------------------------+
| Field?????????????? | Value??????????????????????????? |
+---------------------+----------------------------------+
| domain_id?????????? | default????????????????????????? |
| enabled???????????? | True???????????????????????????? |
| id????????????????? | 7cfc508fd5d44b468aac218bd4029bae |
| name??????????????? | demo???????????????????????????? |
| options???????????? | {}?????????????????????????????? |
| password_expires_at | None???????????????????????????? |
+---------------------+----------------------------------+

c.創(chuàng)建 user 角色
# openstack role create user
+-----------+----------------------------------+
| Field???? | Value??????????????????????????? |
+-----------+----------------------------------+
| domain_id | None???????????????????????????? |
| id??????? | 83b6ab2af4414ad387b2fc9daf575b3a |
| name????? | user???????????????????????????? |
+-----------+----------------------------------+

d.添加 user 角色到 demo 項目和用戶
# openstack role add --project demo --user demo user

10.禁用臨時身份驗證令牌機制
# vim /etc/keystone/keystone-paste.ini
[pipeline:public_api]
# pipeline = admin_token_auth
[pipeline:admin_api]
# pipeline = admin_token_auth
[pipeline:api_v3]
# pipeline = admin_token_auth

11.重置 OS_AUTH_URL 和 OS_PASSWORD 環(huán)境變量
# unset OS_AUTH_URL OS_PASSWORD

12.使用 admin 用戶,請求認證令牌(密碼為admin用戶密碼)
# openstack --os-auth-url http://192.168.30.145:35357/v3 \
? --os-project-domain-name default --os-user-domain-name default \
? --os-project-name admin --os-username admin token issue
Password:
+------------+-----------------------------------------------------------+
| Field????? | Value???????????????????????????????????????????????????? |
+------------+-----------------------------------------------------------+
| expires??? | 2017-03-28T15:11:50+0000????????????????????????????????? |
| id???????? | gAAAAABY2m8mE9pMATPuFW9YpgoBMTg9mCI6GcmFeQAudwbhGiVblXZP? |
|??????????? | kmSmHc5aFwTZSIdjLzPJaMd1k16UZghj59v45Gvzdh5CLhSFGWPsT8rL? |
|??????????? | fRJD4eE1D_eRz2Jjjk5rDmwAHm5mmffuszJLSe4B2KJyBXkdmmznXL-A? |
| project_id | 2461396f6a344c21a2360a612d4f6abe????????????????????????? |
| user_id??? | 63ca263543fb4b02bb34410e3dc8a801????????????????????????? |
+------------+-----------------------------------------------------------+

13.使用 demo 用戶,請求認證令牌(密碼為demo用戶密碼)
# openstack --os-auth-url http://192.168.30.145:5000/v3 \
? --os-project-domain-name default --os-user-domain-name default \
? --os-project-name demo --os-username demo token issue
Password:
+------------+-----------------------------------------------------------+
| Field????? | Value???????????????????????????????????????????????????? |
+------------+-----------------------------------------------------------+
| expires??? | 2017-03-28T15:13:50+0000????????????????????????????????? |
| id???????? | gAAAAABY2m-eSIWmQg1SyZFaiGcP2kjHf742ktr8YcVH3Q4aHKTflDJ?? |
|??????????? | RLAfgmeoDW2z1sbdHQmKQNSb--F-1Pn_hTFHYqgyMlIxYpEQxGhJ-rg?? |
|??????????? | b0EuxUT9opwl0m5onaA5Cv_MBX6awxeity8Gh1dc50NUeYela5Yl4uSG? |
| project_id | 2ef20ce389eb499696f2d7497c6009b0????????????????????????? |
| user_id??? | 7cfc508fd5d44b468aac218bd4029bae????????????????????????? |
+------------+-----------------------------------------------------------+

14.創(chuàng)建腳本

a.創(chuàng)建并編輯文件 admin-openrc 并添加如下內容:
# vim admin-openrc
export OS_PROJECT_DOMAIN_NAME=Default
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_NAME=admin
export OS_USERNAME=admin
export OS_PASSWORD=qaz123
export OS_AUTH_URL=http://192.168.30.145:35357/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2

b.創(chuàng)建并編輯文件 demo-openrc 并添加如下內容:
# vim demo-openrc
export OS_PROJECT_DOMAIN_NAME=Default
export OS_USER_DOMAIN_NAME=Default
export OS_PROJECT_NAME=demo
export OS_USERNAME=demo
export OS_PASSWORD=demo
export OS_AUTH_URL=http://192.168.30.145:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2

15.使用腳本

a.加載腳本
# . admin-openrc

b.請求身份認證令牌
# openstack token issue
+------------+----------------------------------------------------------+
| Field????? | Value??????????????????????????????????????????????????? |
+------------+----------------------------------------------------------+
| expires??? | 2017-03-28T15:22:55+0000???????????????????????????????? |
| id???????? | gAAAAABY2nG_diuPBMl66vJye3mV3S7CWZKesIiSnbicq5XddujfHhc3x|
|??????????? | PHni3iHWPcTQAjHoIEMTvSH6yKOQ6Z74QL6hVbshqP1dJrRJ6xEa9WvIk|
|??????????? | F7H5j7lPmM7ncfVvr9k96gLJ6Uhz38R5qRnHBWkxrlNsgw1jdnAjxf5e |
| project_id | 2461396f6a344c21a2360a612d4f6abe???????????????????????? |
| user_id??? | 63ca263543fb4b02bb34410e3dc8a801???????????????????????? |
+------------+----------------------------------------------------------+

三、配置 Glance 鏡像服務(Controller Node)

1.創(chuàng)建 glance 數(shù)據(jù)庫
# mysql
MariaDB [(none)]> CREATE DATABASE glance;????????????? ##創(chuàng)建 glance 數(shù)據(jù)庫
##對 glance 數(shù)據(jù)庫授權[用戶名@控制節(jié)點...BY 密碼]
MariaDB [(none)]> GRANT ALL PRIVILEGES ON glance.* TO 'glance'@'192.168.30.145' \
????? IDENTIFIED BY 'glance';
MariaDB [(none)]> GRANT ALL PRIVILEGES ON glance.* TO 'glance'@'%' \
????? IDENTIFIED BY 'glance';
MariaDB [(none)]> flush privileges;

2.獲取管理員訪問權限
# . admin-openrc

3.創(chuàng)建服務證書

a.創(chuàng)建glance用戶:
# openstack user create --domain default --password-prompt glance
User Password:
Repeat User Password:
+---------------------+----------------------------------+
| Field?????????????? | Value??????????????????????????? |
+---------------------+----------------------------------+
| domain_id?????????? | default????????????????????????? |
| enabled???????????? | True???????????????????????????? |
| id????????????????? | 3edeaaae87e14811ac2c6767ab657d6b |
| name??????????????? | glance?????????????????????????? |
| options???????????? | {}?????????????????????????????? |
| password_expires_at | None???????????????????????????? |
+---------------------+----------------------------------+

b.添加 admin 角色到 glance 用戶和 service 項目上:
# openstack role add --project service --user glance admin

c.創(chuàng)建“glance”服務實體:
# openstack service create --name glance \
? --description "OpenStack Image" image
+-------------+----------------------------------+
| Field?????? | Value??????????????????????????? |
+-------------+----------------------------------+
| description | OpenStack Image????????????????? |
| enabled???? | True???????????????????????????? |
| id????????? | 22a0875ba92c4512989666f116ae1585 |
| name??????? | glance?????????????????????????? |
| type??????? | image??????????????????????????? |
+-------------+----------------------------------+

d.創(chuàng)建鏡像服務的 API 端點:
# openstack endpoint create --region RegionOne \
? image public http://192.168.30.145:9292
+--------------+----------------------------------+
| Field??????? | Value??????????????????????????? |
+--------------+----------------------------------+
| enabled????? | True???????????????????????????? |
| id?????????? | ff6d9ed365cf4e7f8cc53d47e57cd46b |
| interface??? | public?????????????????????????? |
| region?????? | RegionOne??????????????????????? |
| region_id??? | RegionOne??????????????????????? |
| service_id?? | 22a0875ba92c4512989666f116ae1585 |
| service_name | glance?????????????????????????? |
| service_type | image??????????????????????????? |
| url????????? | http://192.168.30.145:9292?????? |
+--------------+----------------------------------+
# openstack endpoint create --region RegionOne \
? image internal http://192.168.30.145:9292
+--------------+----------------------------------+
| Field??????? | Value??????????????????????????? |
+--------------+----------------------------------+
| enabled????? | True???????????????????????????? |
| id?????????? | 7408dd72bc1745758cdf23e136ef7392 |
| interface??? | internal???????????????????????? |
| region?????? | RegionOne??????????????????????? |
| region_id??? | RegionOne??????????????????????? |
| service_id?? | 22a0875ba92c4512989666f116ae1585 |
| service_name | glance?????????????????????????? |
| service_type | image??????????????????????????? |
| url????????? | http://192.168.30.145:9292?????? |
+--------------+----------------------------------+
# openstack endpoint create --region RegionOne \
? image admin http://192.168.30.145:9292
--------------+----------------------------------+
| Field??????? | Value??????????????????????????? |
+--------------+----------------------------------+
| enabled????? | True???????????????????????????? |
| id?????????? | 8ed4e7e1a5834177b4ce1896c21e6cb9 |
| interface??? | admin??????????????????????????? |
| region?????? | RegionOne??????????????????????? |
| region_id??? | RegionOne??????????????????????? |
| service_id?? | 22a0875ba92c4512989666f116ae1585 |
| service_name | glance?????????????????????????? |
| service_type | image??????????????????????????? |
| url????????? | http://192.168.30.145:9292?????? |
+--------------+----------------------------------+

4.安裝并配置 Glance 組件

a.配置鏡像API
# apt -y install glance
# vim /etc/glance/glance-api.conf
[database]---配置數(shù)據(jù)庫訪問[用戶名:密碼@控制節(jié)點]
connection = mysql+pymysql://glance:glance@192.168.30.145/glance
[keystone_authtoken]---配置身份服務訪問
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
[paste_deploy]
flavor = keystone
[glance_store]---配置本地文件系統(tǒng)存儲和圖像文件位置
stores = file,http
default_store = file
filesystem_store_datadir = /var/lib/glance/images/
# grep ^[a-z] /etc/glance/glance-api.conf
sqlite_db = /var/lib/glance/glance.sqlite
backend = sqlalchemy
connection = mysql+pymysql://glance:glance@192.168.30.145/glance
stores = file,http
default_store = file
filesystem_store_datadir = /var/lib/glance/images
disk_formats = ami,ari,aki,vhd,vhdx,vmdk,raw,qcow2,vdi,iso,ploop.root-tar
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
flavor = keystone

b.配置鏡像注冊服務
# vim /etc/glance/glance-registry.conf
[database]---配置數(shù)據(jù)庫訪問[用戶名:密碼@控制節(jié)點]
connection = mysql+pymysql://glance:glance@192.168.30.145/glance
[keystone_authtoken]---配置身份服務訪問
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
[paste_deploy]
flavor = keystone
# grep ^[a-z] /etc/glance/glance-registry.conf
sqlite_db = /var/lib/glance/glance.sqlite
backend = sqlalchemy
connection = mysql+pymysql://glance:glance@192.168.30.145/glance
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
flavor = keystone

5.同步鏡像服務數(shù)據(jù)庫
# su -s /bin/sh -c "glance-manage db_sync" glance

6.重啟服務
# service glance-registry restart
# service glance-api restart
# service glance-registry status
# service glance-api status

7.驗證操作

使用 CirrOS 對鏡像服務進行驗證

CirrOS是一個小型的Linux鏡像,可以用來進行 OpenStack部署測試。

a.獲取管理員權限

?
# . admin-openrc

?

b.下載源鏡像
# wget http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img

c.使用 QCOW2 磁盤格式, bare 容器格式上傳鏡像到鏡像服務并設置公共可見
# openstack image create "cirros"\
? --file cirros-0.3.5-x86_64-disk.img \
? --disk-format qcow2 --container-format bare \
? --public
+------------------+------------------------------------------------------+
| Field??????????? | Value??????????????????????????????????????????????? |
+------------------+------------------------------------------------------+
| checksum???????? | f8ab98ff5e73ebab884d80c9dc9c7290???????????????????? |
| container_format | bare???????????????????????????????????????????????? |
| created_at?????? | 2017-03-29T05:57:56Z???????????????????????????????? |
| disk_format????? | qcow2??????????????????????????????????????????????? |
| file???????????? | /v2/images/4b6ebd57-80ab-4b79-8ecc-53a026f3e898/file |
| id?????????????? | 4b6ebd57-80ab-4b79-8ecc-53a026f3e898???????????????? |
| min_disk???????? | 0??????????????????????????????????????????????????? |
| min_ram????????? | 0??????????????????????????????????????????????????? |
| name???????????? | cirros?????????????????????????????????????????????? |
| owner??????????? | 2461396f6a344c21a2360a612d4f6abe???????????????????? |
| protected??????? | False??????????????????????????????????????????????? |
| schema?????????? | /v2/schemas/image??????????????????????????????????? |
| size???????????? | 13267968???????????????????????????????????????????? |
| status?????????? | active?????????????????????????????????????????????? |
| tags???????????? |????????????????????????????????????????????????????? |
| updated_at?????? | 2017-03-29T05:57:56Z???????????????????????????????? |
| virtual_size???? | None???????????????????????????????????????????????? |
| visibility?????? | public?????????????????????????????????????????????? |
+------------------+------------------------------------------------------+

d.確認鏡像的上傳并驗證屬性
# openstack image list
+--------------------------------------+--------+--------+
| ID?????????????????????????????????? | Name?? | Status |
+--------------------------------------+--------+--------+
| 4b6ebd57-80ab-4b79-8ecc-53a026f3e898 | cirros | active |
+--------------------------------------+--------+--------+

五、配置 Neutron 網(wǎng)絡服務【各節(jié)點皆要配置】

1.創(chuàng)建 neutron 數(shù)據(jù)庫
# mysql
MariaDB [(none)] CREATE DATABASE neutron;???????????? ##創(chuàng)建 neutron 數(shù)據(jù)庫
##對 neutron 數(shù)據(jù)庫授權[用戶名@控制節(jié)點...BY 密碼]
MariaDB [(none)]> GRANT ALL PRIVILEGES ON neutron.* TO 'neutron'@'192.168.30.145' \\
? IDENTIFIED BY 'neutron';
MariaDB [(none)]> GRANT ALL PRIVILEGES ON neutron.* TO 'neutron'@'%' \\
? IDENTIFIED BY 'neutron';
MariaDB [(none)]> flush privileges;
?

2.獲取管理員訪問權限
# . admin-openrc

3.創(chuàng)建服務證書

a.創(chuàng)建 neutron 用戶
# openstack user create --domain default --password-prompt neutron
User Password:
Repeat User Password:
+---------------------+----------------------------------+
| Field?????????????? | Value??????????????????????????? |
+---------------------+----------------------------------+
| domain_id?????????? | default????????????????????????? |
| enabled???????????? | True???????????????????????????? |
| id????????????????? | 54cd9e72295c411090ea9f641cb02135 |
| name??????????????? | neutron????????????????????????? |
| options???????????? | {}?????????????????????????????? |
| password_expires_at | None???????????????????????????? |
+---------------------+----------------------------------+

b.添加 admin 角色到 neutron 用戶
# openstack role add --project service --user neutron admin

c.創(chuàng)建 neutron 服務實體
# openstack service create --name neutron \\
? --description "OpenStack Networking" network
+-------------+----------------------------------+
| Field?????? | Value??????????????????????????? |
+-------------+----------------------------------+
| description | OpenStack Networking???????????? |
| enabled???? | True???????????????????????????? |
| id????????? | 720687745d354718862255a56d7aea46 |
| name??????? | neutron????????????????????????? |
| type??????? | network????????????????????????? |
+-------------+----------------------------------+

d.創(chuàng)建 neutron 服務API端點
# openstack endpoint create --region RegionOne \\
? network public http://192.168.30.145:9696
+--------------+----------------------------------+
| Field??????? | Value??????????????????????????? |
+--------------+----------------------------------+
| enabled????? | True???????????????????????????? |
| id?????????? | a9b1b5b8fbb842a8b14a9cecca7a58a8 |
| interface??? | public?????????????????????????? |
| region?????? | RegionOne??????????????????????? |
| region_id??? | RegionOne??????????????????????? |
| service_id?? | 720687745d354718862255a56d7aea46 |
| service_name | neutron????????????????????????? |
| service_type | network????????????????????????? |
| url????????? | http://192.168.30.145:9696?????? |
+--------------+----------------------------------+
?? ?
# openstack endpoint create --region RegionOne \\
? network internal http://192.168.30.145:9696
+--------------+----------------------------------+
| Field??????? | Value??????????????????????????? |
+--------------+----------------------------------+
| enabled????? | True???????????????????????????? |
| id?????????? | 61e2c14b0c8f4003a7099012e9a6331f |
| interface??? | internal???????????????????????? |
| region?????? | RegionOne??????????????????????? |
| region_id??? | RegionOne??????????????????????? |
| service_id?? | 720687745d354718862255a56d7aea46 |
| service_name | neutron????????????????????????? |
| service_type | network????????????????????????? |
| url????????? | http://192.168.30.145:9696?????? |
+--------------+----------------------------------+
# openstack endpoint create --region RegionOne \\
? network admin http://192.168.30.145:9696
+--------------+----------------------------------+
| Field??????? | Value??????????????????????????? |
+--------------+----------------------------------+
| enabled????? | True???????????????????????????? |
| id?????????? | 6719539759c34487bd519c0dffb5509d |
| interface??? | admin??????????????????????????? |
| region?????? | RegionOne??????????????????????? |
| region_id??? | RegionOne??????????????????????? |
| service_id?? | 720687745d354718862255a56d7aea46 |
| service_name | neutron????????????????????????? |
| service_type | network????????????????????????? |
| url????????? | http://192.168.30.145:9696?????? |
+--------------+----------------------------------+

4.配置網(wǎng)絡類型2:私有網(wǎng)絡

a.安裝組件
# apt -y install neutron-server neutron-plugin-ml2 \\
? neutron-linuxbridge-agent neutron-l3-agent neutron-dhcp-agent \\
? neutron-metadata-agent

b.配置 Neutron 組件
# vim /etc/neutron/neutron.conf
[database]----配置數(shù)據(jù)庫訪問[用戶名:密碼@控制節(jié)點]
#connection = sqlite:var/lib/neutron/neutron.sqlite
connection = mysql+pymysql://neutron:neutron@192.168.30.145/neutron
[DEFAULT]----啟用ML2插件、路由器服務和overlapping IP addresses
core_plugin = ml2
service_plugins = router
allow_overlapping_ips = true
?? ?
[DEFAULT]----配置 RabbitMQ 消息隊列訪問[用戶名:密碼@控制節(jié)點]
transport_url = rabbit://openstack:openstack@192.168.30.145
[DEFAULT]----配置認證服務訪問
auth_strategy = keystone
[keystone_authtoken]----配置認證服務訪問
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = neutron
?? ?
[DEFAULT]----配置網(wǎng)絡服務來通知計算節(jié)點的網(wǎng)絡拓撲變化
notify_nova_on_port_status_changes = true
notify_nova_on_port_data_changes = true
[nova]----配置網(wǎng)絡服務來通知計算節(jié)點的網(wǎng)絡拓撲變化
auth_url = http://192.168.30.145:35357
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = nova
password = nova
# grep ^[a-z] /etc/neutron/neutron.conf
auth_strategy = keystone
core_plugin = ml2
service_plugins = router
allow_overlapping_ips = true
notify_nova_on_port_status_changes = true
notify_nova_on_port_data_changes = true
transport_url = rabbit://openstack:openstack@192.168.30.145
root_helper = sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf
connection = mysql+pymysql://neutron:neutron@192.168.30.145/neutron
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = neutron
region_name = RegionOne
auth_url = http://192.168.30.145:35357
auth_type = password
password = nova
project_domain_name = default
project_name = service
user_domain_name = default
username = nova

c.配置 Modular Layer 2 (ML2) 插件

ML2插件使用Linuxbridge機制來為實例創(chuàng)建layer-2虛擬網(wǎng)絡基礎設施
# vim /etc/neutron/plugins/ml2/ml2_conf.ini
[ml2]----啟用flat,VLAN以及VXLAN網(wǎng)絡
type_drivers = flat,vlan,vxlan
[ml2]----啟用VXLAN私有網(wǎng)絡
tenant_network_types = vxlan
[ml2]----啟用Linuxbridge和layer-2機制
mechanism_drivers = linuxbridge,l2population
[ml2]----啟用端口安全擴展驅動
extension_drivers = port_security
[ml2_type_flat]----配置公共虛擬網(wǎng)絡為flat網(wǎng)絡
flat_networks = provider
[ml2_type_vxlan]----為私有網(wǎng)絡配置VXLAN網(wǎng)絡識別的網(wǎng)絡范圍
vni_ranges = 1:1000
[securitygroup]----啟用 ipset 增加安全組規(guī)則的高效性
enable_ipset = true
? ?
# grep ^[a-z] /etc/neutron/plugins/ml2/ml2_conf.ini
type_drivers = flat,vlan,vxlan
tenant_network_types = vxlan
mechanism_drivers = linuxbridge,l2population
extension_drivers = port_security
flat_networks = provider
vni_ranges = 1:1000
enable_ipset = true

注:Linuxbridge代理只支持VXLAN覆蓋網(wǎng)絡

d.配置Linuxbridge代理

Linuxbridge代理為實例建立layer-2虛擬網(wǎng)絡并且處理安全組規(guī)則
# vim /etc/neutron/plugins/ml2/linuxbridge_agent.ini
[linux_bridge]----對應公共虛擬網(wǎng)絡和公共物理網(wǎng)絡接口
physical_interface_mappings = provider:ens33
[vxlan]----啟用VXLAN覆蓋網(wǎng)絡,配置覆蓋網(wǎng)絡的物理網(wǎng)絡接口的IP地址,并啟用layer-2 population
enable_vxlan = true
local_ip = 192.168.30.145
l2_population = true
[securitygroup]----啟用安全組并配置防火墻服務
enable_security_group = true
firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
?
# grep ^[a-z] /etc/neutron/plugins/ml2/linuxbridge_agent.ini
physical_interface_mappings = provider:ens33
firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
enable_security_group = true
enable_vxlan = true
local_ip = 192.168.30.145
l2_population = true

e.配置layer-3代理

Layer-3代理為私有虛擬網(wǎng)絡提供路由和NAT服務
# vim /etc/neutron/l3_agent.ini
[DEFAULT]----配置Linuxbridge接口驅動和外部網(wǎng)絡網(wǎng)橋
interface_driver = linuxbridge
?
# grep ^[a-z] /etc/neutron/l3_agent.ini
interface_driver = linuxbridge

f.配置DHCP代理

DHCP代理為虛擬網(wǎng)絡提供DHCP服務

?
# vim /etc/neutron/dhcp_agent.ini
[DEFAULT]----配置Linuxbridge驅動接口,DHCP驅動并啟用隔離元數(shù)據(jù)
interface_driver = linuxbridge
dhcp_driver = neutron.agent.linux.dhcp.Dnsmasq
enable_isolated_metadata = true
?
# grep ^[a-z] /etc/neutron/dhcp_agent.ini
interface_driver = linuxbridge
dhcp_driver = neutron.agent.linux.dhcp.Dnsmasq
enable_isolated_metadata = true

?

g.配置元數(shù)據(jù)代理----負責提供配置信息
# vim /etc/neutron/metadata_agent.ini
[DEFAULT]----配置元數(shù)據(jù)主機以及共享密碼
nova_metadata_ip = 192.168.30.145
metadata_proxy_shared_secret = qaz123
?
# grep ^[a-z] /etc/neutron/metadata_agent.ini
nova_metadata_ip = 192.168.30.145
metadata_proxy_shared_secret = qaz123
?

5.在控制節(jié)點上為計算節(jié)點配置網(wǎng)絡服務
# vim /etc/nova/nova.conf
[neutron]----配置訪問參數(shù),啟用元數(shù)據(jù)代理并設置密碼
url = http://192.168.30.145:9696
auth_url = http://192.168.30.145:35357
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = neutron
password = neutron
service_metadata_proxy = true
metadata_proxy_shared_secret = qaz123
# grep ^[a-z] /etc/nova/nova.conf

6.完成安裝

a.同步數(shù)據(jù)庫
# su -s /bin/sh -c "neutron-db-manage --config-file /etc/neutron/neutron.conf \\
? --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron
......
OK

注:數(shù)據(jù)庫的同步發(fā)生在 Networking 之后,因為腳本需要完成服務器和插件的配置文件

b.重啟計算 API 服務
# service nova-api restart

c.重啟 Networking 服務

對于兩種網(wǎng)絡類型:
# service neutron-server restart
# service neutron-linuxbridge-agent restart
# service neutron-dhcp-agent restart
# service neutron-metadata-agent restart

對于網(wǎng)絡類型 2 ,還需重啟 L3 服務:
# service neutron-l3-agent restart

d.確認啟動與否
# service nova-api status
# service neutron-server status
# service neutron-linuxbridge-agent status
# service neutron-dhcp-agent status
# service neutron-metadata-agent status
# service neutron-l3-agent status

7.配置 Compute Node 的 Neutron 網(wǎng)絡服務
# apt -y install neutron-linuxbridge-agent
# vim /etc/neutron/neutron.conf
[database]----計算節(jié)點不直接訪問數(shù)據(jù)庫
#connection = sqlite:var/lib/neutron/neutron.sqlite
[DEFAULT]----配置 RabbitMQ 消息隊列訪問[用戶名:密碼@控制節(jié)點]
transport_url = rabbit://openstack:openstack@192.168.30.145
[DEFAULT]----配置認證服務訪問
auth_strategy = keystone
[keystone_authtoken]----配置認證服務訪問
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = neutron
?
# grep ^[a-z] /etc/neutron/neutron.conf
auth_strategy = keystone
core_plugin = ml2
transport_url = rabbit://openstack:openstack@192.168.30.145
root_helper = sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf
auth_uri = http://192.168.30.145:5000
auth_url = http://192.168.30.145:35357
memcached_servers = 192.168.30.145:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = neutron

8.為計算節(jié)點配置網(wǎng)絡服務
# vim /etc/nova/nova.conf
[neutron]----配置訪問參數(shù)
url = http://192.168.30.145:9696
auth_url = http://192.168.30.145:35357
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = neutron
password = neutron
# grep ^[a-z] /etc/nova/nova.conf

9.完成安裝

a.重啟計算服務:
# service nova-compute restart
# service nova-compute status

b.重啟Linuxbridge代理:
# service neutron-linuxbridge-agent restart
# service neutron-linuxbridge-agent status

10.在計算節(jié)點上配置網(wǎng)絡類型2

配置Linuxbridge代理----為實例建立layer-2虛擬網(wǎng)絡并且處理安全組規(guī)則
# vim /etc/neutron/plugins/ml2/linuxbridge_agent.ini
[linux_bridge]----對應公共虛擬網(wǎng)絡和公共物理網(wǎng)絡接口
physical_interface_mappings = provider:ens33
[vxlan]----啟用VXLAN覆蓋網(wǎng)絡,配置覆蓋網(wǎng)絡的物理網(wǎng)絡接口的IP地址,啟用layer-2 population
enable_vxlan = true
local_ip = 192.168.30.146
l2_population = true
[securitygroup]----啟用安全組并配置firewall_driver
enable_security_group = true
firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
?
# grep ^[a-z] /etc/neutron/plugins/ml2/linuxbridge_agent.ini
physical_interface_mappings = provider:ens33
firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
enable_security_group = true
enable_vxlan = true
local_ip = 192.168.30.146
l2_population = true

11.在控制節(jié)點上驗證操作

a.獲取管理員權限
# . admin-openrc

b.列出加載的擴展來驗證 neutron-server 進程是否正常啟
# openstack extension list --network
+----------------------+----------------------+--------------------------+
| Name???????????????? | Alias??????????????? | Description????????????? |
+----------------------+----------------------+--------------------------+
| Default Subnetpools? | default-subnetpools? | Provides ability to mark |
|????????????????????? |????????????????????? | and use a subnetpool as? |
|????????????????????? |????????????????????? | the default????????????? |
| Network IP?????????? | network-ip-????????? | Provides IP availability |
| Availability???????? | availability???????? | data for each network??? |
|????????????????????? |????????????????????? | and subnet.????????????? |
| Network Availability |network_availability_z| Availability zone??????? |
| Zone???????????????? | one????????????????? | support for network.???? |
| Auto Allocated?????? | auto-allocated-????? | Auto Allocated Topology? |
| Topology Services??? | topology???????????? | Services.??????????????? |
| Neutron L3?????????? | ext-gw-mode????????? | Extension of the router? |
| Configurable external|????????????????????? | abstraction for????????? |
| gateway mode???????? |????????????????????? | specifying whether SNAT? |
|????????????????????? |????????????????????? | should occur on the????? |
|????????????????????? |????????????????????? | external gateway???????? |
| Port Binding???????? | binding????????????? | Expose port bindings of? |
|????????????????????? |????????????????????? | a virtual port to??????? |
|????????????????????? |????????????????????? | external application???? |
| agent??????????????? | agent??????????????? | The agent management???? |
|????????????????????? |????????????????????? | extension.?????????????? |
| Subnet Allocation??? | subnet_allocation??? | Enables allocation of??? |
|????????????????????? |????????????????????? | subnets from a subnet??? |
|????????????????????? |????????????????????? | pool???????????????????? |
| L3 Agent Scheduler?? | l3_agent_scheduler?? | Schedule routers among?? |
|????????????????????? |????????????????????? | l3 agents??????????????? |
| Tag support????????? | tag????????????????? | Enables to set tag on??? |
|????????????????????? |????????????????????? | resources.?????????????? |
| Neutron external???? | external-net???????? | Adds external network??? |
| network????????????? |????????????????????? | attribute to network???? |
|????????????????????? |????????????????????? | resource.??????????????? |
| Neutron Service????? | flavors????????????? | Flavor specification for |
| Flavors????????????? |????????????????????? | Neutron advanced???????? |
|????????????????????? |????????????????????? | services???????????????? |
| Network MTU????????? | net-mtu????????????? | Provides MTU attribute?? |
|????????????????????? |????????????????????? | for a network resource.? |
| Availability Zone??? | availability_zone??? | The availability zone??? |
|????????????????????? |????????????????????? | extension.?????????????? |
| Quota management???? | quotas?????????????? | Expose functions for???? |
| support????????????? |????????????????????? | quotas management per??? |
|????????????????????? |????????????????????? | tenant?????????????????? |
| HA Router extension? | l3-ha??????????????? | Add HA capability to???? |
|????????????????????? |????????????????????? | routers.???????????????? |
| Provider Network???? | provider???????????? | Expose mapping of??????? |
|????????????????????? |????????????????????? | virtual networks to????? |
|????????????????????? |????????????????????? | physical networks??????? |
|Multi Provider Network| multi-provider?????? | Expose mapping of??????? |
|????????????????????? |????????????????????? | virtual networks to????? |
|????????????????????? |????????????????????? | multiple physical??????? |
|????????????????????? |????????????????????? | networks???????????????? |
| Address scope??????? | address-scope??????? | Address scopes?????????? |
|????????????????????? |????????????????????? | extension.?????????????? |
| Neutron Extra Route? | extraroute?????????? | Extra routes???????????? |
|????????????????????? |????????????????????? | configuration for L3???? |
|????????????????????? |????????????????????? | router?????????????????? |
| Subnet service types | subnet-service-types | Provides ability to set? |
|????????????????????? |????????????????????? | the subnet service_types |
|????????????????????? |????????????????????? | field??????????????????? |
| Resource timestamps? | standard-attr-?????? | Adds created_at and????? |
|????????????????????? | timestamp??????????? | updated_at fields to all |
|????????????????????? |????????????????????? | Neutron resources that?? |
|????????????????????? |????????????????????? | have Neutron standard??? |
|????????????????????? |????????????????????? | attributes.????????????? |
| Neutron Service Type | service-type???????? | API for retrieving?????? |
| Management?????????? |????????????????????? | service providers for??? |
|????????????????????? |????????????????????? | Neutron advanced???????? |
|????????????????????? |????????????????????? | services???????????????? |
| Router Flavor??????? | l3-flavors?????????? | Flavor support for?????? |
| Extension??????????? |????????????????????? | routers.???????????????? |
| Port Security??????? | port-security??????? | Provides port security?? |
| Neutron Extra DHCP?? | extra_dhcp_opt?????? | Extra options??????????? |
| opts???????????????? |????????????????????? | configuration for DHCP.? |
|????????????????????? |????????????????????? | For example PXE boot???? |
|????????????????????? |????????????????????? | options to DHCP clients? |
|????????????????????? |????????????????????? | can be specified (e.g.?? |
|????????????????????? |????????????????????? | tftp-server, server-ip-? |
|????????????????????? |????????????????????? | address, bootfile-name)? |
| Resource revision??? | standard-attr-?????? | This extension will????? |
| numbers????????????? | revisions??????????? | display the revision???? |
|????????????????????? |????????????????????? | number of neutron??????? |
|????????????????????? |????????????????????? | resources.?????????????? |
| Pagination support?? | pagination?????????? | Extension that indicates |
|????????????????????? |????????????????????? | that pagination is?????? |
|????????????????????? |????????????????????? | enabled.???????????????? |
| Sorting support????? | sorting????????????? | Extension that indicates |
|????????????????????? |????????????????????? | that sorting is enabled. |
| security-group?????? | security-group?????? | The security groups????? |
|????????????????????? |????????????????????? | extension.?????????????? |
| DHCP Agent Scheduler | dhcp_agent_scheduler | Schedule networks among? |
|????????????????????? |????????????????????? | dhcp agents????????????? |
| Router Availability? |router_availability_zo| Availability zone??????? |
| Zone???????????????? | ne?????????????????? | support for router.????? |
| RBAC Policies??????? | rbac-policies??????? | Allows creation and????? |
|????????????????????? |????????????????????? | modification of policies |
|????????????????????? |????????????????????? | that control tenant????? |
|????????????????????? |????????????????????? | access to resources.???? |
| Tag support for????? | tag-ext????????????? | Extends tag support to?? |
| resources: subnet,?? |????????????????????? | more L2 and L3?????????? |
| subnetpool, port,??? |????????????????????? | resources.?????????????? |
| router?????????????? |????????????????????? |????????????????????????? |
| standard-attr-?????? | standard-attr-?????? | Extension to add???????? |
| description????????? | description????????? | descriptions to standard |
|????????????????????? |????????????????????? | attributes?????????????? |
| Neutron L3 Router??? | router?????????????? | Router abstraction for?? |
|????????????????????? |????????????????????? | basic L3 forwarding????? |
|????????????????????? |????????????????????? | between L2 Neutron?????? |
|????????????????????? |????????????????????? | networks and access to?? |
|????????????????????? |????????????????????? | external networks via a? |
|????????????????????? |????????????????????? | NAT gateway.???????????? |
| Allowed Address Pairs| allowed-address-pairs| Provides allowed address |
|????????????????????? |????????????????????? | pairs??????????????????? |
| project_id field???? | project-id?????????? | Extension that indicates |
| enabled????????????? |????????????????????? | that project_id field is |
|????????????????????? |????????????????????? | enabled.???????????????? |
| Distributed Virtual? | dvr????????????????? | Enables configuration of |
| Router?????????????? |????????????????????? | Distributed Virtual????? |
|????????????????????? |????????????????????? | Routers.???????????????? |
+----------------------+----------------------+--------------------------+

c.啟動 neutron 代理驗證是否成功
# neutron agent-list
+--------------------------------------+--------------------+------------+
| id?????????????????????????????????? | agent_type???????? | host?????? |
+--------------------------------------+--------------------+------------+
| 23601054-312a-497c-b728-4b791ce76e64 | L3 agent?????????? | controller |
| 9a7546d9-73ec-47e0-ab23-ca2a5366660f | Linux bridge agent | controller |
| acd42d89-1af4-413f-be77-3172d38a805d | Metadata agent???? | controller |
| b438ae93-aaf3-41f0-a7b7-d1502a1986c9 | DHCP agent???????? | controller |
| e1d32b6b-07c6-468b-965d-ce9dfd09b338 | Linux bridge agent | compute??? |
+--------------------------------------+--------------------+------------+
+-------------------+-------+----------------+---------------------------+
| availability_zone | alive | admin_state_up | binary??????????????????? |
+-------------------+-------+----------------+---------------------------+
| nova????????????? | :-)?? | True?????????? | neutron-l3-agent????????? |
|?????????????????? | :-)?? | True?????????? | neutron-linuxbridge-agent |
|?????????????????? | :-)?? | True?????????? | neutron-metadata-agent??? |
| nova????????????? | :-)?? | True?????????? | neutron-dhcp-agent??????? |
|?????????????????? | :-)?? | True?????????? | neutron-linuxbridge-agent |
+-------------------+-------+----------------+---------------------------+

?

轉載于:https://www.cnblogs.com/youran-he/p/8073242.html

總結

以上是生活随笔為你收集整理的ubuntu16.0 安装 openstack的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內容還不錯,歡迎將生活随笔推薦給好友。

最近日本韩国中文字幕 | 黄色一区三区 | av免费网站 | 国产这里只有精品 | 在线а√天堂中文官网 | 午夜国产一区 | 欧美精选一区二区三区 | 精品国产视频在线观看 | 精精国产xxxx视频在线播放 | 免费看久久久 | 99精品国产99久久久久久97 | 黄色成人影视 | 丁香一区二区 | 亚洲精品免费在线 | 国产在线精品国自产拍影院 | 久久99久久精品 | 在线黄色av | 国产精品一区二区久久久 | 久久avav | 五月黄色 | 91精品免费| 国产成人精品日本亚洲999 | 亚洲精品国 | 九色福利视频 | 最新国产精品久久精品 | 日韩视频免费在线观看 | 色亚洲激情 | 在线黄av| 精品欧美一区二区三区久久久 | 成人黄在线观看 | 日韩av视屏在线观看 | 婷婷激情综合五月天 | 日韩网站免费观看 | 美女黄视频免费看 | 国内精品免费久久影院 | 久久成人在线 | 亚洲专区欧美专区 | 狠狠色丁香婷婷综合久小说久 | 最近免费中文字幕大全高清10 | 日韩专区在线 | 色婷婷激情四射 | 在线观看91视频 | 亚洲一级黄色av | 国产亚洲午夜高清国产拍精品 | 狠狠操操操 | www.超碰97.com| 天天色欧美 | 在线观看免费视频你懂的 | 欧美日韩精品免费观看 | 午夜久操| 精品在线小视频 | 亚洲精品高清视频在线观看 | 超碰电影在线观看 | 新av在线| 99精品国产一区二区三区不卡 | 久久国产片 | 狠狠色丁香婷婷综合久久片 | 狠狠躁18三区二区一区ai明星 | av电影亚洲 | 午夜在线观看一区 | 青草视频在线看 | 手机av永久免费 | 蜜桃视频在线观看一区 | 欧美日韩国产一区二区三区在线观看 | 久草在线免费资源 | 日韩精品久久久久久久电影竹菊 | 欧美孕交vivoestv另类 | 97成人免费 | 天天操天天色综合 | 男女全黄一级一级高潮免费看 | 91精品视频免费看 | 欧美在线观看视频一区二区三区 | 99色免费视频 | 91私密视频 | 精品一区二区三区久久久 | 成人精品一区二区三区中文字幕 | 中文字幕在线看视频 | 97超碰人人澡人人爱 | 99精品乱码国产在线观看 | 久久久久久免费毛片精品 | 久久精品欧美日韩精品 | 中文免费在线观看 | 国产一级片免费观看 | 日韩毛片在线免费观看 | 91激情视频在线观看 | 国产精品自产拍在线观看中文 | 国产成人精品三级 | 最新日本中文字幕 | 日韩三级视频在线看 | 国产视频亚洲 | 久久69精品久久久久久久电影好 | 国产成人久久精品亚洲 | 97电影院在线观看 | 日韩色综合网 | 日韩免费一区 | 97伊人网| av在线永久免费观看 | 国产在线观看黄 | 免费精品人在线二线三线 | 超碰人人草 | 色综合www| 97超碰免费在线 | 国产一区二区精品 | 激情欧美xxxx | 免费污片 | 久久久久一区二区三区四区 | 99精品国产福利在线观看免费 | 亚洲久草网 | 91精品免费| 波多野结衣视频网址 | 人人澡人人爽欧一区 | 四虎精品成人免费网站 | 色香蕉在线| 99久久综合国产精品二区 | 日韩免费高清在线 | 黄网站色 | 一本色道久久综合亚洲二区三区 | 黄色国产高清 | 成人黄色小说网 | 国产视频在线观看免费 | 蜜桃视频在线视频 | 亚洲国产成人在线 | 欧美成人h版电影 | 亚洲丝袜一区 | 99久久er热在这里只有精品66 | 国产又粗又猛又色 | 国产午夜小视频 | 日韩v欧美v日本v亚洲v国产v | 久久丁香网 | 欧美日韩国产mv | 日日摸日日碰 | 黄色av影院 | 亚洲精色 | 午夜视频二区 | 热久久免费视频精品 | h视频在线看| 欧美日韩亚洲国产一区 | 日本黄色免费看 | 成人在线播放网站 | 日本中文在线 | 在线视频精品 | 国产精品久久久久久五月尺 | 亚洲精选在线 | 天天操操 | 9999国产精品 | 欧美-第1页-屁屁影院 | 欧美国产日韩在线视频 | 韩国av一区二区三区在线观看 | 精品国产美女 | 97视频资源 | 久久午夜剧场 | 久久福利精品 | 日韩午夜在线 | 国产精品18久久久久久首页狼 | 免费高清在线视频一区· | 国产一线二线三线性视频 | 99产精品成人啪免费网站 | 少妇搡bbbb搡bbb搡忠贞 | 天天插视频 | 久久婷婷一区二区三区 | 在线观看理论 | 亚洲国内精品 | 国产精品久久久久久爽爽爽 | 亚洲视频免费在线看 | 91九色视频在线观看 | 成人免费视频网站在线观看 | 中文字幕欧美日韩va免费视频 | 欧美精品二区 | 国产一级视频在线 | 久久综合桃花 | 免费毛片一区二区三区久久久 | 国产精品 视频 | 精品人人爽 | 欧美日韩一区二区免费在线观看 | 青草视频在线免费 | 欧美a级成人淫片免费看 | 黄色网免费 | 在线中文字幕播放 | 在线观看成人毛片 | 中文字幕在线看 | 亚洲精品男人天堂 | 欧美成人按摩 | 日韩欧美视频在线免费观看 | 在线视频一区二区 | 在线观看黄 | 国产三级av在线 | 久久久久久综合 | 久久免费一级片 | 91最新视频在线观看 | av三区在线 | 97电影手机 | 国产精品成人一区二区 | 精品国产电影 | 欧美在线18 | www九九热 | 久久视频在线观看中文字幕 | 麻豆久久一区 | 日韩在线视频网址 | 亚洲成人免费观看 | 免费一级片视频 | 人人看人人做人人澡 | 久草视频手机在线 | 免费一级日韩欧美性大片 | 国产综合福利在线 | 成人国产精品电影 | 欧美国产日韩激情 | av片子在线观看 | www.色就是色| 亚洲日本成人 | 亚洲色图激情文学 | 国产精品一区二区白浆 | 伊人热| 亚洲男男gⅴgay双龙 | 高清不卡免费视频 | 91在线亚洲 | 日本精品一 | 伊人一级 | 最新久久久 | 日韩免费网站 | 亚洲成人精品久久 | 久久人人看 | 亚洲国产免费网站 | 欧美国产日韩一区 | 婷婷九月激情 | 色久网| 成人av高清在线观看 | 成人资源在线观看 | 日韩精品欧美一区 | 国产小视频国产精品 | 日本精品中文字幕 | 中文字幕 91 | 日韩欧美在线综合网 | 丝袜+亚洲+另类+欧美+变态 | 美国三级黄色大片 | 国产在线观看网站 | 999久久久久久久久 69av视频在线观看 | 国产精品v欧美精品 | 久久久精品国产免费观看同学 | 日韩欧美精品一区二区 | 色婷婷福利视频 | 在线观看国产日韩欧美 | 国产精品成人久久久久 | 夜夜操夜夜干 | 国产精品一级视频 | 天天色天天射天天综合网 | 免费观看一区二区三区视频 | 久久精品久久精品久久精品 | 欧美一级性生活视频 | 国产精品婷婷午夜在线观看 | aaa毛片视频 | 久射网 | 91精品在线视频观看 | 国产精品一区二区三区在线播放 | 五月开心六月伊人色婷婷 | 大胆欧美gogo免费视频一二区 | 久久国产成人午夜av影院潦草 | 亚洲精品99久久久久中文字幕 | 黄色片网站免费 | 国产精品男女啪啪 | 国产精彩在线视频 | 国产日韩高清在线 | 麻豆久久久久 | 国产精品美女在线 | 日韩三级视频在线观看 | 日本婷婷色| 五月天六月丁香 | 国产精品9999久久久久仙踪林 | 日韩有码网站 | 在线免费高清视频 | 99久久久国产免费 | 亚洲日本精品视频 | 国产中文字幕视频在线观看 | 手机在线观看国产精品 | 日本三级大片 | 在线99 | 黄色av影院 | 在线观看v片 | 欧美精品在线观看免费 | 五月婷婷六月丁香激情 | 天天干,天天射,天天操,天天摸 | 天天射综合网站 | 日韩一区二区三区免费视频 | 中文字幕激情 | 91av在线不卡 | 欧美色操 | 不卡视频在线看 | 久久精品亚洲 | 国产真实精品久久二三区 | 五月婷婷,六月丁香 | 成人av一区二区兰花在线播放 | 久久久久久高潮国产精品视 | 免费日韩 精品中文字幕视频在线 | 精品国产一区二区三区不卡 | 黄a网 | 国产成人精品一区二 | 开心激情综合网 | 亚洲第一久久久 | 国产99一区| 欧美久久影院 | 欧美色操 | 亚洲精品高清视频在线观看 | 亚洲一级黄色av | 国产真实精品久久二三区 | 最新黄色av网址 | 天天干,天天射,天天操,天天摸 | 国产精品一区二区三区免费视频 | 中文在线8新资源库 | 伊人婷婷激情 | 免费黄色激情视频 | 欧美福利网站 | 国产精品白浆视频 | 亚洲欧美国产精品 | 亚洲精品国产精品国自产在线 | 久久综合网色—综合色88 | 黄色毛片网站在线观看 | a级国产乱理论片在线观看 伊人宗合网 | av网址最新 | 亚洲乱亚洲乱亚洲 | 免费看黄的视频 | 久久免费视频精品 | 日韩性色| 偷拍精偷拍精品欧洲亚洲网站 | 四虎影视8848aamm | 欧美一级片免费 | 国产精品乱码一区二三区 | 日韩欧美视频在线免费观看 | 丁香在线观看完整电影视频 | 欧美一级xxxx| 国产破处视频在线播放 | 人人精久 | 麻豆视频免费 | 91色吧| 久久久久欧美精品999 | 五月婷婷在线综合 | 国产视频中文字幕在线观看 | 日韩精品最新在线观看 | 久久试看 | 国产成人精品一区二区三区福利 | 午夜视频黄 | 在线观看视频免费播放 | 国产精品一区二区免费看 | 五月婷婷丁香六月 | 91视频 - 114av| 97视频人人免费看 | 91免费国产在线观看 | 91精品国产自产在线观看永久 | 国产精品久一 | 成人精品一区二区三区电影免费 | av丁香花 | 天天爱天天舔 | 国产乱码精品一区二区蜜臀 | 九九激情视频 | 欧美激情xxxx性bbbb | 91色在线观看 | 色多多视频在线 | 国产精品久久久久久久久久直播 | 国产破处精品 | 91视频啪 | 久久一及片 | av电影在线观看完整版一区二区 | 午夜精品99久久免费 | 日韩伦理片一区二区三区 | 四虎免费在线观看 | 色视频网站免费观看 | 免费日韩高清 | 91麻豆精品国产自产在线 | 婷婷综合伊人 | av在线小说 | av在线播放观看 | 色婷婷激情 | 日韩精品中文字幕在线播放 | 玖草在线观看 | 国产精品久久久影视 | 91tv国产成人福利 | 欧美一区成人 | 亚洲国产一区在线观看 | 91成人精品观看 | 美女网站免费福利视频 | 午夜视频一区二区 | 欧美日韩精 | 国产在线观看av | 日韩免费高清在线观看 | 午夜国产一区二区 | 国产精品99久久免费黑人 | 日韩国产精品久久 | 国产成人精品亚洲 | 成人蜜桃网 | 天天色天天上天天操 | 欧美日韩国产综合一区二区 | 99热最新在线 | 成人在线观看网址 | 久草综合视频 | 国产特级毛片aaaaaa | 91精品天码美女少妇 | 青青河边草免费观看 | 国产一区欧美日韩 | 99999精品 | 婷婷视频导航 | 国产精品亚 | 日韩在线视频一区二区三区 | 国产91精品一区二区麻豆网站 | 一本色道久久综合亚洲二区三区 | 在线观看中文字幕2021 | 最新av免费在线 | 91麻豆福利 | 99人成在线观看视频 | 亚洲最新视频在线播放 | 人人射人人爽 | 天天色.com| 美女视频网| 碰超在线 | 天天干天天干天天干天天干天天干天天干 | 久久午夜影院 | 久草在线视频网站 | 99精品热| 久久久久久国产精品免费 | 一区二区 久久 | 午夜视频二区 | 国产成人a亚洲精品v | 久久精品久久精品 | 91在线porny国产在线看 | 精品a在线 | 成人资源站 | 97超碰人人模人人人爽人人爱 | 国产精品免费在线 | 黄色av网站在线观看 | aaa毛片视频 | 日本少妇高清做爰视频 | 人人干人人搞 | 91网页版在线观看 | 国产护士av | 97国产电影| 国产精品毛片一区二区在线看 | 五月婷在线观看 | 美女国产网站 | 色在线国产 | 欧美日韩国产精品久久 | 国产精品18久久久久久久久久久久 | 国产69久久久 | 久久免费视频这里只有精品 | 国产精品美女久久久久久久 | 深夜免费福利网站 | 少妇av网| 欧美精品一区二区三区一线天视频 | 91九色精品女同系列 | 国产精品对白一区二区三区 | 99在线视频精品 | 久热超碰| 久热久草 | 日韩av不卡在线播放 | 亚洲激情 欧美激情 | 伊人五月天婷婷 | 美女视频网| 国产一二三四在线观看视频 | 欧美 亚洲 另类 激情 另类 | 日韩精品视频网站 | 91麻豆精品国产91久久久久久 | 国产欧美日韩精品一区二区免费 | 在线天堂中文在线资源网 | 午夜在线观看一区 | 在线观看日韩精品 | 亚洲理论电影 | 97精品国产97久久久久久久久久久久 | 最新午夜 | 黄色日批网站 | 日本精品久久久久中文字幕5 | 久久免费成人网 | 四虎精品成人免费网站 | 亚洲一区美女视频在线观看免费 | www.黄色片网站 | 亚洲午夜精品一区 | 天天干天天干天天色 | 亚洲精品乱码久久久久久按摩 | 久久久久国产视频 | 成人毛片在线观看 | 国产片网站 | 久久精品中文视频 | 亚洲成av人片在线观看www | 亚洲黄色小说网 | 天天射天天射天天射 | 麻豆一精品传二传媒短视频 | 日本成人免费在线观看 | 视频国产精品 | 六月丁香婷 | 国产在线观看高清视频 | 黄色一集片 | 免费观看黄色12片一级视频 | 成人免费 在线播放 | 久久精品香蕉视频 | 欧美在线视频免费 | 欧美日韩国产一区 | 日韩欧美在线观看一区二区三区 | 久久艹国产 | 久久精品xxx | 玖玖精品视频 | 久久精品视频日本 | 国产伦理久久精品久久久久_ | 97在线视频免费观看 | 黄色的片子 | 精品美女视频 | 欧美一区影院 | 97精品国产97久久久久久 | 久久不射电影院 | 国产精品美女久久久久久免费 | 一区二区三区视频网站 | 国产精品第2页 | 久久久久久久久久久久久久电影 | 天天色天天操综合 | 国产精品一区免费观看 | 日韩av资源在线观看 | 天天操狠狠干 | 欧美日韩视频一区二区三区 | 成人三级av| 国产精品久久久久久欧美 | 久久成人免费 | 日韩av成人免费看 | 亚洲美女视频网 | 免费在线国产视频 | 3d黄动漫免费看 | 五月综合色婷婷 | 国产精品视频免费看 | 少妇自拍av | 91精品国 | 国产精品1区2区3区 久久免费视频7 | 三级黄色理论片 | 一区二区视 | 天天操天天爱天天干 | 国产一区二区免费 | 欧美日在线观看 | 特黄特色特刺激视频免费播放 | 肉色欧美久久久久久久免费看 | 久久天天躁狠狠躁亚洲综合公司 | 国产99久久久久 | 在线va网站 | 精品亚洲免a | 在线影院av | 久久不色| 免费观看一区 | 激情开心色 | 日日草av| 久久久久久美女 | 美女久久精品 | 免费精品视频在线观看 | 99精品色 | 国产青草视频在线观看 | 国产精品淫 | 激情综合网五月婷婷 | 亚洲精品国偷拍自产在线观看蜜桃 | 伊人资源视频在线 | 日韩三级一区 | 国产午夜影院 | 91色九色| 久久国产免费看 | 中文av网站| 99中文字幕在线观看 | 狠狠操操 | 一本一本久久a久久精品综合 | 视频一区二区在线 | 激情综合五月天 | 亚州精品天堂中文字幕 | www日韩| 亚洲免费成人 | 香蕉视频网站在线观看 | 色窝资源| 色偷偷av男人天堂 | 一区二区三区 亚洲 | 久久99九九99精品 | 久久久久国产成人精品亚洲午夜 | 国产精品高清在线 | 免费97视频| 中文在线中文资源 | 久久精品一区二区三区中文字幕 | 日本黄色免费大片 | 日韩av在线资源 | 精品二区久久 | 免费看的毛片 | 国产美腿白丝袜足在线av | 欧美国产高清 | 午夜精品久久久久久久99热影院 | 日本中文字幕系列 | 黄色精品久久久 | 色中射 | 天天av天天 | 91精品国自产在线观看 | 麻豆影视网| 中文字幕在线视频免费播放 | 三级动图| 久久天堂影院 | 久久综合中文色婷婷 | 久久字幕精品一区 | 在线中文字幕视频 | 国产丝袜高跟 | 国产亚洲视频在线观看 | 91麻豆免费视频 | 久久理伦片 | 亚洲精品一区二区精华 | 最新动作电影 | 久久久久久久综合色一本 | 色婷婷久久一区二区 | 国产精品大片免费观看 | 国内精品久久久久久 | 久久黄色小说视频 | 日韩av电影免费在线观看 | 激情综合网色播五月 | 96av麻豆蜜桃一区二区 | 欧美色综合久久 | 99精品久久99久久久久 | 手机色在线 | 黄色精品久久 | 一区二区av | 久久精品一区二区三 | 国产一区在线视频播放 | 国产一级免费av | 成年人免费看片网站 | 成人免费av电影 | 91成人精品一区在线播放69 | 免费看国产视频 | 五月天天av| 久久精品国产一区二区电影 | 国产亚洲视频在线免费观看 | 欧美精品免费在线观看 | 国产精品久久久久久久7电影 | 色偷偷88888欧美精品久久 | 日日干日日色 | 久久不色 | 激情综合网五月婷婷 | 人人爽人人看 | 成年人视频免费在线 | 在线观看中文字幕视频 | 玖玖视频 | 中文字幕丝袜美腿 | 亚洲精选视频免费看 | 久久99久久99精品中文字幕 | 丁香花在线观看免费完整版视频 | 中文字幕乱码日本亚洲一区二区 | 久久久国产一区二区三区四区小说 | 国产精品永久 | 日韩三级在线观看 | 日韩,中文字幕 | 日韩在线一二三区 | 国产精品久久久久久久久久免费 | 久久69av| 久久99久久99精品免观看软件 | 日韩小视频网站 | 亚洲精品美女在线观看播放 | 亚洲美女精品视频 | 国产黄色大片免费看 | 成人免费观看av | 九九电影在线 | 美女黄网站视频免费 | 免费高清在线一区 | 91免费观看网站 | 免费亚洲精品 | 久久99国产视频 | 亚洲精品免费在线 | 国产精品一区专区欧美日韩 | 97精品一区二区三区 | 深爱五月网 | 久久久精品久久 | 亚洲砖区区免费 | 日本中文字幕在线一区 | 亚洲精品综合久久 | 成人一区二区三区在线观看 | 国产区久久 | 99久久精品国产免费看不卡 | 国内精品久久久 | 国产伦理一区 | 国模视频一区二区三区 | 天天摸天天操天天舔 | 成人免费电影 | 色婷婷 亚洲 | 成人福利在线播放 | 国产午夜精品久久久久久久久久 | 日本午夜免费福利视频 | 91精品网站在线观看 | 国产欧美精品一区二区三区四区 | www.com久久 | 国产香蕉97碰碰碰视频在线观看 | 九七视频在线 | 97成人精品区在线播放 | 在线观看av片 | 欧美精品网站 | 久久99久久99精品免费看小说 | 国产永久免费高清在线观看视频 | 狠狠的干狠狠的操 | 亚洲国产午夜视频 | 国产精品入口麻豆 | 女人18毛片a级毛片一区二区 | 91精品啪啪| 一区二区在线影院 | 成人a在线观看高清电影 | av成人免费| 日韩欧美成| 91精品久久久久久久久 | 久久精品屋| www中文在线| 久久午夜电影院 | 亚洲视频久久 | 国产91全国探花系列在线播放 | 91在线观看高清 | 中文字幕av在线免费 | 久草剧场| 国产精品一区二区三区99 | 中文字幕av播放 | 欧美性猛片 | 欧美在线1 | 99热高清| 亚洲乱码精品久久久久 | 亚洲国产高清在线观看视频 | 久久久久久久电影 | 一区二区三区视频在线 | 日韩在线观看视频免费 | 草莓视频在线观看免费观看 | 黄色免费av | 中国成人一区 | 免费在线色 | 午夜精品一区二区国产 | 成人免费看黄 | 久久草精品| 99精品在线播放 | 奇米影视777四色米奇影院 | 摸阴视频 | 成人黄色在线视频 | 天天曰| 免费在线看v | 亚洲激情网站免费观看 | 91在线视频免费观看 | 成人av在线资源 | 天天干天天爽 | 在线观看色视频 | av黄色在线观看 | 成人污视频在线观看 | 国产精品人成电影在线观看 | 91桃花视频 | 97成人精品视频在线观看 | 日韩a在线 | 成年人免费在线播放 | 国产破处视频在线播放 | 激情五月激情综合网 | 91精品国产欧美一区二区成人 | 激情视频一区二区三区 | 成年人网站免费在线观看 | 亚洲高清不卡av | 在线激情网 | 久久精品艹| 香蕉在线观看 | 九九色综合 | 久久久久免费网站 | 99精品黄色 | 婷婷丁香狠狠爱 | 欧美黄色软件 | 亚洲理论影院 | www.五月天激情 | 午夜精品一区二区三区视频免费看 | 国产欧美精品一区二区三区四区 | 国产一级久久久 | 在线观看视频在线观看 | 丁香视频五月 | 日韩av中文在线 | 日韩a级黄色 | 欧美二区视频 | 天天射天天干天天操 | 国产一区二区三区在线免费观看 | 人交video另类hd | 国产亚洲视频中文字幕视频 | 国产成人亚洲在线电影 | 亚洲精品黄色 | 国产伦精品一区二区三区在线 | 久久久久久免费视频 | 午夜免费在线观看 | 2019中文字幕第一页 | 久久久麻豆精品一区二区 | 国产精品中文字幕av | 久久精品韩国 | 国产在线a视频 | 久久国产女人 | 久久免费在线视频 | 最新中文字幕在线播放 | 成人午夜剧场在线观看 | 一区在线播放 | 精品国产一区二区三区av性色 | 99热国产在线| 国产99久久九九精品免费 | 国内免费的中文字幕 | 久久久久久久综合色一本 | 麻豆视频大全 | 成人三级网址 | 亚洲激情av | 国产系列在线观看 | 精品视频不卡 | 久久久久综合视频 | 激情网五月婷婷 | 91高清不卡 | 日韩欧美在线免费 | 免费在线观看国产精品 | 色吧久久 | 国产小视频福利在线 | 9在线观看免费高清完整版在线观看明 | 日韩xxxx视频 | 精品国产一区二 | 99久久99久久综合 | 免费在线观看av网站 | 亚洲精品在线视频播放 | 91精品国产综合久久福利不卡 | 伊人天天 | 欧美va在线观看 | 一区二区三区韩国免费中文网站 | 精品一区二区综合 | 激情综合网色播五月 | 亚洲一区 影院 | 福利一区视频 | 高清免费av在线 | 中文在线中文a | 中文字幕一区二区三区在线视频 | 欧美激情视频一二三区 | 婷婷国产v亚洲v欧美久久 | 久久久久这里只有精品 | 国产一区二区免费在线观看 | 亚洲乱码国产乱码精品天美传媒 | 国产精品美女毛片真酒店 | 99免费精品视频 | 国产夫妻性生活自拍 | 成人精品一区二区三区电影免费 | 久久久精品小视频 | 国产精品国产毛片 | 精品欧美一区二区精品久久 | 午夜国产一区二区 | 日韩av一区二区三区在线观看 | 欧美久久九九 | 91中文字幕在线视频 | 国产成人免费高清 | 久久人人爽人人 | 91成人精品国产刺激国语对白 | 亚洲精品日韩一区二区电影 | 97在线视频免费播放 | 成人四虎影院 | 国产精品欧美久久久久天天影视 | 伊人伊成久久人综合网小说 | 99视频在线精品国自产拍免费观看 | 精品国产123 | 成人黄色毛片 | 免费男女网站 | 夜夜干天天操 | 国产成人精品一区二区三区免费 | 天天干一干 | 国产中文在线播放 | 丁香综合av| 97小视频 | 久草在在线 | 国产在线久草 | 久久免费的视频 | 免费又黄又爽的视频 | 91网站在线视频 | 国产在线精品视频 | 日韩在线一区二区免费 | 国产一级在线 | 国产精品一区二区三区视频免费 | 国产日韩欧美在线免费观看 | 九热在线 | 91香蕉久久 | 国产精品久久久久影视 | 夜色成人网| 天天色.com | 欧美日韩精品免费观看视频 | 亚洲精品久久久久久国 | 91干干干 | 色婷婷亚洲综合 | 成人av在线直播 | 久久人人爽人人人人片 | 色99中文字幕 | 日韩av免费在线电影 | 亚洲精品网站在线 | 99在线热播精品免费 | 91精品对白一区国产伦 | 中文字幕永久 | 91亚色免费视频 | 天天综合亚洲 | 888av| 黄色tv视频| 久久夜色精品国产亚洲aⅴ 91chinesexxx | 黄在线免费看 | 91在线免费视频 | 97夜夜澡人人爽人人免费 | 亚洲午夜精品一区二区三区电影院 | a黄色影院| 亚洲国产午夜精品 | 日韩一级黄色大片 | 久久久久草 | 91在线九色 | 国产精品黄色影片导航在线观看 | 六月色| 久久歪歪 | 一区二区中文字幕在线 | 国产精品h在线观看 | 狠狠狠综合 | 超碰97在线人人 | 黄色免费大全 | 亚州精品视频 | 911香蕉视频 | 亚洲国产精品人久久电影 | 伊人五月天婷婷 | 免费看黄色91 | 97av视频在线观看 | 99国产一区二区三精品乱码 | 99精品视频精品精品视频 | 中文在线字幕观看电影 | av东方在线 | 欧美日本在线视频 | 国产精品久99| av短片在线 | 美女视频免费精品 | 久久超| 免费在线91| 免费av片在线 | 91九色视频在线播放 | 一区二区三区在线视频观看58 | 久久国产经典 | 91久久在线观看 | av中文字幕在线电影 | 五月天六月丁香 | 97免费在线观看视频 | 亚洲精品久久久久中文字幕二区 | 国产午夜小视频 | 人人干人人干人人干 | 97成人啪啪网 | 人人爽人人爽人人 | 日韩欧美综合 | 亚洲日本黄色 | www.久久色| 日韩精品一区二区三区高清免费 | 黄色午夜 | 亚洲人av免费网站 | 久久免费精品一区二区三区 | 精品视频区 | 视频在线观看入口黄最新永久免费国产 | 香蕉视频啪啪 | 狠狠色丁香婷婷综合 | 毛片网站免费在线观看 | 有码中文在线 | 日韩在线播放av | av在线播放观看 | av福利在线 | 天天操天天干天天摸 | 午夜久久电影网 | 久久久精品国产免费观看一区二区 | 天天射网 | 色av网站| 国产美女网| 人人射人人爽 | 中文字幕在线观看一区二区 | 91麻豆精品国产午夜天堂 | 亚洲91精品在线观看 | 一区二区理论片 | 2023国产精品自产拍在线观看 | 8x成人免费视频 | 五月天综合色激情 | 9999精品 | av在线免费观看不卡 | 乱男乱女www7788| 久草香蕉在线视频 | 开心激情五月网 | 免费在线观看一区二区三区 | 欧美一级免费高清 | 99高清视频有精品视频 | 91xav| 综合久久五月天 | 99久久精 | 免费亚洲精品视频 | 久久老司机精品视频 | 色久网| 亚洲a网 | 精品亚洲男同gayvideo网站 | www免费在线观看 | 国产xx在线 | 亚洲精品免费在线视频 | 绯色av一区| 亚洲色图色 | 日韩在线资源 | 激情九九 | 亚洲精品综合在线 | 久久久精品视频成人 | 国产在线播放一区二区三区 | 成人h在线播放 | 狠狠狠狠狠狠狠 | 在线天堂中文www视软件 | 国产无套精品久久久久久 | 人人射人人爱 | 午夜视频色| 中文区中文字幕免费看 | 精品免费观看视频 | 午夜精品一二三区 | 日韩精品欧美专区 | 91av中文| 色视频成人在线观看免 | 婷婷成人亚洲综合国产xv88 | 久久精品视频99 | 天天天干天天天操 | 亚洲另类xxxx |