思路：多個gpu 服務接口-->ngxin做負載均衡-->對外暴露一個。

以一機兩卡為例,其中gunicorn部署一卡多進程服務參考這篇文章

一.制作nginx負載均衡鏡像

1.制作Dockerfie

FROM nginx:1.13.3 COPY ./ / RUN mkdir /app COPY /nginx.conf /etc/nginx/nginx.conf

2.nginx.conf詳細

#user nobody; worker_processes 1;#error_log logs/error.log; #error_log logs/error.log notice; #error_log logs/error.log info;#pid logs/nginx.pid;events {worker_connections 1024; }http {include mime.types;default_type application/octet-stream;#log_format main '$remote_addr - $remote_user [$time_local] "$request" '# '$status $body_bytes_sent "$http_referer" '# '"$http_user_agent" "$http_x_forwarded_for"';#access_log logs/access.log main;sendfile on;#tcp_nopush on;#keepalive_timeout 0;keepalive_timeout 65;#gzip on;#bx----------------------upstream algoserver{server 192.168.102.200:10009;}server {listen 8082;server_name localhost;#charset koi8-r;#access_log logs/host.access.log main;location / {#root html;#index index.html index.htm;#bx--------------------------------proxy_pass http://algoserver;proxy_set_header Host $host;}#error_page 404 /404.html;# redirect server error pages to the static page /50x.html#error_page 500 502 503 504 /50x.html;location = /50x.html {root html;}# proxy the PHP scripts to Apache listening on 127.0.0.1:80##location ~ \.php$ {# proxy_pass http://127.0.0.1;#}# pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000##location ~ \.php$ {# root html;# fastcgi_pass 127.0.0.1:9000;# fastcgi_index index.php;# fastcgi_param SCRIPT_FILENAME /scripts$fastcgi_script_name;# include fastcgi_params;#}# deny access to .htaccess files, if Apache's document root# concurs with nginx's one##location ~ /\.ht {# deny all;#}}# another virtual host using mix of IP-, name-, and port-based configuration##server {# listen 8000;# listen somename:8080;# server_name somename alias another.alias;# location / {# root html;# index index.html index.htm;# }#}# HTTPS server##server {# listen 443 ssl;# server_name localhost;# ssl_certificate cert.pem;# ssl_certificate_key cert.key;# ssl_session_cache shared:SSL:1m;# ssl_session_timeout 5m;# ssl_ciphers HIGH:!aNULL:!MD5;# ssl_prefer_server_ciphers on;# location / {# root html;# index index.html index.htm;# }#}}

其中server 192.168.102.200:10009;
? ? ? ? server 192.168.102.200:10010;

就是gpu啟動的兩個服務，現在映射為192.168.102.200:8082.

3.build鏡像

docker build -t nginx/express:0.1 .

二.啟動容器做負載均衡

上面的8082端口就對外映射為10016,用戶就可以通過10016調用10009和10010的gpu服務啦。

docker run -it -p 10016:8082 -v /home/fanzonghao/red_detection/software/nginx.conf:/etc/nginx/nginx.conf nginx/express:0.1

?

總結

以上是生活随笔為你收集整理的nginx做负载均衡，解决多机器多gpu卡服务对外暴露一个接口问题的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。