分布式机器学习框架:MxNet
???? MxNet官網: http://mxnet.readthedocs.io/en/latest/
前言:
caffe是很優秀的dl平臺。影響了后面很多相關框架。
cxxnet借鑒了很多caffe的思想。相比之下,cxxnet在實現上更加干凈,例如依賴很少,通過mshadow的模板化使得gpu和cpu代碼只用寫一份,分布式接口也很干凈。mxnet是cxxnet的下一代,目前實現了cxxnet所有功能,但借鑒了minerva/torch7/theano,加入更多新的功能。
目前mxnet還在快速發展中。這個月的主要方向有三,更多的binding,更好的文檔,和更多的應用(language model、語音,機器翻譯,視頻)。地址在dmlc/mxnet · GitHub
官方簡介: ??????????
?????? MXNet is a deep learning framework designed for both efficiency andflexibility.It allows you tomix theflavours of symbolicprogramming and imperative programming to maximize efficiency and productivity.In its core, a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations on the fly.A graph optimization layer on top of that makes symbolic execution fast and memory efficient.The library is portable and lightweight, and it scales to multiple GPUs and multiple machines.
?????? MXNet is also more than a deep learning project. It is also a collection ofblue prints and guidelines for buildingdeep learning system, and interesting insights of DL systems for hackers.
????? MxNet混合了符號式設計和命令式設計,來最大化效率和提高產出。其核心是一個動態調度器,不停的并行執行符號和命令操作。頂層的圖優化層使符號執行快速且有效。這個包輕量級可移植性好,并且可以擴展到多GPU和多個機器。
最新發展
What's New
- MXNet Memory Monger, Training Deeper Nets with Sublinear Memory Cost
- Tutorial for NVidia GTC 2016
- Embedding Torch layers and functions in MXNet
- MXNet.js: Javascript Package for Deep Learning in Browser (without server)
- Design Note: Design Efficient Deep Learning Data Loading Module
- MXNet on Mobile Device
- Distributed Training
- Guide to Creating New Operators (Layers)
- Amalgamation and Go Binding for Predictors
- Training Deep Net on 14 Million Images on A Single Machine
- MxNet的內存管理:子線性的內存代價
- NVIDIA GTC2016上的 教程
- 嵌入 Torch網絡層和函數 到MxNet
- MxNet.js : 可運行到瀏覽器中的javascript包
- 設計節點:設計有效的深度學習數據載入模型
- 移動設備的上的 Mxnet
- 分布式訓練方法
- 網絡層 的運算符重載
- 使用一個深度網絡 訓練1400萬張圖片
Contents
- Documentation and Tutorials
- Design Notes
- Code Examples
- Installation
- Pretrained Models
- Contribute to MXNet
- Frequent Asked Questions
Features
- Design notes providing useful insights that can re-used by other DL projects
- Flexible configuration for arbitrary computation graph
- Mix and match good flavours of programming to maximize flexibility and efficiency
- Lightweight, memory efficient and portable to smart devices
- Scales up to multi GPUs and distributed setting with auto parallelism
- Support for python, R, C++ and Julia
- Cloud-friendly and directly compatible with S3, HDFS, and Azure
Ask Questions
- Please use mxnet/issues for how to use mxnet and reporting bugs
License
? Contributors, 2015. Licensed under an Apache-2.0 license.
Reference Paper
Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao,Bing Xu, Chiyuan Zhang, and Zheng Zhang.MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems.In Neural Information Processing Systems, Workshop on Machine Learning Systems, 2015
History
MXNet is initiated and designed in collaboration by the authors of cxxnet, minerva andpurine2. The project reflects what we have learnt from the past projects. It combines important flavours of the existing projects for efficiency, flexibility and memory efficiency.
???????
總結
以上是生活随笔為你收集整理的分布式机器学习框架:MxNet的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: Caffe: Vs13添加CUDA支持
- 下一篇: MxNet教程:使用一台机器训练1400