• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

originrose/cortex: Machine learning in Clojure

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称(OpenSource Name):

originrose/cortex

开源软件地址(OpenSource Url):

https://github.com/originrose/cortex

开源编程语言(OpenSource Language):

Clojure 93.4%

开源软件介绍(OpenSource Introduction):

Cortex TravisCI

Neural networks, regression and feature learning in Clojure.

Cortex has been developed by ThinkTopic in collaboration with Mike Anderson.

Mailing List

https://groups.google.com/forum/#!forum/clojure-cortex

Usage

Clojars Project

All libraries are released on clojars. Cortex is not 1.0 yet preliminary and you should expect quite a few things to change over time but it should allow you to train some initial classifiers or regressions. Note that the save format has not stabilized and although we do just save edn data in nippy format it may require some effort to bring versions of saved forward.

Cortex Design

Design is detailed here: Cortex Design Document

Please see the various unit tests and examples for training a model. Specifically see: mnist verification

Also, for an example of using cortex in a more real-world scenario please see: mnist example.

Existing Framework Comparisons

  • Stanford CS 231 Lecture 12 contains a detailed breakdown of Caffe, Torch, Theano, and TensorFlow.

TODO:

  • hdf5 import of major keras models (vgg-net). This requires each model along with a single input and per-layer outputs for that input. Please don't ask for anything to be supported unless you can provide the appropriate thorough test.

  • Recurrence in all forms. There is some work towards that direction in the compute branch and it is specifically designed to match the cudnn API for recurrence. This is less important at this point than running some of the larger pre-trained models.

  • Speaking of larger nets, multiple GPU support and multiple machine support (which could be helped by the above graph based description layer).

  • Profiling GPU system to make sure we are using as much GPU as possible in the single-gpu case.

  • Better data import/visualization support. We have geom and we have a clear definition of the datasets, now we need to put together the pieces and build some great visualizations as examples.

Getting Started:

  • Get the project and run lein test in both cortex and compute. The various unit tests train various models.

GPU Compute Install Instructions

Ubuntu

$ sudo apt install nvidia-cuda-toolkit
reboot

Install cuDNN and copy the cuDNN files to the corresponding folders in the local cuda installation (probably at /usr/local/cuda). For reference, follow the "Installing cuDNN" section here.

To check everything is working, run $ nvidia-smi

You should now have cuda8.0 installed. Current master is 8.0, so if you're running 7.5 you will need to change the javacpp dependency in your project file of the mnist Example.

Mac OS

These instructions follow the gpu setup from Tensor Flow, i.e.:

Install coreutils and cuda:

$ brew install coreutils
$ brew tap caskroom/drivers
$ brew cask install nvidia-cuda

Add CUDA Tool kit to bash profile

export CUDA_HOME=/usr/local/cuda
export DYLD_LIBRARY_PATH="$DYLD_LIBRARY_PATH:$CUDA_HOME/lib"
export PATH="$CUDA_HOME/bin:$PATH"

Download the CUDA Deep Neural Network libraries.

Once downloaded and unzipped, moving the files:

$ sudo mv include/cudnn.h /Developer/NVIDIA/CUDA-8.0/include/
$ sudo mv lib/libcudnn* /Developer/NVIDIA/CUDA-8.0/lib
$ sudo ln -s /Developer/NVIDIA/CUDA-8.0/lib/libcudnn* /usr/local/cuda/lib/

Should you see a jni linking error similar to this

Retrieving org/bytedeco/javacpp-presets/cuda/8.0-1.2/cuda-8.0-1.2-macosx-x86_64.jar from central
Exception in thread "main" java.lang.UnsatisfiedLinkError: no jnicudnn in java.library.path, compiling:(think/compute/nn/cuda_backend.c
lj:82:28)
        at clojure.lang.Compiler.analyze(Compiler.java:6688)
        at clojure.lang.Compiler.analyze(Compiler.java:6625)
        at clojure.lang.Compiler$HostExpr$Parser.parse(Compiler.java:1009)

Make sure you have installed the appropriate CUDNN for your version of CUDA.

Windows

Some preliminary information about getting gpu-acceleration working on windows is available here: https://groups.google.com/forum/#!topic/clojure-cortex/hNFW1T_2PZc

See also:

Roadmap




鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap