Posts Tagged ‘torch’

Batch-Normalized LSTM for Torch

Written by iassael on . Posted in computing, machine learning

Recurrent Batch Normalization

Batch-Normalized LSTMs

Tim Cooijmans, Nicolas Ballas, César Laurent, Çağlar Gülçehre, Aaron Courville

http://arxiv.org/abs/1603.09025

Usage

Clone from: https://github.com/iassael/torch-bnlstm

local rnn = nn.LSTM(input_size, rnn_size, n, dropout, bn)

n = number of layers (1-N)

dropout = probability of dropping a neuron (0-1)

bn = batch normalization (true, false)

Example

https://github.com/iassael/char-rnn

Performance

Validation scores on char-rnn with default options

bnlstm_val_loss

 

Toch7 Intel MKL not found

Written by iassael on . Posted in computing, machine learning

I am on Mac OS X Yosemite, and although I had installed Intel MKL properly, I was getting a mkl_intel_lp64 not found message when I was trying to install Torch7.

The solution was found by adding the following links to your .profile.

source /opt/intel/composer_xe_2015.3.187/bin/compilervars.sh intel64

and most importantly:

export CMAKE_INCLUDE_PATH=$CMAKE_INCLUDE_PATH:/opt/intel/compilers_and_libraries/mac/include:/opt/intel/mkl/include
export CMAKE_LIBRARY_PATH=$CMAKE_LIBRARY_PATH:/opt/intel/compilers_and_libraries/mac/lib:/opt/intel/mkl/lib