- using GetVerboseLevel(),
- avoiding 'WriteIntegerVector' for writing to KALDI_LOG by introducing:
  'operator<< (std::ostream, std::vector<T>)' in kaldi-error.h

- introducing interface 'MultistreamComponent',
  - handles stream-lengths and stream-resets,
- rewritten most of training tools 'nnet-train-lstm-streams',
  'nnet-train-blstm-streams',
- introducing 'RecurrentComponent' with simple forward recurrency.
- the LSTM/BLSTM components have clipping presets we recently
  found helpful for BLSTM-CTC system.
- renaming tools and components (removing 'streams' from names)
- updating the scripts for generating lstm/blstm prototypes
- updating 'rm' lstm/blstm examples

Minor fix to queue.pl RE its workaround for bugs in NFS; change when CuDevice warning is printed regarding device exclusive mode.

fix bug when do blstm nnet-forward

Fix "error" on checking dash

$ ./check_dependencies.sh 
./check_dependencies.sh: line 83: [: ==: unary operator expected
./check_dependencies.sh: all OK.
$

Modify extras_check_dependencies.sh to check more robustly for system-installed OpenFst (which conflicts with Kaldi)

fix bug when initialize blstm nnet

nnet3: Minor fix in NaturalGradientAffineComponent initialization

WIP : tedlium release 2

fix the bug on line 372 of wsj/s5/utils/prepare_lang.sh（issus 904）

Speed up AddDiagMatMat

CuVector::AddDiagMatMat<double>[no-trans],[no-trans],   16  0.0138  0.0172 1.24x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans],   32  0.0581  0.0646 1.11x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans],   64  0.2201  0.2271 1.03x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans],  128  0.7907  0.7302 0.92x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans],  256  1.9197  2.0379 1.06x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans],  512  3.8760  3.9739 1.03x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans], 1024  5.3297  7.2730 1.36x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans], 2048  4.7379  7.2775 1.54x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans], 4096  4.1652  8.7746 2.11x
CuVector::AddDiagMatMat<double>[no-trans],[no-trans], 8192  2.7393  9.6129 3.51x
CuVector::AddDiagMatMat<double>[trans],[trans],   16  0.0137  0.0175 1.28x
CuVector::AddDiagMatMat<double>[trans],[trans],   32  0.0576  0.0639 1.11x
CuVector::AddDiagMatMat<double>[trans],[trans],   64  0.2209  0.2254 1.02x
CuVector::AddDiagMatMat<double>[trans],[trans],  128  0.8055  0.7418 0.92x
CuVector::AddDiagMatMat<double>[trans],[trans],  256  1.9017  2.0358 1.07x
CuVector::AddDiagMatMat<double>[trans],[trans],  512  3.8703  3.9644 1.02x
CuVector::AddDiagMatMat<double>[trans],[trans], 1024  5.2985  7.3149 1.38x
CuVector::AddDiagMatMat<double>[trans],[trans], 2048  4.9325  7.2759 1.48x
CuVector::AddDiagMatMat<double>[trans],[trans], 4096  4.1638  8.7515 2.10x
CuVector::AddDiagMatMat<double>[trans],[trans], 8192  2.6703  9.6149 3.60x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans],   16  0.0137  0.0174 1.28x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans],   32  0.0576  0.0614 1.07x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans],   64  0.2150  0.2367 1.10x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans],  128  0.8098  0.7457 0.92x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans],  256  1.9851  2.1878 1.10x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans],  512  4.1400  4.3129 1.04x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans], 1024  6.2485  8.0504 1.29x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans], 2048  6.7869 12.2660 1.81x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans], 4096  5.8144 12.1037 2.08x
CuVector::AddDiagMatMat<float>[no-trans],[no-trans], 8192  3.2519 15.0645 4.63x
CuVector::AddDiagMatMat<float>[trans],[trans],   16  0.0137  0.0180 1.31x
CuVector::AddDiagMatMat<float>[trans],[trans],   32  0.0568  0.0672 1.18x
CuVector::AddDiagMatMat<float>[trans],[trans],   64  0.2193  0.2263 1.03x
CuVector::AddDiagMatMat<float>[trans],[trans],  128  0.8132  0.7751 0.95x
CuVector::AddDiagMatMat<float>[trans],[trans],  256  1.9621  2.1918 1.12x
CuVector::AddDiagMatMat<float>[trans],[trans],  512  4.2527  4.3181 1.02x
CuVector::AddDiagMatMat<float>[trans],[trans], 1024  6.3149  8.0543 1.28x
CuVector::AddDiagMatMat<float>[trans],[trans], 2048  6.7934 12.3520 1.82x
CuVector::AddDiagMatMat<float>[trans],[trans], 4096  5.8246 12.0940 2.08x
CuVector::AddDiagMatMat<float>[trans],[trans], 8192  3.2314 15.0555 4.66x

reformat code

CuVector::AddDiagMatMat<float>[trans],[no-trans],   16  0.0150  0.0172 1.15x
CuVector::AddDiagMatMat<float>[trans],[no-trans],   32  0.0593  0.0666 1.12x
CuVector::AddDiagMatMat<float>[trans],[no-trans],   64  0.2161  0.2533 1.17x
CuVector::AddDiagMatMat<float>[trans],[no-trans],  128  0.6925  0.9069 1.31x
CuVector::AddDiagMatMat<float>[trans],[no-trans],  256  1.7409  2.9110 1.67x
CuVector::AddDiagMatMat<float>[trans],[no-trans],  512  3.5518  6.7235 1.89x
CuVector::AddDiagMatMat<float>[trans],[no-trans], 1024  5.5328 13.3136 2.41x
CuVector::AddDiagMatMat<double>[trans],[no-trans],   16  0.0157  0.0179 1.14x
CuVector::AddDiagMatMat<double>[trans],[no-trans],   32  0.0578  0.0693 1.20x
CuVector::AddDiagMatMat<double>[trans],[no-trans],   64  0.2088  0.2620 1.25x
CuVector::AddDiagMatMat<double>[trans],[no-trans],  128  0.7430  0.9503 1.28x
CuVector::AddDiagMatMat<double>[trans],[no-trans],  256  1.7494  3.0979 1.77x
CuVector::AddDiagMatMat<double>[trans],[no-trans],  512  3.0646  6.1060 1.99x
CuVector::AddDiagMatMat<double>[trans],[no-trans], 1024  5.0206  9.4023 1.87x

CuVector::AddDiagMatMat<float>[no-trans],[trans],   16  0.0132  0.0188 1.42x
CuVector::AddDiagMatMat<float>[no-trans],[trans],   32  0.0563  0.0738 1.31x
CuVector::AddDiagMatMat<float>[no-trans],[trans],   64  0.2220  0.2846 1.28x
CuVector::AddDiagMatMat<float>[no-trans],[trans],  128  0.8277  0.9890 1.19x
CuVector::AddDiagMatMat<float>[no-trans],[trans],  256  3.4564  3.3012 0.96x
CuVector::AddDiagMatMat<float>[no-trans],[trans],  512  7.8546  8.6339 1.10x
CuVector::AddDiagMatMat<float>[no-trans],[trans], 1024 14.4238 16.4371 1.14x
CuVector::AddDiagMatMat<double>[no-trans],[trans],   16  0.0138  0.0175 1.27x
CuVector::AddDiagMatMat<double>[no-trans],[trans],   32  0.0561  0.0715 1.27x
CuVector::AddDiagMatMat<double>[no-trans],[trans],   64  0.2280  0.2765 1.21x
CuVector::AddDiagMatMat<double>[no-trans],[trans],  128  0.9059  0.9130 1.01x
CuVector::AddDiagMatMat<double>[no-trans],[trans],  256  3.2346  2.9633 0.92x
CuVector::AddDiagMatMat<double>[no-trans],[trans],  512  5.7313  6.6734 1.16x
CuVector::AddDiagMatMat<double>[no-trans],[trans], 1024  9.2105 10.1042 1.10x

fix a bug in ClipGradientComponent::RepairGradients(), which may caus…

steps/nnet3/report : Added capability to plot clipped-proportions

Adding the underlying scripts for my refactored version of Vimal's da…

Adding the underlying scripts for my refactored version of Vimal's data-cleanup-and-resegmentation.  No example scrips yet-- will come soon.

New data-related utility scripts to be used in the not-yet-committed data cleanup scripts.  Also various script bug fixes.

Make it so that matrix row ranges are supported when reading single objects as opposed to just when reading tables.

Tedlium data prep changes

Some updates to the TEDLIUM recipe data preparation: pad training segment times by around 0.1 seconds, and join all 's and 're suffixes [etc.] in text prepration in both training and test.