sandbox/dan2: various modifications and bug fixed to support CUDA training in Dan's recipe.  Modify CUDA device selection code (cleanup, and make error-status controllable).

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3105 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: Modify CUDA matrix allocation so that it caches freed memory and returns cached answers if they are of the size required... this is to work around the extremee slowness of cudaMalloc and cudaMallocPitch on some platforms.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3104 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3100 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: copying directories fstext,latbin back from trunk (we merged our changes back to trunk; revision history gets messed up and merges become difficult, unless we delete and copy them back at this point).

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3090 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: Deleting directories fstext,latbin from ^/sandbox/kaldi-dan2/src; next commit will copy them back from trunk.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3089 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: merging changes from trunk; some further small code-level optimizations to determinization code (which I just realized were done in sandbox/dan2; I'll now merge those back to trunk.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3087 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: Optimizations to lattice-determinization code (approx 20% decoding speedup when using large lattice-beam).

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3085 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: changes to Makefiles so that CUDA libraries are not needed for those programs that don't use CUDA.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3065 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3060 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: some name changes in cudamatrix library; remove some code RE allocation that I decided not to use.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3046 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3038 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: Modify some nnet code to use symmetric regular not packed matrices; minor improvements in cudamatrix/

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3034 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3033 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: modify sliding-window CMVN algorithm to include current frame in window (note: this code not used in any recipes yet); modify prior-floor in nnet-cpu code to fix problem..

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3032 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3031 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3030 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3028 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3021 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3020 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3019 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: Adding various new functionality and efficiency improvements to cudamatrix/, some minor changes to Matrix/.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3018 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3017 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3015 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3010 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

sandbox/dan2: cudamatrix changes including bug fixes and moving AssertEqual, ApproxEqual to headers; add different form of preconditioned update (doesn't work great, may remove).

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3008 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3007 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3006 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3005 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3001 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: Fix to bug in arpa2fst that sometimes caused wrong LMs when words contained underscores; speed up arpa2fst by using better string hasher.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3000 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2997 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2994 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@2993 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2992 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@2991 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: add resegmentation scripts with an example in egs/swbd/s5b/local/run_resegment.sh.  Minor fixes.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2990 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

Update COPYING notice to further clarify our conventions regarding copyright and multiple authors; update Apache headers to point to COPYING notice.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2988 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2987 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk/: Modify SolveQuadraticProblem and similar, to use options class instead of default arguments (more consistent with Google style); add extra option parameter; change calling code.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2983 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@2980 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8