* [build]: resolving OpenFst compilation issue with  gcc-6.x (#1392)

* [egs] Add new graphemic system for Gale Arabic, with newer nnet scripts (#1298)

* [build] Windows build: generate missing base/version.h; cosmetic changes (#1397)

* [build]: Enable cross compilation, including to android. (#726)

If a user has a number of tool chains installed and they do not want to
use the default, they must currently edit the kaldi.mk file after
running configure to change the CC, CXX, AR, AS, and RANLIB variables.
This is something that should be exposed via the configure script. This
patch exposes an option to set the host triple for the desired tool
chain in the configure script.

Building Kaldi on my Raspberry Pi boards is not particularly fast.  I
have been using the following patch to build kaldi executables for use
on the Pi boards for the better part of a year.  A typical invocation
for me is something like:

$ ./configure --static --atlas-root=/opt/cross/armv8hf \
--fst-root=/opt/cross/armv8hf --host=armv8-rpi3-linux-gnueabihf \
--fst-version=1.4.1

This way I can build on my much faster x86 desktop, but still run
experiments on ARM.

I have included support for cross compiling for ppc64le and it works for
me (at least it produces binaries for ppc64le I don't have a ppc64
machine to test it).

Signed-off-by: Eric B Munson <eric@cobaltspeech.com>

* Add mk file and configure options for building for Android

Building for Android requires a toolchain that can be built using the
Android NDK.  It works similiarly to the linux build except that it only
uses clang, only supports the openBLAS math library, and requires an
additional include directory for the system C++ headers.

A typical configure invocation looks like:

./configure --static --openblas-root=/opt/cross/arm-linux-androideabi \
--fst-root=/opt/cross/arm-linux-androideabi \
--host=arm-linux-androideabi --fst-version=1.4.1 \
--android-includes=/opt/cross/arm-linux-androideabi/sysroot/usr/include

Signed-off-by: Eric B Munson <eric@cobaltspeech.com>

* Make pthread cancel symbols noops for Android

The Android C library does not support cancelling pthreads so the
symbols PTHREAD_CANCEL_STATE and pthread_setcancelstate are undefined.
Because a pthread cannot be cancelled in Android, it is reasonable to
make the pthread_setcancelstate() call a noop.

Signed-off-by: Eric B Munson <eric@cobaltspeech.com>

* [build] fixing issue introduced in the previous win commit (#1399)

* [egs] Fix to HKUST nnet2/3 scripts. (#1401)

when training ubm, we should just use the 40 dimention mfcc
so change the train directory for avoiding dimention mismatching
this script won't get error when run after nnet2's scripts.

* [egs,scripts,src] Add BABEL s5d recipe; various associated fixes (#1356)

* Creating a new recipe directory

* adding lists

* Improvements in the pipeline, fixes, syllab search

* Transplanting the diff to s5d

* added TDNN, LSTM and BLSTM scripts.
added Telugu conf files.

* added blstm script and top level commands

* improved keyword search, new lang  configs

* removing not needed scripts

* added blstm results

* some keyword-search optimization binaries

* removing some extra files + kwsearch pipeline improvement

* adding configs for the OP3 langs

* configs for the rest of the OP3 langs

* Added updated configs for IndusDB.20151208.Babel.tar.bz2

* fixes of the pipeline, added langp (re)estimation

* adding the kaldi-native search pipeline and a bunch of changes related to this

* removing extra files

* A couple of fixes

* KWS improvements and fixes

* Fixes of a couple of issues reported by Fred Richardson <frichard@ll.mit.edu>

* A separate script for lexicon expansion

* A couple of fixes and tweaks. Added checks for tools, especially sox.

* adding a couple of changes -- new style options and results for BP langs

* adding new results(still will need to be updated)

* added langp and some details tweaked

* updated STT results, new KWS results and a couple of small fixes all around

* adding file lists for dev languages

* miniature fixes and cleanups

* one more batch of small fixes -- mostly whitespace cleanup

* small fixes -- location of files and removal of trailing slash inn the pathname

* enabling stage-2 KWS pipeline

* adding some directories to .gitignore

* some quick fixes

* latest fixes

* making the script split_compound_set to conform to the naming

* some last minute fixes for the combination scoring

* do not attempt to score when the scoring data is not available

* bug fixes and --ntrue-from option

* another batch of fixes

* adding +x permission to split_compound_set.sh

* fixing whitespaces

* fixing whitespaces

* a couple of fixes

* adding the cleanup script and chain models training

* adding the graphemic/unicode lexicon feature

* adding the graphemic/unicode lexicon feature

* fixing the the cc files headers, adding c info

* use the user-provided kwset id, not the filename

* use _cleaned affix

* fixes w.r.t. getting chain models independent on other systems

* small fixes as reported by Fred Richardson and Yenda

* another issue reported by Fred Richarson

* fixing KWS for the chain systems

* fixes in the KWS hitlist combination

* adding 40hrs pashto config and fixes for the unicode system

* fixing some bugs as reported by Ni Chongjia (I2R)

* fixing some bugs as reported by Fred Richardson

* adding 40hrs Pashto OP3 setup

* addressing Dan's comments, some further cleanup

* improving the make_index script

* remove  fsts-scale

* adding 'see also' to some of the fst tools

* adding back accidentaly removed svn check

* [egs] removing empty files in BABEL recipe (#1406)

These caused a problem on MacOS, as reported by @dogancan.

* Add online extension to travis build.

* Fix parallel online extension build. Randomly choose between single and double precision BaseFloats in travis build.

* Remove parantheses that were unintentinally added to the travis script in the previous commit.

OpenFst-1.5.3 adds support for minimization of non-deterministic FSTs
over idempotent semirings which is a feature used throughout Kaldi.
Along with the requirement for a C++ compiler with C++11 support, we
are also removing support for older OpenFst releases so that we can
build against an un-patched OpenFst installation.

* print cmdline of the last configure call

Add script to automatically put the Kaldi libraries we link with in the right order; use it to modify the Makefiles.  Minor top-level Makefile fix.

- added <HiddenSoftmax> which bacpropagates using the Jacobian
  of Softmax, so it can be placed inside the DNN,
- added backpropagation function of <Splice> (to be used with
  per-utterance training,

Added code-level support for the ',bg' option on sequential table readers, causing them to read the data in a background thread.  Helps speed up GPU-based nnet training, for instance.

master: merging most code changes from chain branch (but not the actual chain code)-- want to keep shared parts of the code the same.

chain branch: code cleanup, removing unneeded code and options (note: not consistent right now as the --pdf-boudnary-penalty option has yet to be removed from the scripts.  removing ctc code

chain branch: update language-modeling code to prune in a more optimal way (involves rewrite and change in options).  plus various misc. fixes

chain branch: Add randomized thresholding to beta computation for efficiency; changes for efficiency in the NormalizeComponent.

other bug-fixes

ctc: various reorganizations and fixes; adding some test code for nnet-ctc supervision (unfinished); adding some documentation

(trunk) Create a separate kws library. If you are using lat/kaldi-kws.h, change it to kws/kaldi-kws.h.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@5176 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: http://svn.code.sf.net/p/kaldi/code@5057 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4927 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4926 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4718 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4700 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4697 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: merging sandbox/dan back to trunk.  Includes addition of recipe for the LibriSpeech corpus, and the capability to rescore lattices using ARPA language models that are too big to convert into FSTs.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4504 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: changes to feature extraction classes so Compute can be done using a const method (more friendly to multithreaded code).

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4128 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

trunk: cosmetic fix - compatiable issue of autoconf version prior 2.62 => AC_PREREQ([2.62]) is defined in aclocal.m4 in tools/openfst-1.3.4.tar.gz 

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@4126 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8

git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3963 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8