Skip to content
Snippets Groups Projects
  • Dogan Can's avatar
    0d5e4b1d
    Resolve merge conflicts and add "make ext" to travis build (#1407) · 0d5e4b1d
    Dogan Can authored
    
    * [build]: resolving OpenFst compilation issue with  gcc-6.x (#1392)
    
    * [egs] Add new graphemic system for Gale Arabic, with newer nnet scripts (#1298)
    
    * [build] Windows build: generate missing base/version.h; cosmetic changes (#1397)
    
    * [build]: Enable cross compilation, including to android. (#726)
    
    If a user has a number of tool chains installed and they do not want to
    use the default, they must currently edit the kaldi.mk file after
    running configure to change the CC, CXX, AR, AS, and RANLIB variables.
    This is something that should be exposed via the configure script. This
    patch exposes an option to set the host triple for the desired tool
    chain in the configure script.
    
    Building Kaldi on my Raspberry Pi boards is not particularly fast.  I
    have been using the following patch to build kaldi executables for use
    on the Pi boards for the better part of a year.  A typical invocation
    for me is something like:
    
    $ ./configure --static --atlas-root=/opt/cross/armv8hf \
    --fst-root=/opt/cross/armv8hf --host=armv8-rpi3-linux-gnueabihf \
    --fst-version=1.4.1
    
    This way I can build on my much faster x86 desktop, but still run
    experiments on ARM.
    
    I have included support for cross compiling for ppc64le and it works for
    me (at least it produces binaries for ppc64le I don't have a ppc64
    machine to test it).
    
    Signed-off-by: default avatarEric B Munson <eric@cobaltspeech.com>
    
    * Add mk file and configure options for building for Android
    
    Building for Android requires a toolchain that can be built using the
    Android NDK.  It works similiarly to the linux build except that it only
    uses clang, only supports the openBLAS math library, and requires an
    additional include directory for the system C++ headers.
    
    A typical configure invocation looks like:
    
    ./configure --static --openblas-root=/opt/cross/arm-linux-androideabi \
    --fst-root=/opt/cross/arm-linux-androideabi \
    --host=arm-linux-androideabi --fst-version=1.4.1 \
    --android-includes=/opt/cross/arm-linux-androideabi/sysroot/usr/include
    
    Signed-off-by: default avatarEric B Munson <eric@cobaltspeech.com>
    
    * Make pthread cancel symbols noops for Android
    
    The Android C library does not support cancelling pthreads so the
    symbols PTHREAD_CANCEL_STATE and pthread_setcancelstate are undefined.
    Because a pthread cannot be cancelled in Android, it is reasonable to
    make the pthread_setcancelstate() call a noop.
    
    Signed-off-by: default avatarEric B Munson <eric@cobaltspeech.com>
    
    * [build] fixing issue introduced in the previous win commit (#1399)
    
    * [egs] Fix to HKUST nnet2/3 scripts. (#1401)
    
    when training ubm, we should just use the 40 dimention mfcc
    so change the train directory for avoiding dimention mismatching
    this script won't get error when run after nnet2's scripts.
    
    * [egs,scripts,src] Add BABEL s5d recipe; various associated fixes (#1356)
    
    * Creating a new recipe directory
    
    * adding lists
    
    * Improvements in the pipeline, fixes, syllab search
    
    * Transplanting the diff to s5d
    
    * added TDNN, LSTM and BLSTM scripts.
    added Telugu conf files.
    
    * added blstm script and top level commands
    
    * improved keyword search, new lang  configs
    
    * removing not needed scripts
    
    * added blstm results
    
    * some keyword-search optimization binaries
    
    * removing some extra files + kwsearch pipeline improvement
    
    * adding configs for the OP3 langs
    
    * configs for the rest of the OP3 langs
    
    * Added updated configs for IndusDB.20151208.Babel.tar.bz2
    
    * fixes of the pipeline, added langp (re)estimation
    
    * adding the kaldi-native search pipeline and a bunch of changes related to this
    
    * removing extra files
    
    * A couple of fixes
    
    * KWS improvements and fixes
    
    * Fixes of a couple of issues reported by Fred Richardson <frichard@ll.mit.edu>
    
    * A separate script for lexicon expansion
    
    * A couple of fixes and tweaks. Added checks for tools, especially sox.
    
    * adding a couple of changes -- new style options and results for BP langs
    
    * adding new results(still will need to be updated)
    
    * added langp and some details tweaked
    
    * updated STT results, new KWS results and a couple of small fixes all around
    
    * adding file lists for dev languages
    
    * miniature fixes and cleanups
    
    * one more batch of small fixes -- mostly whitespace cleanup
    
    * small fixes -- location of files and removal of trailing slash inn the pathname
    
    * enabling stage-2 KWS pipeline
    
    * adding some directories to .gitignore
    
    * some quick fixes
    
    * latest fixes
    
    * making the script split_compound_set to conform to the naming
    
    * some last minute fixes for the combination scoring
    
    * do not attempt to score when the scoring data is not available
    
    * bug fixes and --ntrue-from option
    
    * another batch of fixes
    
    * adding +x permission to split_compound_set.sh
    
    * fixing whitespaces
    
    * fixing whitespaces
    
    * a couple of fixes
    
    * adding the cleanup script and chain models training
    
    * adding the graphemic/unicode lexicon feature
    
    * adding the graphemic/unicode lexicon feature
    
    * fixing the the cc files headers, adding c info
    
    * use the user-provided kwset id, not the filename
    
    * use _cleaned affix
    
    * fixes w.r.t. getting chain models independent on other systems
    
    * small fixes as reported by Fred Richardson and Yenda
    
    * another issue reported by Fred Richarson
    
    * fixing KWS for the chain systems
    
    * fixes in the KWS hitlist combination
    
    * adding 40hrs pashto config and fixes for the unicode system
    
    * fixing some bugs as reported by Ni Chongjia (I2R)
    
    * fixing some bugs as reported by Fred Richardson
    
    * adding 40hrs Pashto OP3 setup
    
    * addressing Dan's comments, some further cleanup
    
    * improving the make_index script
    
    * remove  fsts-scale
    
    * adding 'see also' to some of the fst tools
    
    * adding back accidentaly removed svn check
    
    * [egs] removing empty files in BABEL recipe (#1406)
    
    These caused a problem on MacOS, as reported by @dogancan.
    
    * Add online extension to travis build.
    
    * Fix parallel online extension build. Randomly choose between single and double precision BaseFloats in travis build.
    
    * Remove parantheses that were unintentinally added to the travis script in the previous commit.
    0d5e4b1d
    History
    Resolve merge conflicts and add "make ext" to travis build (#1407)
    Dogan Can authored
    
    * [build]: resolving OpenFst compilation issue with  gcc-6.x (#1392)
    
    * [egs] Add new graphemic system for Gale Arabic, with newer nnet scripts (#1298)
    
    * [build] Windows build: generate missing base/version.h; cosmetic changes (#1397)
    
    * [build]: Enable cross compilation, including to android. (#726)
    
    If a user has a number of tool chains installed and they do not want to
    use the default, they must currently edit the kaldi.mk file after
    running configure to change the CC, CXX, AR, AS, and RANLIB variables.
    This is something that should be exposed via the configure script. This
    patch exposes an option to set the host triple for the desired tool
    chain in the configure script.
    
    Building Kaldi on my Raspberry Pi boards is not particularly fast.  I
    have been using the following patch to build kaldi executables for use
    on the Pi boards for the better part of a year.  A typical invocation
    for me is something like:
    
    $ ./configure --static --atlas-root=/opt/cross/armv8hf \
    --fst-root=/opt/cross/armv8hf --host=armv8-rpi3-linux-gnueabihf \
    --fst-version=1.4.1
    
    This way I can build on my much faster x86 desktop, but still run
    experiments on ARM.
    
    I have included support for cross compiling for ppc64le and it works for
    me (at least it produces binaries for ppc64le I don't have a ppc64
    machine to test it).
    
    Signed-off-by: default avatarEric B Munson <eric@cobaltspeech.com>
    
    * Add mk file and configure options for building for Android
    
    Building for Android requires a toolchain that can be built using the
    Android NDK.  It works similiarly to the linux build except that it only
    uses clang, only supports the openBLAS math library, and requires an
    additional include directory for the system C++ headers.
    
    A typical configure invocation looks like:
    
    ./configure --static --openblas-root=/opt/cross/arm-linux-androideabi \
    --fst-root=/opt/cross/arm-linux-androideabi \
    --host=arm-linux-androideabi --fst-version=1.4.1 \
    --android-includes=/opt/cross/arm-linux-androideabi/sysroot/usr/include
    
    Signed-off-by: default avatarEric B Munson <eric@cobaltspeech.com>
    
    * Make pthread cancel symbols noops for Android
    
    The Android C library does not support cancelling pthreads so the
    symbols PTHREAD_CANCEL_STATE and pthread_setcancelstate are undefined.
    Because a pthread cannot be cancelled in Android, it is reasonable to
    make the pthread_setcancelstate() call a noop.
    
    Signed-off-by: default avatarEric B Munson <eric@cobaltspeech.com>
    
    * [build] fixing issue introduced in the previous win commit (#1399)
    
    * [egs] Fix to HKUST nnet2/3 scripts. (#1401)
    
    when training ubm, we should just use the 40 dimention mfcc
    so change the train directory for avoiding dimention mismatching
    this script won't get error when run after nnet2's scripts.
    
    * [egs,scripts,src] Add BABEL s5d recipe; various associated fixes (#1356)
    
    * Creating a new recipe directory
    
    * adding lists
    
    * Improvements in the pipeline, fixes, syllab search
    
    * Transplanting the diff to s5d
    
    * added TDNN, LSTM and BLSTM scripts.
    added Telugu conf files.
    
    * added blstm script and top level commands
    
    * improved keyword search, new lang  configs
    
    * removing not needed scripts
    
    * added blstm results
    
    * some keyword-search optimization binaries
    
    * removing some extra files + kwsearch pipeline improvement
    
    * adding configs for the OP3 langs
    
    * configs for the rest of the OP3 langs
    
    * Added updated configs for IndusDB.20151208.Babel.tar.bz2
    
    * fixes of the pipeline, added langp (re)estimation
    
    * adding the kaldi-native search pipeline and a bunch of changes related to this
    
    * removing extra files
    
    * A couple of fixes
    
    * KWS improvements and fixes
    
    * Fixes of a couple of issues reported by Fred Richardson <frichard@ll.mit.edu>
    
    * A separate script for lexicon expansion
    
    * A couple of fixes and tweaks. Added checks for tools, especially sox.
    
    * adding a couple of changes -- new style options and results for BP langs
    
    * adding new results(still will need to be updated)
    
    * added langp and some details tweaked
    
    * updated STT results, new KWS results and a couple of small fixes all around
    
    * adding file lists for dev languages
    
    * miniature fixes and cleanups
    
    * one more batch of small fixes -- mostly whitespace cleanup
    
    * small fixes -- location of files and removal of trailing slash inn the pathname
    
    * enabling stage-2 KWS pipeline
    
    * adding some directories to .gitignore
    
    * some quick fixes
    
    * latest fixes
    
    * making the script split_compound_set to conform to the naming
    
    * some last minute fixes for the combination scoring
    
    * do not attempt to score when the scoring data is not available
    
    * bug fixes and --ntrue-from option
    
    * another batch of fixes
    
    * adding +x permission to split_compound_set.sh
    
    * fixing whitespaces
    
    * fixing whitespaces
    
    * a couple of fixes
    
    * adding the cleanup script and chain models training
    
    * adding the graphemic/unicode lexicon feature
    
    * adding the graphemic/unicode lexicon feature
    
    * fixing the the cc files headers, adding c info
    
    * use the user-provided kwset id, not the filename
    
    * use _cleaned affix
    
    * fixes w.r.t. getting chain models independent on other systems
    
    * small fixes as reported by Fred Richardson and Yenda
    
    * another issue reported by Fred Richarson
    
    * fixing KWS for the chain systems
    
    * fixes in the KWS hitlist combination
    
    * adding 40hrs pashto config and fixes for the unicode system
    
    * fixing some bugs as reported by Ni Chongjia (I2R)
    
    * fixing some bugs as reported by Fred Richardson
    
    * adding 40hrs Pashto OP3 setup
    
    * addressing Dan's comments, some further cleanup
    
    * improving the make_index script
    
    * remove  fsts-scale
    
    * adding 'see also' to some of the fst tools
    
    * adding back accidentaly removed svn check
    
    * [egs] removing empty files in BABEL recipe (#1406)
    
    These caused a problem on MacOS, as reported by @dogancan.
    
    * Add online extension to travis build.
    
    * Fix parallel online extension build. Randomly choose between single and double precision BaseFloats in travis build.
    
    * Remove parantheses that were unintentinally added to the travis script in the previous commit.