Software

From SpeechWiki

(Difference between revisions)
Jump to: navigation, search
m (fix broken link to stft.c by Cohen,Goudeseune,H-J)
 
(78 intermediate revisions not shown)
Line 1: Line 1:
-
==Phonetic Transcription Tool==
+
===Statistical Speech Technology Group Software===
 +
Our policy: everything we write is free on the web. This wiki is intended to be definitive, because anybody in the group can edit it to add their own software. A spider-indexable backup is at http://www.isle.uiuc.edu/software .
-
This tool gives the American English phonetic transcription of any string.  It uses an HMM model to either generate a most likely phonetic transcription, or if a phonetic transcription is provided, it can perform forced alignment. So, it gives a reasonable pronounciation for out-of-dictionary words, or partially pronounced words.
+
You can access each project by browsing an SVN snapshot online, or by downloading a tgz file (gzipped .tar file) by using one of the links below.
-
[[Phonetic Transcription Tool]].  You can try out the [http://mickey.ifp.uiuc.edu/speech/webpronounce/webpronounce.cgi demo] here.
+
You can also check it out of our [http://subversion.apache.org subversion] server using login name "anon" with no password (hit "enter" when a password is requested).
 +
* On Windows, use [http://tortoisesvn.net/ TortoiseSVN].
 +
* On Linux, use <code>svn</code>.  For example, for a project listed at {{SoftwarePath}}/speechfileformats use the command
 +
svn co svn://mickey.ifp.illinois.edu/speechfileformats
 +
==Learning==
 +
;HTKtrain (Sarah Borys and Mark Hasegawa-Johnson, 2008)
 +
:[{{SoftwarePath}}/HTKtrain source], [{{SoftwarePath}}/HTKtrain.tgz tgz]
 +
:Scripts for training HMMs using HTK
 +
; Pronounce (Arthur Kantor, 2007)
 +
: [[Phonetic Transcription Tool | Description]], [http://mickey.ifp.uiuc.edu/speech/webpronounce/webpronounce.cgi Demo], [{{SoftwarePath}}/pronounce source], [{{SoftwarePath}}/pronounce.tgz tgz]
 +
: An orthographic string to phonetic string mapping tool.
 +
:This tool computes American English phonetic transcriptions from plaintext.  Its HMM either generates a most likely phonetic transcription, or forces alignment if a phonetic transcription is provided.  So, it gives a reasonable pronunciation for both out-of-dictionary words and partially pronounced words.
-
==Perl scripts for parallel processing of HTK commands==
+
;HTK-based Explicit-duration HMM (Ken Chen, 2003)
 +
:[http://www.isle.uiuc.edu/pubs/2003/chen03interspeech.pdf Description], [{{SoftwarePath}}/HDK4_release source], [{{SoftwarePath}}/HDK4_release.tgz tgz]
-
Perl scripts for parallel processing of four HTK commands (HCopy, HERest, HVite, and HResults) are available.
+
==Signal Processing==
 +
;Singing-Voice Separation From Monaural Recordings Using Robust Principal Component Analysis (Po-Sen Huang, 2012)
 +
: [https://sites.google.com/site/singingvoiceseparationrpca/ Projects Description and Demo]  [http://www.ifp.illinois.edu/~huang146/RPCA_separation/RPCA_separation_codes.zip MATLAB code]
-
1. [http://www.ifp.uiuc.edu/~bowonlee/htk-pl/HCopy.pl HCopy.pl]
+
;Nested STFTs (Dave Cohen, Camille Goudeseune, Mark Hasegawa-Johnson, 2009)
 +
:Efficient Simultaneous Multi-Scale Computation of FFTs
 +
: [http://fodava.gatech.edu/files/reports/GT-FODAVA-09-01.pdf Description], [http://zx81.isl.uiuc.edu/camilleg/gt-fodava-09-01-stft.c stft.c]  
-
2. [http://www.ifp.uiuc.edu/~bowonlee/htk-pl/HERest.pl HERest.pl]
 
-
3. [http://www.ifp.uiuc.edu/~bowonlee/htk-pl/HVite.pl HVite.pl]
+
;Improved Mistral (Qingsong Liu, 2009)
 +
:State of the Art Text-Independent Speaker Verification System,especially for NIST SRE
 +
:Based on [http://mistral.univ-avignon.fr/wiki/index.php/Main_Page Mistral Open Source package]
 +
:Improved and New Features:
 +
:* full factor analysis(eigenchannel and eigenvoice), instead of simple factor analysis(eigenchannel)
 +
:* multi-threads for Windows as well as Linux
 +
:* read HTK format feature/model
 +
:* effective Algorithm for fast implementation of FA.
 +
:* code optimization(for FA)
 +
:* fixed some bugs
 +
:Source: /ws/ifp-32-2/hasegawa/pineking/programs/Improved_Mistral
-
4. [http://www.ifp.uiuc.edu/~bowonlee/htk-pl/HResults.pl HResults.pl]
+
;PVTK (Sarah Borys and Mark Hasegawa-Johnson, 2005-8)
 +
:[{{SoftwarePath}}/PVTK source], [{{SoftwarePath}}/PVTK.tgz tgz]
 +
:Extract HTK features as training vectors for libSVM, apply trained SVMs directly to feature files
-
Those scripts use the SGE (Sun Grid Engine) for job queuing.
+
;VAD (Bowon Lee, 2007)
 +
:[http://www.isle.uiuc.edu/pubs/2007/lee07dspincars.pdf Description], [{{SoftwarePath}}/lee_vad source], [{{SoftwarePath}}/lee_vad.tgz tgz]
 +
:Voice activity detector with improved noise model
-
Written by Bowon Lee, 02/24/2006
+
==Computation==
 +
;Matlab GMM (Arthur Kantor, 2010)
 +
: [{{SoftwarePath}}/gmm source], [{{SoftwarePath}}/gmm.tgz tgz]
 +
: A somewhat optimized Matlab toolbox for calculating the likelihood of many observations against many gaussian mixtures, each with many diagonal-covariance componenents.
-
== More software written at ISLE ==
+
;GMTK Parallel (Arthur Kantor, 2008)
-
Other speech recognition and biomedical imaging tools can be found [http://www.isle.uiuc.edu/software/ here].
+
:[[GMTK parallel tools|Description]]
-
8916552730391667248774
+
:Run GMTK commands in parallel on a compute cluster.  Email [[User:Arthur|Arthur]] for code.
-
222319685521159986532182
+
 
-
<br><br><u style="display:none;"> <br><br><u style=\"display:none;\">[http://caras.jot.com/WikiHome/index.html Buy celebrex online]
+
;HTK Parallel (Bowon Lee, 2006)
-
[http://caras.jot.com/WikiHome/Buy-generic-celebrex.html Buy generic celebrex]
+
:[http://www.ifp.uiuc.edu/~bowonlee/research/cluster/HTK_parallel.htm description], [{{SoftwarePath}}/HTK_parallel source], [{{SoftwarePath}}/HTK_parallel.tgz tgz]
-
[http://caras.jot.com/WikiHome/Buy-cheap-celebrex.html Buy cheap celebrex]
+
:These Perl scripts split an HTK command for parallel excution on an [http://www.ifp.uiuc.edu/~bowonlee/research/cluster/linux_cluster.htm SGE] cluster.
-
[http://caras.jot.com/WikiHome/Buy-celebrex-drug.html Buy celebrex drug]
+
 
-
[http://homeclub.jot.com/WikiHome/index.html Buy cialis]
+
==Data==
-
[http://homeclub.jot.com/WikiHome/Buy-cialis-online.html Buy cialis online]
+
;Timeliner (Camille Goudeseune, 2012)
-
[http://homeclub.jot.com/WikiHome/Buy-cialis-uk.html Buy cialis uk]
+
:[http://zx81.isl.uiuc.edu/tmp/acmmm.pdf Description], [{{SoftwarePath}}/timeliner-2012-07-24.tgz Linux source tgz]
-
[http://homeclub.jot.com/WikiHome/Buy-cialis-generic.html Buy cialis generic]
+
:Browser for long audio files, with generated spectrograms and other derived features.
-
[http://homeclub.jot.com/WikiHome/Buy-cialis-generic-online.html Buy cialis generic online]
+
 
-
[http://homeclub.jot.com/WikiHome/Buy-tadalafil-cialis.html Buy tadalafil cialis]
+
;Matlab pfile I/O toolbox (Arthur Kantor, 2010)
-
[http://huyase.jot.com/WikiHome/index.html Buy levitra]
+
: [{{SoftwarePath}}/pfile source], [{{SoftwarePath}}/pfile.tgz tgz]
-
[http://huyase.jot.com/WikiHome/Buy-levitra-online.html Buy levitra online]
+
: A Matlab toolbox for reading and writing ICSI pfile data format used by [http://ssli.ee.washington.edu/~bilmes/gmtk/ GMTK] and [http://www.icsi.berkeley.edu/Speech/qn.html QuickNet].
-
[http://huyase.jot.com/WikiHome/Buy-levitra-vardenafil.html Buy levitra vardenafil]
+
: The toolbox is designed to work with large pfiles (hundreds of GB).
-
[http://huyase.jot.com/WikiHome/Buy-levitra-uk.html Buy levitra uk]
+
: It is based on the [http://www.ee.columbia.edu/~dpwe/muscontent/matlab/pfread.m pfread.m] and [http://www.ee.columbia.edu/~dpwe/muscontent/matlab/pfinfo.m pfinfo.m] scripts by [http://www.ee.columbia.edu/~dpwe Dan Ellis].
-
[http://huyase.jot.com/WikiHome/Buy-levitra-generic.html Buy levitra generic]
+
 
-
[http://udaff.jot.com/WikiHome/index.html Buy neurontin ]
+
;Python library for reading/writing GMTK parameter files (Arthur Kantor, 2010)
-
[http://udaff.jot.com/WikiHome/Neurontin-side-effects.html Neurontin side effects]
+
: [{{SoftwarePath}}/gmtkParam source], [{{SoftwarePath}}/gmtkParam.tgz tgz]
-
[http://udaff.jot.com/WikiHome/Neurontin-lawsuit.html Neurontin lawsuit]
+
: The library can read/write complete TrainableParameters files, as well as decision trees and most other objects allowed in GMTK parameter files.
-
[http://udaff.jot.com/WikiHome/Neurontin.html Neurontin]</u></u>
+
: This library is based on the code from [http://code.google.com/p/extended-hidden-vector-state-parser/ EHVS parser] project, and so is available under the [http://www.gnu.org/licenses/gpl-3.0.html GPL3] license.
-
<br><br><u style="display:none;">[http://mdaa.jot.com/WikiHome/index.html Paxil]
+
 
-
[http://mdaa.jot.com/WikiHome/Paxil-side-effects.html Paxil side effects]
+
;Improved MVA (Arthur Kantor, 2008)
-
[http://mdaa.jot.com/WikiHome/Paxil-cr.html Paxil cr]
+
:[http://mickey.ifp.uiuc.edu/speech/akantor/fisher/programs/bin.Linux/MVA Linux binary]
-
[http://mdaa.jot.com/WikiHome/Buy-paxil.html Buy paxil]
+
:Perform mean and variance normalization and ARMA filtering
-
[http://mdaa.jot.com/WikiHome/Paxil-withdrawal.html Paxil withdrawal]
+
:It's essentially [http://ssli.ee.washington.edu/people/chiaping/mva.html this] version but with
-
[http://mdaa.jot.com/WikiHome/Paxil-online.html Paxil online]
+
:* better error reporting (e.g. failing to open file tells you so instead of core dumping)
-
[http://mdaa.jot.com/WikiHome/Paxil-weight-gain.html Paxil weight gain]
+
:* more accurate mean and variance estimation (doubles instead of floats in strategic places)
-
[http://mdaa.jot.com/WikiHome/Paxil-withdrawal-symptom.html Paxil withdrawal symptom]</u>
+
:* faster computation in the case of MV (ARMA order 0)
-
<br><br><u style="display:none;">[http://generic-viagra-online.jot.com/WikiHome/index.html Generic viagra online]
+
:svn location is svn://mickey.ifp.uiuc.edu/corporaNormalizationScripts/fisher/MVA.cc
-
[http://generic-viagra-online.jot.com/WikiHome/Buy-generic-viagra-online.html Buy generic viagra online]
+
 
-
[http://generic-viagra-online.jot.com/WikiHome/Buy-cheap-generic-viagra-online.html Buy cheap generic viagra online]
+
;DTMFseg (Bowon Lee, 2006)
-
[http://generic-viagra-online.jot.com/WikiHome/Cheap-generic-viagra-online.html Cheap generic viagra online]
+
:[{{SoftwarePath}}/dtmfseg source], [{{SoftwarePath}}/dtmfseg.tgz tgz]
-
[http://generic-viagra-online.jot.com/WikiHome/Generic-online-pharmacy-viagra.html Generic online pharmacy viagra]
+
:Segment audio files at DTMF tones
-
[http://generic-viagra-online.jot.com/WikiHome/Generic-online-order-viagra.html Generic online order viagra]</u>
+
 
-
<br><br><u style="display:none;">[http://generic-viagra.jot.com/WikiHome/index.html Generic viagra]
+
;Transcription tools (Mark Hasegawa-Johnson, 2005)
-
[http://generic-viagra.jot.com/WikiHome/Buy-generic-viagra.html Buy generic viagra]
+
:[{{SoftwarePath}}/transcription_tools source], [{{SoftwarePath}}/transcription_tools.tgz tgz]
-
[http://generic-viagra.jot.com/WikiHome/Generic-sales-viagra.html Generic sales viagra]
+
:Convert transcription formats
-
[http://generic-viagra.jot.com/WikiHome/Cheap-generic-viagra.html Cheap generic viagra]
+
 
-
[http://generic-viagra.jot.com/WikiHome/Generic-viagra-online.html Generic viagra online]
+
;Speechfileformats (Mark Hasegawa-Johnson, 2004)
-
[http://generic-viagra.jot.com/WikiHome/Buy-generic-viagra-online.html Buy generic viagra online]
+
:[{{SoftwarePath}}/speechfileformats source], [{{SoftwarePath}}/speechfileformats.tgz tgz]
-
[http://generic-viagra.jot.com/WikiHome/Cheapest-generic-viagra.html Cheapest generic viagra]
+
:Read and write HTK files in matlab
-
[http://generic-viagra.jot.com/WikiHome/Viagra-generic-brand.html Viagra generic brand]
+
 
-
[http://generic-viagra.jot.com/WikiHome/Discount-generic-viagra.html Discount generic viagra]
+
;CTMRedit (Jul Cha and Mark Hasegawa-Johnson, 1999)
-
[http://generic-viagra.jot.com/WikiHome/Order-generic-viagra.html Order generic viagra]
+
:[http://www.isle.uiuc.edu/pubs/1990s/hasegawa-johnson99embs.pdf Description], [{{SoftwarePath}}/CTMRedit source], [{{SoftwarePath}}/CTMRedit.tgz tgz]
-
[http://generic-viagra.jot.com/WikiHome/Best-generic-viagra.html Best generic viagra]
+
:Manually and automatically segment CT and MR image stacks
-
[http://generic-viagra.jot.com/WikiHome/Cialis-generic-viagra.html Cialis generic viagra]
+
 
-
[http://generic-viagra.jot.com/WikiHome/Avoid-generic-viagra.html Avoid generic viagra]</u>
+
==LaTeX tools==
 +
 
 +
[[LaTeX]] scripts to import figures from dia and pdf. (Arthur Kantor, 2010)
 +
 
 +
==Miscellaneous==
 +
Other scripts written in perl, python, bash, and ruby can be found in [svn://mickey.ifp.uiuc.edu/scripts SVN archive].
 +
 
 +
There is also [[Scripts Documentation| auto-generated documentation]] for them.

Latest revision as of 17:19, 4 February 2015

Contents

Statistical Speech Technology Group Software

Our policy: everything we write is free on the web. This wiki is intended to be definitive, because anybody in the group can edit it to add their own software. A spider-indexable backup is at http://www.isle.uiuc.edu/software .

You can access each project by browsing an SVN snapshot online, or by downloading a tgz file (gzipped .tar file) by using one of the links below.

You can also check it out of our subversion server using login name "anon" with no password (hit "enter" when a password is requested).

svn co svn://mickey.ifp.illinois.edu/speechfileformats

Learning

HTKtrain (Sarah Borys and Mark Hasegawa-Johnson, 2008)
source, tgz
Scripts for training HMMs using HTK
Pronounce (Arthur Kantor, 2007)
Description, Demo, source, tgz
An orthographic string to phonetic string mapping tool.
This tool computes American English phonetic transcriptions from plaintext. Its HMM either generates a most likely phonetic transcription, or forces alignment if a phonetic transcription is provided. So, it gives a reasonable pronunciation for both out-of-dictionary words and partially pronounced words.
HTK-based Explicit-duration HMM (Ken Chen, 2003)
Description, source, tgz

Signal Processing

Singing-Voice Separation From Monaural Recordings Using Robust Principal Component Analysis (Po-Sen Huang, 2012)
Projects Description and Demo MATLAB code
Nested STFTs (Dave Cohen, Camille Goudeseune, Mark Hasegawa-Johnson, 2009)
Efficient Simultaneous Multi-Scale Computation of FFTs
Description, stft.c


Improved Mistral (Qingsong Liu, 2009)
State of the Art Text-Independent Speaker Verification System,especially for NIST SRE
Based on Mistral Open Source package
Improved and New Features:
  • full factor analysis(eigenchannel and eigenvoice), instead of simple factor analysis(eigenchannel)
  • multi-threads for Windows as well as Linux
  • read HTK format feature/model
  • effective Algorithm for fast implementation of FA.
  • code optimization(for FA)
  • fixed some bugs
Source: /ws/ifp-32-2/hasegawa/pineking/programs/Improved_Mistral
PVTK (Sarah Borys and Mark Hasegawa-Johnson, 2005-8)
source, tgz
Extract HTK features as training vectors for libSVM, apply trained SVMs directly to feature files
VAD (Bowon Lee, 2007)
Description, source, tgz
Voice activity detector with improved noise model

Computation

Matlab GMM (Arthur Kantor, 2010)
source, tgz
A somewhat optimized Matlab toolbox for calculating the likelihood of many observations against many gaussian mixtures, each with many diagonal-covariance componenents.
GMTK Parallel (Arthur Kantor, 2008)
Description
Run GMTK commands in parallel on a compute cluster. Email Arthur for code.
HTK Parallel (Bowon Lee, 2006)
description, source, tgz
These Perl scripts split an HTK command for parallel excution on an SGE cluster.

Data

Timeliner (Camille Goudeseune, 2012)
Description, Linux source tgz
Browser for long audio files, with generated spectrograms and other derived features.
Matlab pfile I/O toolbox (Arthur Kantor, 2010)
source, tgz
A Matlab toolbox for reading and writing ICSI pfile data format used by GMTK and QuickNet.
The toolbox is designed to work with large pfiles (hundreds of GB).
It is based on the pfread.m and pfinfo.m scripts by Dan Ellis.
Python library for reading/writing GMTK parameter files (Arthur Kantor, 2010)
source, tgz
The library can read/write complete TrainableParameters files, as well as decision trees and most other objects allowed in GMTK parameter files.
This library is based on the code from EHVS parser project, and so is available under the GPL3 license.
Improved MVA (Arthur Kantor, 2008)
Linux binary
Perform mean and variance normalization and ARMA filtering
It's essentially this version but with
  • better error reporting (e.g. failing to open file tells you so instead of core dumping)
  • more accurate mean and variance estimation (doubles instead of floats in strategic places)
  • faster computation in the case of MV (ARMA order 0)
svn location is svn://mickey.ifp.uiuc.edu/corporaNormalizationScripts/fisher/MVA.cc
DTMFseg (Bowon Lee, 2006)
source, tgz
Segment audio files at DTMF tones
Transcription tools (Mark Hasegawa-Johnson, 2005)
source, tgz
Convert transcription formats
Speechfileformats (Mark Hasegawa-Johnson, 2004)
source, tgz
Read and write HTK files in matlab
CTMRedit (Jul Cha and Mark Hasegawa-Johnson, 1999)
Description, source, tgz
Manually and automatically segment CT and MR image stacks

LaTeX tools

LaTeX scripts to import figures from dia and pdf. (Arthur Kantor, 2010)

Miscellaneous

Other scripts written in perl, python, bash, and ruby can be found in SVN archive.

There is also auto-generated documentation for them.

Personal tools