Quadratic Weighted Automata:Spectral Algorithm and Likelihood Maximization

Raphael Bailly
Proceedings of the Asian Conference on Machine Learning, PMLR 20:147-163, 2011.

Abstract

In this paper, we address the problem of non-parametric density estimation on a set of strings $\Sigma^*$. We introduce a probabilistic model - called quadratic weighted automaton, or QWA - and we present some methods which can be used in a density estimation task. A spectral analysis method leads to an effective regularization and a consistent estimate of the parameters. We provide a set of theoretical results on the convergence of this method. Experiments show that the combination of this method with likelihood maximization may be an interesting alternative to the well-known Baum-Welch algorithm.

Cite this Paper


BibTeX
@InProceedings{pmlr-v20-bailly11, title = {Quadratic Weighted Automata:Spectral Algorithm and Likelihood Maximization}, author = {Bailly, Raphael}, booktitle = {Proceedings of the Asian Conference on Machine Learning}, pages = {147--163}, year = {2011}, editor = {Hsu, Chun-Nan and Lee, Wee Sun}, volume = {20}, series = {Proceedings of Machine Learning Research}, address = {South Garden Hotels and Resorts, Taoyuan, Taiwain}, month = {14--15 Nov}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v20/bailly11/bailly11.pdf}, url = {https://proceedings.mlr.press/v20/bailly11.html}, abstract = {In this paper, we address the problem of non-parametric density estimation on a set of strings $\Sigma^*$. We introduce a probabilistic model - called quadratic weighted automaton, or QWA - and we present some methods which can be used in a density estimation task. A spectral analysis method leads to an effective regularization and a consistent estimate of the parameters. We provide a set of theoretical results on the convergence of this method. Experiments show that the combination of this method with likelihood maximization may be an interesting alternative to the well-known Baum-Welch algorithm.} }
Endnote
%0 Conference Paper %T Quadratic Weighted Automata:Spectral Algorithm and Likelihood Maximization %A Raphael Bailly %B Proceedings of the Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2011 %E Chun-Nan Hsu %E Wee Sun Lee %F pmlr-v20-bailly11 %I PMLR %P 147--163 %U https://proceedings.mlr.press/v20/bailly11.html %V 20 %X In this paper, we address the problem of non-parametric density estimation on a set of strings $\Sigma^*$. We introduce a probabilistic model - called quadratic weighted automaton, or QWA - and we present some methods which can be used in a density estimation task. A spectral analysis method leads to an effective regularization and a consistent estimate of the parameters. We provide a set of theoretical results on the convergence of this method. Experiments show that the combination of this method with likelihood maximization may be an interesting alternative to the well-known Baum-Welch algorithm.
RIS
TY - CPAPER TI - Quadratic Weighted Automata:Spectral Algorithm and Likelihood Maximization AU - Raphael Bailly BT - Proceedings of the Asian Conference on Machine Learning DA - 2011/11/17 ED - Chun-Nan Hsu ED - Wee Sun Lee ID - pmlr-v20-bailly11 PB - PMLR DP - Proceedings of Machine Learning Research VL - 20 SP - 147 EP - 163 L1 - http://proceedings.mlr.press/v20/bailly11/bailly11.pdf UR - https://proceedings.mlr.press/v20/bailly11.html AB - In this paper, we address the problem of non-parametric density estimation on a set of strings $\Sigma^*$. We introduce a probabilistic model - called quadratic weighted automaton, or QWA - and we present some methods which can be used in a density estimation task. A spectral analysis method leads to an effective regularization and a consistent estimate of the parameters. We provide a set of theoretical results on the convergence of this method. Experiments show that the combination of this method with likelihood maximization may be an interesting alternative to the well-known Baum-Welch algorithm. ER -
APA
Bailly, R.. (2011). Quadratic Weighted Automata:Spectral Algorithm and Likelihood Maximization. Proceedings of the Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 20:147-163 Available from https://proceedings.mlr.press/v20/bailly11.html.

Related Material