{"id":79,"date":"2015-08-17T22:34:52","date_gmt":"2015-08-17T22:34:52","guid":{"rendered":"http:\/\/grupo.us.es\/gapsc\/?page_id=79"},"modified":"2019-10-29T07:38:55","modified_gmt":"2019-10-29T07:38:55","slug":"gaussian-processes-in-digital-communications","status":"publish","type":"page","link":"https:\/\/grupo.us.es\/gapsc\/gaussian-processes-in-digital-communications\/","title":{"rendered":"Gaussian Processes and Kernel Methods"},"content":{"rendered":"<h2>Overview<\/h2>\n<p>Gaussian processes are non-parametric kernel based Bayesian tools to perform inference. Non-parametric kernel solutions are based on providing a new solution for some new input by using the set of training data. This set is included in the so-called kernel matrix.<\/p>\n<p>Gaussian processes for regression (GPR) are useful tool to perform prediction or even detection. It exhibits three\u00a0major advantages. First, the formulation is analytic and so it is its solution. This solution can be cast as a &#8220;non-linear&#8221; version of the linear minimum mean square error (MMSE) estimator with extra regularization term. Second, the hyper-parameter learning can be performed in a principled way, rather than using cross-validation. Third, it does not only provides a predicted or estimated value, but a probabilistic information on it. Its counterpart for classification, GP for classification (GPC), exhibits the same features but that of being analytic.<\/p>\n<p>Since MMSE has been a quite extended tool in digital communications, we forecasted that GPR and GPC\u00a0would be\u00a0useful there were the linear MMSE failed. Both, in the inversion of linear and non-linear systems. We proved its good features in the multiuser detection and channel equalization. Furthermore, we exploited its output being probabilistic to feed them to modern channel decoders, quite improving the overall performance.<\/p>\n<p>In some other applications we found it a competitive tool. As in the prediction of tax incomes in Brazil, where we collaborated with the University of Brazilia.<\/p>\n<p>Lately, and given the interest to develop non-parametric tools for complex-valued signals, we are working on the formulation of GPR for both, proper and non-proper complex signals. With application, among others, to channel equalization.<\/p>\n<h2>Involved Members<\/h2>\n<p>Juan J. Murillo-Fuentes,\u00a0Fernando P\u00e9rez-Cruz, Rafael Boloix-Tortosa, Pablo M. Olmos, Javier Pay\u00e1n-Somet, Eva Arias de Reyna.<\/p>\n<h2>Publications<\/h2>\n<h3 class=\"p1\">Journals<\/h3>\n<ol>\n<li>R. Boloix-Tortosa, J.J. Murillo-Fuentes S.A. Tsaftaris. (2019). &#8220;The Generalized Complex Kernel Least-Mean-Square Algorithm&#8221; <em>IEEE Transactions on Signal Processing<\/em>, Vol. 67, no. 20, pp. 5213 &#8211; 5222. Oct.15, 2019. DOI <a href=\"https:\/\/doi.org\/10.1109\/TSP.2019.2937289\">10.1109\/TSP.2019.2937289<\/a>, <a href=\"https:\/\/arxiv.org\/abs\/1902.08692\">https:\/\/arxiv.org\/abs\/1902.08692<\/a><\/li>\n<li>Santos, J.J. Murillo-Fuentes, P. M. Djuric. (2019). Recursive Estimation of Dynamic RSS Fields Based on Crowdsourcing and Gaussian Processes. <em>IEEE Transactions on Signal Processing.<\/em> 2019. EEE (2017) Q1, 32\/260. DOI <a href=\"https:\/\/doi.org\/10.1109\/TSP.2018.2889987\">10.1109\/TSP.2018.2889987<\/a>, <a href=\"https:\/\/arxiv.org\/abs\/1806.02530\">https:\/\/arxiv.org\/abs\/1806.02530<\/a>.<\/li>\n<li><span style=\"font-size: 1rem;\">R. Boloix-Tortosa, J. J. Murillo-Fuentes, F. J. Pay\u00e1n-Somet and F. P\u00e9rez-Cruz, &#8220;Complex Gaussian Processes for Regression,&#8221; in\u00a0<\/span><em style=\"font-size: 1rem;\">IEEE Transactions on Neural Networks and Learning Systems<\/em><span style=\"font-size: 1rem;\">, vol. 29, no. 11, pp. 5499-5511, Nov. 2018.\u00a0DOI:\u00a0<\/span><a style=\"font-size: 1rem;\" href=\"https:\/\/doi.org\/10.1109\/TNNLS.2018.2805019\">10.1109\/TNNLS.2018.2805019<\/a> <a style=\"font-size: 1rem;\" href=\"https:\/\/arxiv.org\/abs\/1511.05710\">https:\/\/arxiv.org\/abs\/1511.05710<\/a><\/li>\n<li>R. Boloix-Tortosa, J. J. Murillo-Fuentes, I. Santos and F. P\u00e9rez-Cruz, (2017) &#8220;Widely Linear Complex-Valued Kernel Methods for Regression,&#8221; in <em>IEEE Transactions on Signal Processing<\/em>, vol. 65, no. 19, pp. 5240-5248, Oct.1, 1 2017. <a href=\"http:\/\/personal.us.es\/murillo\/papers\/IEEETSPCKRHS17.PDF\" target=\"_blank\" rel=\"noopener\">Paper<\/a>, also in <a href=\"http:\/\/ieeexplore.ieee.org\/document\/7979572\/\" target=\"_blank\" rel=\"noopener\">IEEE TSP<\/a>,\u00a0<a href=\"https:\/\/arxiv.org\/abs\/1610.09915?context=stat\" target=\"_blank\" rel=\"noopener\">arxiv.org<\/a><\/li>\n<li>F. P\u00e9rez-Cruz, S. Van Vaerenbergh, J. J. Murillo-Fuentes, M. L\u00e1zaro-Gredilla and I. Santamar\u00eda.\u00a0<a href=\"http:\/\/arxiv.org\/abs\/1303.2823\">&#8221;Gaussian Processes for Nonlinear Signal Processing&#8221;<\/a>. <i>IEEE Signal Processing Magazine<\/i>. Vol.30, no.4. 2013.<\/li>\n<li>P. M. Olmos, J. J. Murillo-Fuentes and F. P\u00e9rez-Cruz, (2010). <a href=\"http:\/\/personal.us.es\/murillo\/papers\/equalizationGPC_IEEETSP2009.pdf\">&#8221;Joint Nonlinear Channel Equalization and Soft LDPC Decoding with\u00a0Gaussian Processes&#8221;<\/a>. <i>IEEE Transactions on Signal Processing<\/i>, Vol. 58, N. 3, pp. 1183 &#8211; 1192, March 2010.<\/li>\n<li>J. J. Murillo-Fuentes and F. P\u00e9rez-Cruz, (2009). <a href=\"http:\/\/personal.us.es\/murillo\/papers\/cdmaGP_IEEETCOM09Murillo.pdf\">&#8221;Gaussian Process Regressors for Multiuser Detection in DS-CDMA\u00a0Systems&#8221;. <\/a><i>IEEE Transactions on Communications<\/i>,<br \/>\n57(8):2339-2347, August 2009.<\/li>\n<li>F. P\u00e9rez-Cruz, J. J. Murillo-Fuentes and S. Caro, (2008). <a href=\"http:\/\/personal.us.es\/murillo\/equalizationGPC_IEEETSP2008Cruz.pdf\">&#8221;Nonlinear Channel Equalization with Gaussian Processes for\u00a0Regression&#8221;<\/a>.<i> IEEE Transactions on Signal Processing<\/i>, 56(10-2):5283-5286, October 2008.<\/li>\n<li>F. P\u00e9rez-Cruz and J. J. Murillo-Fuentes, (2008). &#8221;Digital Communication Receivers Using Gaussian Processes for\u00a0Machine Learning&#8221;. <i>Journal on Advances in Signal Processing<\/i>. Vol 2008. doi:10.1155\/2008\/491503.<\/li>\n<\/ol>\n<h3 class=\"p2\">Book Chapters<\/h3>\n<ul class=\"ul1\">\n<li class=\"li1\">P. M. Olmos, J. J. Murillo-Fuentes and F. P\u00e9rez-Cruz, (2010). <a href=\"http:\/\/www.intechopen.com\/books\/application-of-machine-learning\/gaussian-processes-and-its-application-to-the-design-of-digital-communication-receivers\">&#8221;Gaussian Processes and its Application to the design of Digital Communication Receivers&#8221;<\/a>. <i>In Machine Learning<\/i>, Chapter 11. In-Tech, ISBN 978-953-307-035-3, DOI: 10.5772\/8617. 2010.<\/li>\n<\/ul>\n<h3 class=\"p2\">Conferences<\/h3>\n<ol>\n<li>Havasi, J.M. Hern\u00e1ndez-Lobato, J.J. Murillo-Fuentes \u201cInference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo\u201c Neural Information and Processing Systems (<strong>NeurIPS<\/strong>), 2018.<\/li>\n<li>I. Santos, P. Djuric, \u201cCrowdsource-based signal strength field estimation by Gaussian Processes\u201d. Proc of 25th European Signal Processing Conference (EUSIPCO). Kos (Greece). 2017<\/li>\n<li>I. Santos Vel\u00e1zquez, J.J. Murillo-Fuentes, P.M. Djuric, (2017) \u201cRecursive Estimation of Time-Varying RSS Fields Based on Crowdsourcing and Gaussian Processes\u201d. IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP) 2017.<\/li>\n<li>R. Boloix-Tortosa, F. J. Pay\u00e1n-Somet, E. Arias-de-Reyna and J. J. Murillo-Fuentes, (2015) &#8220;Complex kernels for proper complex-valued signals: A review,&#8221;\u00a0<em>23rd European Signal Processing Conference (EUSIPCO)<\/em>, Nice, 2015, pp. 2371-2375. <a href=\"http:\/\/ieeexplore.ieee.org\/document\/7362809\/\">ieeexplore<\/a><\/li>\n<li><span style=\"font-size: 1rem;\">R. Boloix-Tortosa, F.J. Pay\u00e1n-Somet, J.J. Murillo-Fuentes (2014). <\/span><a style=\"font-size: 1rem;\" href=\"http:\/\/personal.us.es\/murillo\/papers\/SAM14v4web.pdf\">&#8221;Gaussian processes regressors for complex proper signals in digital communications&#8221;.<\/a><i style=\"font-size: 1rem;\"> IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM),<span class=\"Apple-converted-space\">\u00a0 <\/span>pp. 137-140, 22-25 June 2014.<\/i><\/li>\n<li>Pablo M. Olmos, Juan Jos\u00e9 Murillo-Fuentes and Fernando P\u00e9rez-Cruz (2009).<a href=\"http:\/\/personal.us.es\/murillo\/papers\/eusipco2009.pdf\">&#8221;Soft LDPC decoding in nonlinear channels with Gaussian processes for classification&#8221;.<\/a><i> European Signal Processing Conference (EUSIPCO)<\/i>. Pp. 1641-1645. Glasgow, UK. 24-28 Aug 2009.<\/li>\n<li>Sebasti\u00e1n Caro, Juan Jos\u00e9 Murillo-Fuentes, Fernando P\u00e9rez-Cruz (2006). <a href=\"http:\/\/personal.us.es\/murillo\/papers\/eusipco2006.pdf\">&#8221;Gaussian Processes for Regression In Channel Equalization&#8221;. <\/a><i>European Signal Processing Conference (EUSIPCO)<\/i>. Florence, Italy. 4-8 Sep 2006.<\/li>\n<li>Fernando P\u00e9rez-Cruz, Juan Jos\u00e9 Murillo-Fuentes (2006) <a href=\"https:\/\/grupo.us.es\/gapsc\/papers\/eusipco2006.pdf\">&#8221;Gaussian Processes for Digital Communications&#8221;.<\/a> <i>In Proc of the IEEE Int. Conf.\u00a0on Acoustics, Speech and Signal Processing (ICASSP)<\/i>, Vol V. PP 781-784. ISSN: 1520-6149. ISBN: 1-4244-0469-X. Toulouse (France), 14-19 May\u00a02006.<\/li>\n<li>Fernando P\u00e9rez-Cruz, Sebasti\u00e1n Caro, Juan Jos\u00e9 Murillo-Fuentes (2005). <a href=\"https:\/\/papers.nips.cc\/paper\/2791-gaussian-processes-for-multiuser-detection-in-cdma-receivers.pdf\">&#8221;Gaussian Processes for Multiuser Detection in CDMA receivers&#8221;<\/a>.<i> Advances in Neural Information Processing Systems 18 (NIPS).<\/i> Editores Y. Weiss, B. Sch\u00f6lkopf and J. Platt. MIT Press (Cambridge, MA). Pp. 939-946, Vancouver (Canada), 6-9 Dec 2005.<\/li>\n<\/ol>\n<hr \/>\n<hr \/>\n<p><b><strong>Acknowledgements<\/strong><\/b><\/p>\n<p>These results were possible thanks to public fundings. The Universidad de Sevilla\u00a0trusted us\u00a0to carry out this research. The Spanish Government and the European Union (FEDER) also founded this research through\u00a0the projects MEC.CICYT.TIC 2003-03781, TEC2006-13514-C02-2\/TCM, CONSOLIDER CSD2008-00010 and TEC2012-38800-C03-C02. This work was also possible thanks to the fruitful\u00a0collaboration with prof. Fernando P\u00e9rez-Cruz, from Universidad Carlos III de Madrid, member of the group.<\/p>\n<p><a href=\"http:\/\/personal.us.es\/murillo\/wp-content\/uploads\/2015\/08\/US-e1439833635430.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-68 size-full\" src=\"https:\/\/grupo.us.es\/gapsc\/wp-content\/uploads\/2015\/08\/US-e1439833635430.jpg\" alt=\"US\" width=\"70\" height=\"64\" \/><\/a><a href=\"https:\/\/grupo.us.es\/gapsc\/wp-content\/uploads\/2015\/08\/feder.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-65 size-medium\" src=\"https:\/\/grupo.us.es\/gapsc\/wp-content\/uploads\/2015\/08\/feder-300x62.jpg\" alt=\"feder\" width=\"300\" height=\"62\" srcset=\"https:\/\/grupo.us.es\/gapsc\/wp-content\/uploads\/2015\/08\/feder-300x62.jpg 300w, https:\/\/grupo.us.es\/gapsc\/wp-content\/uploads\/2015\/08\/feder.jpg 524w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p><b><strong>Copyright Notice<\/strong><\/b><\/p>\n<p>The material above is presented here to ensure dissemination of scholar and technical work by the author. Copyright and all rights are retained by authors and\u00a0other copyright holders. Accordingly, all persons using this material are expected to adhere to the terms and\u00a0constraints invoked by each holder&#8217;s copyright. Notice that, in most cases, these works may not be reposted without the explicit\u00a0permission of the copyright holder.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Overview Gaussian processes are non-parametric kernel based Bayesian tools to perform inference. Non-parametric kernel solutions are based on providing a&hellip;<\/p>\n","protected":false},"author":1,"featured_media":49,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-79","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/pages\/79","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/comments?post=79"}],"version-history":[{"count":0,"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/pages\/79\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/media\/49"}],"wp:attachment":[{"href":"https:\/\/grupo.us.es\/gapsc\/wp-json\/wp\/v2\/media?parent=79"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}