# Tutorials

**Modern Probability Theory**

*Kevin H. Knuth, Departments of Physics and Informatics, University at Albany (SUNY), Albany NY, USA*

A theory of logical inference should be all-encompassing, applying to any subject about which inferences are to be made. This includes problems ranging from the early applications of games of chance, to modern applications involving astronomy, biology, chemistry, geology, jurisprudence, physics, signal processing, sociology, and even quantum mechanics. This paper focuses on how the theory of inference has evolved in recent history: expanding in scope, solidifying its foundations, deepening its insights, and growing in calculational power.

**Biography:**Kevin H. Knuth is an Associate Professor in the Departments of Physics and Informatics at the University at Albany (SUNY). He is Editor-in-Chief of the journal Entropy, the co-founder and President of a robotics company, Autonomous Exploration Inc., and a former NASA research scientist. He has 20 years of experience in designing Bayesian and maximum entropy-based machine learning algorithms for data analysis applied to the physical sciences. His interests in the foundations of inference and inquiry has led his theoretical investigations to focus on the foundations of physics from an information-based perspective. knuthlab.rit.albany.edu/

**Basics of Information Geometry**

*Ariel Caticha, Department of Physics, University at Albany, NY 12222, USA*

A parametric family of probability distributions forms a statistical manifold, namely, a space in which each point represents a probability distribution. Generic manifolds do not come with a pre-installed notion of distance; such additional structure has to be purchased separately in the form of a metric tensor. Statistical manifolds are, however, an exception: a theorem due to N. Čencov (1981) states that up to an overall scale factor there is only one metric that takes into account the fact that these are not distances between simple structureless dots but distances between probability distributions.

**Biography: **Ariel Caticha is professor of physics at the University at Albany–SUNY. In recent years his research has focused on the connection between physics and information. One goal has been to develop an entropic inference framework that addresses the central issues—the nature of information and how it ought to be processed through Bayesian, entropic, and geometric methods—in a unified manner. The other goal has been to derive the laws of physics as examples of entropic inference. In this view the laws of physics do not directly reflect nature itself. They are not “Laws of Nature”. Instead, the laws of physics reflect our schemes for processing information about nature. Caticha’s papers on entropic inference and on its applications to the foundations of statistical mechanics, quantum mechanics, and general relativity can be found at http://www.albany.edu/physics/acaticha.shtml

**Voronoi diagrams in information geometry**

*Franck Nielsen, Ecole polytechnique, France*

This yields the Riemannian framework of statistical geometry. When selecting the Kullback-Leibler asymmetric divergence, the diagrams amount to Bregman Voronoi diagrams [2] for exponential families:

This yields the dually flat geometry of statistical geometry where we unravel the doubly dual orthogonal Voronoi/regular triangulations.

Applications to computing the Chernoff information [3] and hypothesis testing [4] are presented.

**Biography: **Frank Nielsen received his PhD thesis on adaptive computational geometry in 1996 from the university of Nice, France.

After serving in the french army in 1997, he joined the Sony Computer Science Laboratories, Japan. He became professor of computer science at Ecole Polytechnique in 2008. His research interests concentrates on computational information geometry

for imaging and learning.

**Uncertainty quantification for computer model**

*Udo V. Toussaint, Max Planck Institut, Germany*

The quantification of uncertainty for complex simulations is of increasing importance as well as a significant challenge. Bayesian and non-Bayesian probabilistic uncertainty quantification methods like polynomial chaos (PC) expansion methods or Gaussian processes have found increasing use over the recent years. This contribution describes the use of Gaussian processes and collocation methods for the propagation of uncertainty in computational models using illustrative examples as well as real-world problems. In addition the existing challenges like phase-transitions are outlined.

Bayesian and Information Geometry in signal processing

**Biography: **Udo v. Toussaint received his PhD thesis on Bayesian inference in ion-beam techniques in 2000 from the university of Bayreuth, Germany. Subsequently he worked with Peter Cheeseman at NASA Ames research center, Mountain View, CA, USA on computer vision and data fusion problems. In 2002 he joined the Max-Planck-Institut for Plasmaphysics, focussing on atomistic modelling and inverse problems. He became a lecturer at the TU Graz, Austria in 2012 and heads a research group at IPP since 2013.

**Koszul Information Geometry and Souriau Lie Group Thermodynamics**

*Frédéric Barbaresco, Thales Air Systems, Advanced Radar Concepts Business Unit, France*

**Biography: **Frédéric Barbaresco received the State Engineering degree from the French Grand École SUPELEC, Paris, France, in 1991. Since then, he began to work for THALES Group, where he is now Senior Scientist and Advanced Studies Manager in Advanced Radar Concept Department of Surface Radar Domain of THALES AIR SYSTEMS. He was awarded Aymé Poirson Prize by French Academy of Science in 2014. He is IEEE AES member. He has been an Emeritus Member of SEE since 2011 and he was awarded the Ampere Medal by SEE in 2007 and NATO SET Lecture Award in 2012 for his NATO Lecture from 2008 to 2011 in Europe and North America on Waveform Diversity and Design for Advanced Radar Systems. He has launched in 2009, the Leon Brillouin Seminar on Geometric Sciences of Information hosted by IRCAM and IHP in Paris, France. He has organized Special Sessions on Information Geometry in radar conferences: IRS’11 and IRS’13, EURAD’12. He will gave a Lecture for International Radar’’14 conference on “Modern Radar Processing based on Geometry of Structured Matrices & Information Geometry”. He is a coordinator of Springer Lecture Notes on “Matrix Information Geometry” published in 2012. He was an invited lecturer for UNESCO “Advanced School and Workshop on Matrix Geometries and Applications” in Trieste in June 2013. He is the General Chairman of the new international conference GSI “Geometric Sciences of Information: Information Geometry Manifolds and their Advanced Applications”, first edition GSI’13 at École des Mines in Paris during summer 2013. He is editor of “Geometric Science of Information” book published by SPRINGER in 2013, and one contributors of the SPRINGER book “Geometric Theory of Information” published in 2014. He is co-editor for MDPI “Entropy” journal special session on “Information, Entropy and their Geometric Structures”. His research interests mainly focus on geometric science of information for robust radar processing. He is author or coauthor of over 90 papers and an inventor of over 15 patents for THALES GROUP.