Information theoretical methods for complex network structure reconstruction
1 Computational Genomics Department, National Institute of Genomic Medicine, Mexico City, México
2 Complexity in Systems Biology, Center for Complexity Sciences, National Autonomous University of México, Mexico City, Mexico
3 Ethics, Legal and Social Studies Department, National Institute Genomic Medicine, Mexico City, México
Complex Adaptive Systems Modeling 2013, 1:8 doi:10.1186/2194-3206-1-8Published: 8 April 2013
Complex networks seem to be ubiquitous objects in contemporary research, both in the natural and social sciences. An important area of research regarding the applicability and modeling of graph- theoretical-oriented approaches to complex systems, is the probabilistic inference of such networks. There exist different methods and algorithms designed for this purpose, most of them are inspired in statistical mechanics and rely on information theoretical grounds. An important shortcoming for most of these methods, when it comes to disentangle the actual structure of complex networks, is that they fail to distinguish between direct and indirect interactions. Here, we suggest a method to discover and assess for such indirect interactions within the framework of information theory.
Information-theoretical measures (in particular, Mutual Information) are applied for the probabilistic inference of complex networks. Data Processing Inequality is used to find and assess for direct and indirect interactions impact in complex networks.
We outline the mathematical basis of information-theoretical assessment of complex network structure and discuss some examples of application in the fields of biological systems and social networks.
Information theory provides to the field of complex networks analysis with effective means for structural assessment with a computational burden low enough to be useful in both, Biological and Social network analysis.