The book is an overview of the development of basic ideas and mathematical results regarding measures and principles of uncertainty-based information formalized within the framework of classical set theory, probability theory, fuzzy set theory, possibility theory, and the Dempster-Shafer theory of evidence. The book contains many new results, which had until now not been available in a single monograph. The book is very useful for researchers, but it can also be used as a graduate text.