We could not, for example, arrive at a principle like that of entropy without introducing some additional principle, such as randomness, to this topography. – Michael Polanyi
Entropy theory, on the other hand, is not concerned with the probability of succession in a series of items but with the overall distribution of kinds of items in a given arrangement. – Rudolf Arnheim