there is a pareto optimality between the complexity of a theory and its explanatory power. we want to find that optimality because we want a theory to be as explanatory as possible while being as simple as possible. would be interesting to find ‘good theories’ by compressing a normalised text file containing a theory and comparing the file sizes, explanatory power by surprisal/cross entropy loss
Leave a comment