Good one: Ralf Der and colleagues proposed homeokinesis as such a principle in 1999. That turned out not to be enough, because the agent would then have an incentive to move into a corner and just hide. That renders the world very predictable, but clearly not a good strategy on the long run.

So, they generalized the method to find a predictable future, but in very unstable states. Later, Der and Ay generalized this towards maximization of predictive information - for that, it is not sufficient to predict to environment, but there also must be something nontrivial to predict. This gives rise to a number of highly interesting behaviours in many of their scenarios.

So, yes, your idea is a good one...