While staying focused in a startup is important, it's nice to have freedom to explore new ideas and thought processes outside of the core product.

I've seen plenty of startups hyper-focus on one product and fail because they couldn't position their product in the marketplace properly (seeing the forrest-through-the-trees).