> It can be a bit awkward to unfollow people you know

Mute them. It works well, and if they are engaged with others you follow it is all there, uncensored. So it isn't as harsh as a block, and they generally don't know about you putting it in place because you can still interact when your friends do, or when you choose.