Why would anyone follow their coworkers? I follow people whose opinions I want, and I 'friend' my friends - a few coworkers included, but not 95% of people that I meet in the office daily.
I hold roughly the same opinion and generally try to avoid social networks. But I've certainly worked in places where everyone followed everyone else and it would probably be seen as rude not to.
