I just logged out and back in to test this.. still get prompted for an app password. It's good to see they're rolling it out, though!