I'm sure if borgbackup can pull this off, Signal can, too?

The solution is to split up your data into encrypted chunks, and only upload the new ones.