This causes unnecessary network traffic and momentarily blanks the
ephemeral properties of the annotation set on the client.