Instead of calling the fuzzyTime filter for the $viewValue.updated in the annotation.html we're now calling this filter in the directive ctrl.$render.
This way it only recalculates the fuzzyTime filter once / annotation / clicking to the bucket.