The main cause of this problem was that angular was calling this filter very frequently.
Now the annotation.reply_list is maintained that it stores the replies sorted and using the filter is no longer necessary.