I was avoiding expanding buckets beyond the bounds of their annotations' locations by preventing merging with empty buckets. However, empty buckets should totally merge with empty buckets.