The very popular UPS Store at 105 Court St. in Middlebury will close on May 31, and the building in which it’s been located since 2014 has been sold.