It hasn’t been used much in recent years, but last summer, Mayor Harvey Ward and a developer began talking about plans to renovate the building.