In the end is it just a matter of taste?

According to Michael Kimmelman in his Critic’s Notebook piece in the January 28, 2015 issue of The New York Times (“A Chance to Salvage A Master’s Creation”), because of dislike for its style, Orange County government officials allowed Paul Rudolph’s Orange County Government Center in Goshen, New York to fall into disrepair and the building be scheduled for partial demolition. Although architect Gene Kaufman has made an offer to buy and restore the building and also design a new government center, County Executive Steven M. Neuhas insists that the demolition will go on. It would appear that Neuhas’ decision is based on pure aesthetic dislike. Should taste be the factor which decides whether a work of art or architecture is destroyed or restored?