Buttonwood are notorious for decline and death in Northern states where they have to spend winters indoors where light and humidity are minimal. They require extreme heat and humidity, as in Florida coastal full sun heat, light and humidity. Unless you have a hothouse you can keep them in for the winter (And most of the spring), and you live further North than Florida, you've going to have issues. Temps lower than 50 are a problem.