I grew up in Vermont and now live in central New York state. I've started looking for a house out here and I check the Vermont real estate market occasionally to see what prices are. It's ridiculous and will only get more so unless more housing gets built.

So yes, Vermont needs to grow. Or else the population will drop as no one will be able to afford to live there.