Im with Broosky.
If there is nobody but you depending on your income, then go for it. However, contrary to Hollywood belief system, sacrificing your family in pursuit of your dreams is a BAD THING! If you have kids, they become part of your dream.
Now, don't be stupid, plan it out. You have a MOVIE idea? Is your screenplay done? Do you have a schedule for shooting? What I'm getting at is that there are lots of NON-FILMING activities that you can do while you SAVE UP SOME CASH. That planning and preparing can take months, so start now! Keep working while saving all your money, if you pay rent, maybe get a few moths AHEAD, nothing says freedom like not having to worry about your biggest bill for a few months.. you can eat top rammen, and you could sleep in your car, but having a place to "work" on your film is pretty important. If your adventurous, you might find a CHEAP empty space for less rent than your paying now. You might have to bathe in a sink, but hey having a large EMPTY shop like space where you can build a set, etc, could be pretty cool..
Your still going to need an income. Either its savings your eating, or your working nights. Keep in mind that most OTHER people youll be working with WILL BE keeping their day jobs, so you'll have to keep your weekends open.
And finally, living in NH. This is a summer thing only. I would not want to be in the NE winter living out of my car in an unheated shop! brrrrrrrr