As Hurdity says, it depends on where you live and what type of winter you get. I used to live in Wiltshire until earlier this year - I was out in the country and my garden was very exposed - any geraniums left outside had died by the end of October. But in the village 2 miles down the road, they would keep flowering in sheltered spots until December and sometimes survived for another year.
I would either lift them out of the windowboxes and pot up into smaller plastic pots for winter or get a thick layer of fleece to cover them and hope the winter is a mild one. For future years, your best bet would be to take cuttings at the end of September and overwinter those inside, then you can use them to replace the previous year's plants.