The thermostat is way simpler/cheaper to replace so do that first if you haven't already. But I'm guessing the bolt problem would cause the same slow overflow you saw with the radiator cap off.