Make sure you withdraw any remaining funds in advance of closing your bank account