You don't need to convert the entire account, however, you can't convert only after-tax dollars. When you convert Traditional IRA to Roth IRA, it's pro-rata - which means conversions are proportional to the pre vs post tax dollars. If 10% of your tIRA is post-tax and 90% is pre-tax, any conversion you do will be taxable on 90% of the conversion.