A lot of retirees assume Social Security benefits are simply tax-free. They aren't automatically — whether any portion is taxable depends on your other income, and the thresholds involved are unusual in a specific way: unlike almost every other figure in the tax code, they have not been adjusted for inflation in decades, which is exactly why more retirees find themselves owing tax on benefits over time even without a real increase in purchasing power.
The "Combined Income" Test
The IRS uses a specific formula called combined income: your Adjusted Gross Income, plus any tax-exempt interest, plus half of your Social Security benefits for the year. Where that combined figure lands determines how much of your benefit becomes taxable:
| Filing Status | Combined Income | Portion of Benefits Taxable |
|---|---|---|
| Single | Under $25,000 | None |
| Single | $25,000 – $34,000 | Up to 50% |
| Single | Over $34,000 | Up to 85% |
| Married Filing Jointly | Under $32,000 | None |
| Married Filing Jointly | $32,000 – $44,000 | Up to 50% |
| Married Filing Jointly | Over $44,000 | Up to 85% |
Even at the highest tier, no more than 85% of benefits ever becomes taxable — some portion is always tax-free regardless of how high your other income runs.
Why These Numbers Feel Outdated
They are — these specific thresholds have stayed fixed since they were introduced, while wages, pensions, and cost-of-living have all risen substantially over the same period. The practical effect is that a growing share of retirees cross into taxable territory each year even without any real change in their standard of living, simply because Social Security's own annual cost-of-living adjustments push benefit amounts (and therefore combined income) upward while the taxability thresholds stay still.
What Counts Toward Combined Income
Wages from continuing to work, pension income, traditional IRA and 401(k) withdrawals (see our Retirement Accounts article), interest, dividends, and rental income (see our Rental Property article) all count toward the AGI portion of combined income. Roth IRA qualified withdrawals generally do not, since they're not included in AGI in the first place — one of several reasons some retirees value having a mix of traditional and Roth accounts specifically to manage this calculation in retirement.
Unemployment Compensation
Unlike Social Security's partial taxability, unemployment compensation is fully taxable at the federal level, dollar for dollar, with no exclusion. It's a common source of an unexpectedly large tax bill for people who received unemployment benefits during the year and didn't have tax withheld from those payments, since withholding is optional on unemployment rather than automatic the way it typically is with wages.
A Simplified Example
A retired single filer has $18,000 in pension income and $20,000 in annual Social Security benefits. Combined income = $18,000 + (0.5 × $20,000) = $28,000 — squarely in the 50%-taxable tier for a single filer. Up to $10,000 of their Social Security benefit could become part of their taxable income, on top of the $18,000 pension, depending on the exact calculation. This is precisely the situation that surprises new retirees who assumed a modest pension plus Social Security would stay comfortably tax-free.
Frequently Asked Questions
- Can I have tax withheld from my Social Security directly? Yes — you can voluntarily request federal withholding on Social Security benefits using Form W-4V, which many retirees use specifically to avoid a surprise bill or the need for quarterly estimated payments.
- Does this calculator model Social Security taxation? Not currently — enter your other taxable income as usual, but treat any Social Security-specific calculation as something to verify separately using the combined-income method above.
State Taxes on Social Security
Federal taxability is only half the picture. Most states don't tax Social Security benefits at all, but a smaller number do, generally with their own separate rules, exemptions, or income thresholds that don't mirror the federal combined-income test. Check the State Tax tab for your specific state, since this is exactly the kind of state-specific wrinkle that a federal-only calculation would miss entirely.
One More FAQ
Does the type of retirement account I withdraw from change my Social Security taxability? Yes, indirectly — traditional 401(k)/IRA withdrawals count toward AGI and therefore toward combined income, while qualified Roth withdrawals generally don't, which is exactly why the mix of account types you draw from in retirement can meaningfully shift how much of your Social Security ends up taxable in a given year.