The tank-vs-tankless decision is treated as an upgrade question in most retail conversations. It is not. It is a fit question. Tankless is unambiguously better at three things, unambiguously worse at three other things, and the right answer depends on which set of three matters more for your household.
The 30-second answer
Buy tankless if: you have a household with overlapping hot water use (multiple showers + appliances), your gas line is sized at 3/4" or larger, you live somewhere with mild groundwater temperatures (South, West Coast), and you plan to be in the house 12+ years. Buy tank if: any of those are false. Specifically — buy tank if your gas line is undersized and would require a re-run, your peak use is sequential rather than overlapping, or you have a 100A electric panel with no gas.
What they actually do
A tank water heater holds 40–80 gallons of water at temperature, ready for use. When you draw hot water, the tank delivers from its reservoir while the burner replenishes. When the reservoir is depleted, you wait for the burner to catch up.
A tankless heater holds zero water. When you turn on a hot tap, the unit detects flow, fires a burner (or activates resistance elements), and heats the water as it passes through. The output continues as long as flow continues — limited only by the unit's GPM capacity at your local temperature rise.
These are not the same device. Tank is a battery with a slow charger; tankless is a passthrough heater with no battery.
"Endless hot water" is mostly true
Tankless does deliver endless hot water — at the unit's GPM rating. You can run a 30-minute shower without running out. You cannot run two simultaneous showers if the unit is sized for one. The marketing line is accurate at the single-tap level and misleading at the whole-house level.
For a household where two people shower at the same time, the right tankless is a 180K–199K BTU gas unit. The wrong tankless is a small electric unit (under 24 kW) that the homeowner thought would suffice and now fails the second shower. Most "tankless doesn't work" complaints are size complaints.
The cold-water sandwich (real, fixable)
Turn the tap off mid-shower, turn it back on 30 seconds later: a slug of cold water passes before hot returns. This is the cold-water sandwich and it happens because the heater is off when there is no flow — the hot water in the pipe between the heater and your tap cools down quickly, especially in a basement install. Tank water heaters don't have this because the reservoir always has hot water at the tap end of the pipe.
The fix is recirculation: a small pump runs hot water through the pipes in a loop so the line stays warm. Some premium tankless units (Navien NPE-A series, Rinnai RU iN series) have this built in. Retrofitting a recirc loop to a system that lacks one costs $400–$1,200 in additional plumbing. This is the cost that nobody tells you about in the showroom.
Lifespan and reliability
Tank heater: 10–15 years for a quality residential gas unit with annual flushing. 6–10 years with no maintenance. Failure mode is tank leakage (catastrophic, requires immediate replacement). Annual maintenance: 45-minute flush, anode rod inspection every 4 years.
Tankless: 18–22 years for a quality gas unit with annual descaling. 10–14 years with no maintenance. Failure mode is component failure (flow sensor, igniter, heat exchanger) — repairable rather than catastrophic. Annual maintenance: 60-minute vinegar descaling, more frequent in hard water.
Both will last roughly the same if neither is maintained. With diligent maintenance, tankless wins by 5–8 years. Maintenance compliance in real households runs 20–30% for both — so in practice the lifespans converge more than they should on paper.
Efficiency: the gap is smaller than advertised
Modern condensing tankless: UEF 0.93–0.96.
Modern condensing tank (high-efficiency): UEF 0.78–0.86.
Standard atmospheric gas tank: UEF 0.60–0.64.
Tankless does beat tank on efficiency, but the gap depends on what you're comparing. A condensing tankless (Rinnai, Navien) versus a condensing tank (AO Smith Vertex, Bradford White eF Series) is a 7–10% efficiency difference — meaningful but not dramatic. A condensing tankless versus a standard atmospheric tank is a 35% efficiency difference — huge, but few people consider the condensing tank option.
Annual operating cost difference, household of four, $1.20/therm gas, hot water usage 60 gal/day:
- Atmospheric tank (UEF 0.62): $480/yr
- Condensing tank (UEF 0.86): $345/yr
- Condensing tankless (UEF 0.96): $310/yr
The $170/yr savings from going atmospheric tank → condensing tankless is real. The $35/yr savings from condensing tank → condensing tankless is not actually material to the buying decision.
Installation cost reality
Like-for-like tank replacement (existing tank → new tank): $1,200–$1,800 installed.
Tank-to-tankless conversion: $3,500–$6,500 installed. The conversion typically requires:
- New gas line (existing 1/2" line is undersized for most tankless — needs 3/4" or larger). $400–$1,200 depending on run length.
- New venting (PVC for condensing tankless, replacing the existing B-vent or chimney route). $500–$1,500.
- Electrical outlet for the tankless control board. $150–$400.
- New mounting bracket on the wall. $50–$100.
- Service valves for descaling. $150–$300.
The conversion cost is the single biggest reason households do not switch. A $5,000 install premium needs $170/year in fuel savings to break even — 29 years, longer than the unit's life. The math does not work for most households when the existing tank can be replaced like-for-like.
However: if you are doing major plumbing renovation anyway (kitchen remodel, basement finish, addition), the marginal cost of tankless drops to $1,500–$2,500 because the gas line and venting work is happening regardless. That is when the math actually works.
Physical footprint
A 50-gallon tank: roughly 22" diameter × 60" tall, occupies about 4 square feet of floor space plus clearance.
A whole-house gas tankless: roughly 18" × 26" × 12" deep, wall-mounted, occupies zero floor space.
For homes where the existing tank lives in a finished basement or a utility closet that could be repurposed, the freed floor space is genuinely useful. For homes where the heater is in a garage corner or unfinished basement, the space win is essentially zero — nobody was using that corner anyway.
Who actually wins with each
Tank wins for: a 2-person household where peak hot water demand is one shower + a dishwasher; a household where the existing tank just failed and replacement is needed within 48 hours (tankless is rarely available + installable that fast); a renter or owner who plans to move within 5 years (tankless does not generate enough resale lift to justify the install premium); any home where the gas line is 1/2" and the cost of running 3/4" exceeds $1,500.
Tankless wins for: a 4+ person household with overlapping morning hot water use; a household that finds the floor space genuinely useful; a household doing a kitchen or basement renovation that already involves gas/venting work; a home in Texas, Florida, California, or Arizona where mild groundwater means tankless GPM stays high year-round.
Roughly a wash: 3-person households in moderate climates with sequential hot water use. The 10-year cost is similar within $500. Pick whichever the contractor prefers to install — labor familiarity is the deciding factor.
The hybrid alternative most people skip
Heat-pump water heaters (Rheem ProTerra, AO Smith Voltex, State Premier) are the third option in this comparison and outperform both on operating cost in most US climates. The ProTerra runs ~$150/yr to operate — half the cost of even a condensing tankless. The catch is they need 750+ cubic feet of air space around them and they pull heat out of that space (effectively a small dehumidifier with the side effect of hot water). They work great in basements and large utility rooms; they do not work in closets.
If you are doing the math on tank vs tankless and your install location is a basement or open utility room, add hybrid heat-pump to your shortlist. It often wins.