There is a really, really big caveat here.
While all of this is true, and while heat pumps are definitely more efficient than gas/oil/electric heat, you MUST have a well-insulated home without drafts. If your home is not well insulated, or is drafty, then heat pumps likely will not keep your home at a comfortable temperature.
A standard furnace works by kicking on when heat drops below the set point of your thermostat, and then it blasts heated air until the whole space is a certain temperature above the set point on your thermostat, and then shuts off. The most efficient heat pumps are constantly trickling a little heat at a time, rather than cycling on and off. If your home is poorly insulated or drafty, then you can end up losing heat faster than the heat pump can bring it in. The better your insulation and the better sealed your home is, the better your results with a heat pump will be.
Unfortunately, my home is largely uninsulated and pretty drafty; without doing a pretty significant amount of work, at a fairly steep cost, I can't retrofit to a heat pump.