Are there affordable ways to cut your heating bill?

Alternatives to gas and oil heating are becoming more popular but are still expensive.