There is good debt and bad debt... The good debt are things that have low interest and potentially have increased value over the price that you paid for the item. Things like loans for education (although the interest rates on those loans are getting higher than when I took out mine because so many students are defaulting on them), houses, and cars (although their value tends to decrease with time) are considered good debt. In fact home loans are very good nowadays with their very low interest rates... Usually with small improvements, you can actually beat out the interest rate of the home loan by the increase in value. Moreover, you can write off part of the interest on home loans if you do itemized deductions on your income taxes. Additionally, you may also be able to make more on interest on investments were you to just pay the minimum on the home loan.
Bad debt are things like credit cards, small personal loans, payday / tax rebate loans (where you essentially sell the value of your future paycheck or tax rebate in return for immediate cash less a sizable chunk of interest), *bleep* loans, etc. that tend to have high interest rates. For those, it is best to pay off as much of the loan as soon as possible.
I know there are some financial experts (Dave Ramsey is probably most well-known because of his syndicated radio show) that would argue to get out of all debt asap, even to the point of not contributing to an employer-matching IRA until all of a person's debt is eliminated. Even though critics of this approach point out that this doesn't make much financial sense (as I pointed out for the home loans), he contends that it is less about the math and more about the emotions... If you have a lot of debt, you tend to feel overwhelmed, that you'll never pay it all off, and tend to give up, whereas if you are completely debt free, you feel much more in control of your money. It is the same rationale that he uses when saying to pay off your small loans first and work your way up instead of paying off loans in order of their interest rates (paying those with the highest interest rates off first) even if a smaller personal loan has a smaller interest rate than a larger credit-card loan.
For myself, I'd rather pay off the loans from a financial sense, paying a lot on high credit card loans and just paying the minimum on my home loan. If the interest rates are the same, then I'd go with the one that is smaller for that sense of accomplishment, but otherwise I'd pay it off in order of the interest. And also take into consideration other variables to determine how much I should pay off (for example, if my employer matched contributions to an IRA, I'd first pay into that IRA to get the matching money, and then pay off as much as I could on a high-interest loan). And I probably will get loans in the future, esp. if there is some promotion attached to it (eg car companies tend to have 0% interest for 60 months promotions).