Talk Merit asked this question in the Bitcoin Talk forum, and received some interesting replies
Will you ever be able to buy a coffee with Bitcoin
The problems seem to stem from the long(ish) confirmation times, and the risk that the transaction will fail or be cancelled before it is confirmed.