How much system memory is enough?

When it comes to adding memory, we all have to deal with the cost vs. speed equation. So how much memory do you really need?