The restaurant industry says it is facing a double whammy – rising costs and customers with less money.