Are you getting a check engine light and code? I had this problem recently and it turned out to be the idle-air regulator motor/valve asembly. $47.00 to replace.
I think that's the air idle control valve or AIC. Very easy to replace and yeah about $45 at <insert local auto parts place here>.