A fun way to get inexpensive produce is by joining a food co-op. We did that initially when we began My Healthy Eating Challenge. We purchased our produce through Bountiful Baskets. For $15 we received a basketful of produce, 50% veggies, 50% fruit. For organic produce it was $25.
We'd place the order on-line on a Monday (that was the order date for this area) and pick it up at the assigned location on Saturday morning. It was like Christmas, since we never knew what we would receive. Sometimes we received produce that we were not used to eating, which was a good way to try new recipes!
We no longer buy our produce through Bountiful Baskets because we decided to go with the organic produce and felt like we got more bang for our buck by shopping sales. However, for those who live in areas where it is difficult to find good prices for organic produce, you might want to try it... and for those you don't prefer organic, it's a great deal!
They sometimes offer other food items too, such as artisan bread.
Here's the link: Bountiful Baskets. (If there is not one in your area, you can check around for other food co-ops.)