They don't look cheap, just boring and too big in this case here. Take a couple and have them recovered in a fabric you select. Or, just go completely "clean" and have no toss pillows at all. (Then you won't have to keep straightening them out). A couple colorful toss throws instead?

I kind of wondered if I could just go without pillows all together. So you think that would work ok as well?

I don't think they look cheap at all.

Yes, you can go without pillows. But add color or texture or pattern elsewhere. I like Margo's suggestion of one lumbar and a throw.

keep your eyes peeled for sales at fabric stores. I just bought really nice fabric for $7/meter which was originally $30/meter. then you can get whatever fabric you want, and make simple covers for the pillows.

Doesn't look cheap. You just need the right pillows to make it look interesting. Check out one kings lane - you could probably get a few that won't cost a fortune but still add some design/style to your room.

I wouldn't
Take the back cushions away ...
Not having any there would
Make the back of your sofa low
And not comfy .....

Maybe keep the back ones

Take away the cushions either side of them .
or recover them ...
Love the cushion and throw Margo posted ...
Good luck in cushion heaven ...
BTW yours don't look cheap at all...
You must have liked something about your sofa
To have brought it ....

I would keep the ones you have now + go on line for throw cushion covers. They cost approximately $20 each. Go to a fabric store and purchase stuffing. Unzip the pillows and add stuffing until you are fine with the intensity. If you don't overstuff, the pillows will have the softness and flexibility of feathers. Look to match up to your rug and wall color. Silk pillows in links below, just as an example - but covers can be found in lots of places.
http://www.amazon.ca/Avarada-Middle-Stripe-Pillow-Yellow/dp/B00KDCH184/ref=sr_1_62?ie=UTF8&qid=1412188273&sr=8-62&keywords=throw+cushion+covers; http://www.amazon.ca/ELEPHANT-THROW-CUSHION-COVER-PILLOW/dp/B00NYYT5LY/ref=sr_1_136?ie=UTF8&qid=1412188392&sr=8-136&keywords=throw+cushion+covers

Look on etsy for pillow covers. Lots of options and you can cover the existing pillows. I agree they don't look cheap I just don't think they are adding anything.

Another good site to find accent pillows is Wayfair.com. They have a good assortment, and many come in sets of 2. Below are some samples that I think would look great on your loveseat.

Themrene.houzz.com

Don't replace pillows. You have a perfect neutral pallet. Good choice! Just add some color with varied textures and patterns. . However, don't EVER invest in expensive pillows, especially with kids and dogs. You can get really beautiful pillows very inexpensively that look designer high end. Go to Home Goods, Marshalls, TJ Maxx, Tuesday Morning, even Target and Walmart. That's where Home Stagers go. You will also notice that is where TV and movie set designers go too. Nobody but the super rich who hire interior designers (who get a big kickback) pays $$$$ for expensive pillows. A big waste of money. Also, that way you can change for seasons or just because! Have fun!

Have you thought of just getting pillow covers in a design you love? That way you could spice it up and change it later if you want to. Stores such as Bed Bath and Beyond have these. Also maybe a throw in your favorite color would add a splash of interest.

No they don't you just need to add a couple of different ones .

Pillows are expensive. Heck, even Walmart or some of the cheap linen places will have some throw pillows that aren't going to cost your 1st born child. A couple cheap pillows with the nice stuff - no one will ever know! Now me........I'd probably hot glue some fringe or trim on one or two of the pillows or sew a few beads on.........(I bead a lot........)...........

These pillows don't look cheap either, but they are:
https://www.etsy.com/listing/192457915/green-striped-pillow-cover-embroidered?ref=shop_home_active_1&ga_search_query=orange
https://www.etsy.com/listing/197079203/decorative-kilim-pillow-case-2239?ref=sc_1&plkey=482a33a07b751cd52b9f8cd2e578ca78116ae2a1%3A197079203&ga_search_query=kilim+pillows&ga_search_type=all&ga_view_type=gallery

The pillows that came w/your sofa don't look cheap at all. I agree w/a lot of these folks above -a beautiful colored lumbar pillow and throw would really 'add.'