I suspect no one is actually singling out your yard for littering — more likely, it’s more a matter of other neighbors being faster to clean up the litter in their yards than you are in yours.
The various and sundry things that people choose to abandon on sidewalks, in gutters, or in people’s front yards — and the volume of those things — is a source of ongoing amazement to me. And it’s frustrating. But (as PoP was advising in his advice-to-newcomers thing from seven years ago, recently reposted at http://www.popville.com/2014/08/tips-for-newcomers-7-years-later-what-would-you-addremove/ )… pick up the trash in front of your house. (And if you’re feeling generous, in front of the houses on either side.) Otherwise it will just stay there until it blows into someone else’s yard/sidewalk/treebox area.