I have around 50 bottles in my collection, about 45 too many for most I guess :-)
People experience guilt when they over-indulge. If that's what you're feeling just cut back on your spending and try to sample more.
You only live once my friend, work out how many bottles you're happy with and "just do it". No one can tell you what's right for you.