It’s a baseball metaphor about how the people most likely to say “the poors aren’t working hard enough” are the people who were given all of their money from their parents.

Born rich and pretending they made that money themselves.