“There's a fine line between fishing and just standing on the shore like an idiot.”

The joke is aimed at spectators rather than participants, which is why it survives being repeated by people who have never fished. It works as a small definition of effort: the visible difference between doing a thing and watching someone do it.