Small specs tend to trade counter to trend like hedgers. They try to pick tops and bottoms against the prevailing trend and they trade more frequently, whereas large specs have more difficulty changing their book around due to liquidity, so they are more likely to be big trend followers holding their positions for longer and bigger moves.

It's not a zero sum game, but it's really near to it. SMCJB explained well enough.