To recreate:
/scoreboard objectives add caught stat.fishCaught caught
/scoreboard objectives setdisplay sidebar caught (just to see it)
Now find a stream and go fishing. When you reel in a fish, the number doesn't go up in the objective (and neither does the FishCaught statistic).