To reproduce:

1. Create a new world
2. /achievement give *
3. /achievement take achievement.overkill
4. Hit escape and look at your achievements, observe how more than one achievement is missing