I paused the game for a few minutes and after that, the chests would open anymore.

After I exited the world and re-entered it worked again.

EDIT: Actually anything that has an inventory. And also pressure plates