The only real thing I did here was leash boats to a fence, left the world, and then the leads disappeared(although they seem to still behave as if the lead was still there.) 

Quick update: Doesn't always seem to work, though...