Scaffolding breaks (drops) when it falls above the following blocks:

Modified grass_block (grass_path, farmland, etc...)

Torches/Signs.

All flowers (except any type of grass)

and many others that SAND breaks when falling into.

It was really annoying when i was in the middle of an village experimenting with scaffolding...