Basically I made a command block that constantly clears all players of barrier blocks

(/clear @a barrier), and whenever it runs, players who are using their crafting grid in their inventories lose any item that is placed in it.

So in conclusion, the /clear command always clears whatever is in the 2x2 crafting grid in inventories, even with a specific item that it's looking to clear.