If a chest has a solid block on top, a comparator will read it incorrectly. Try the following:

Place an empty chest with a solid block on top and place the comparator. Then start pushing items into the chest with either a hopper or a dropper. The comparator will not light up even though the items are in the chest. Is this expected behavior?