If you are too close to a skeleton you won't see any arrow comming towards you and for that reason you can't react fast. Also the arrow seems to take yur damage before it hits you and it might have to do with the arrow leaving the skeleton after the skeleton shooted at you. Finally, the skeleton shoots arrows from his head and not his bow.