In server.properties even when pvp=false flaming arrows shot by a player at another player still takes damage. I haven't tested it with normal arrows.

The exact enchantment on the bow that fired the arrow was:
Infinity I
Power V
Punch I
Flame I
Unbreaking III

Thanks!