You need to be clear of the red marker by the time it disappears. I think a lot of people believe that so long as they aren't in the area when they 'see' the spell being cast they're safe, but that's not the case. If you're standing in red the moment the marker disappears, you're going to take the hit.
