Employee was with a crew removing demo material. EE was outside the hole removing buckets that the crew inside was filling up. As EE reached inside to remove a bucket the crew inside shouted at EE to watch out because a chunk of refractory material fell from side wall above door. Due proximity of the falling material, EE was unable to avoid being struck in the left hand.