Every time we switch attention, it causes us to burn mental energy.  And that energy lost ends up costing us: I usually focus on the fact that everything takes longer when my focus shifts.  But we also lose creativity, sleep, energy... and more.