Where to put your Attention and Why