Microsoft Interview Question

How do transformers and attention work