Intel Corporation Interview Question

Describe tokenizing concepts?