UC Merced Interview Question

solve this math problem using factoring