Inworld AI Interview Question

How would you improve LLM model serving performance?