Transformers and the challenges of deploying LLMs

Explain how a Transformer works, then discuss recent advances in large language models, how you would apply one in the team's product, and the main problems with deploying LLMs in the real world (hallucination, safety, cost, latency, evaluation) and what you would do about each.