I Shipped an LLM Feature to Production. The Model Was the Easy Part.
中文摘要
将LLM功能从原型推向生产环境非常困难。模型开发容易，但生产环境的工程实现需耗时数月。
English Summary
Moving an LLM feature from demo to production is challenging; while the model is easy, the engineering implementation takes months.
Original Excerpt
The demo took a weekend. Production took six months. Continue reading on Medium »