Intelligent Delivery: Making Every Unit of Compute Serve Better Ads
中文摘要
广告模型规模增长迅速,系统通过智能分配计算资源,精准匹配算力与广告请求,从而优化整体投放效果。
English Summary
Ads models are scaling rapidly; the system intelligently allocates computing resources to specific requests and chips to maximize advertising efficiency and overall performance.
Original Excerpt
Ads ranking models are growing toward LLM scale faster than the hardware to run them can keep up. An extra unit of compute has more impact on some ad requests, models, and chips than on others. The challenge is deciding where to allocate it to get the best outcome for the entire system. We built [...] Read More...