返回首页
arXiv AI··论文与技术

Pareto-Optimal RTL Code Generation via Multi-Objective Reinforcement Learning with Large Language Models

中文摘要

该研究通过多目标强化学习与大语言模型,生成在功耗、性能及面积间实现帕累托最优权衡的高质量RTL代码。

English Summary

This study uses multi-objective reinforcement learning and LLMs to generate RTL code with Pareto-optimal trade-offs in power, performance, and area.

原文节选

arXiv:2610.26904v1 Announce Type: new Abstract: Recent studies have proposed reinforcement learning with verifiable rewards (RLVR) methods that enable LLMs to generate high-quality RTL circuits from natural-language specifications. Existing approaches optimize circuit PPA (Power, Performance, Area) by aggregating multiple objectives into a single scalar reward, making it difficult to simultaneously generate diverse Pareto-optimal solutions across different trade-offs such as low power, low latency, and small area. However, in practical design, the relative importance of each objective varies depending on product requirements and design constraints; thus, obtaining a diverse and high-quality candidate set is beneficial in that designers can choose a preferred trade-off a posteriori. In this work, we are the first to propose a learning method for LLM-based circuit generation that optimizes, not the quality of a single circuit, but the quality and diversity of the entire circuit set obtained through multiple generations in the PPA objective space. The proposed method consists of (1) a generation-based training pipeline that reformulates coverage improvement of the entire Pareto soluti…