EarthRecord: From Pixels to Land Change with Multimodal Agents over Four Decades of Satellite Imagery
中文摘要
EarthRecord基准测试利用多模态智能体分析四十年来原始卫星影像,填补了土地变化监测在复杂数据处理与科学评估方面的空白。
English Summary
EarthRecord is a new benchmark using multimodal agents to analyze four decades of raw satellite imagery, improving land-change detection for complex Earth observation science tasks.
arXiv:2611.12934v1 Announce Type: new Abstract: While multimodal agents now carry out complex data analysis with tools, their ability to turn decades of satellite imagery into reliable land-change analysis, crucial for Earth observation science, remains unmeasured. Existing benchmarks fall short: they pose questions on curated images or give agents preprocessed inputs, leaving out the raw multi-sensor archives where such analysis begins. We introduce EarthRecord, a benchmark built on the raw record of 56 sites: four decades of Landsat, MODIS, VIIRS, and Sentinel-2 data, with cloud masking and cross-sensor harmonization left to the agent. It poses 238 land-change questions across ten analysis tasks, scored against withheld references from global products, agreement among methods, and visual interpretation. Two controls test what answers rest on: the closed book removes the record, and instrument pairs alter one satellite's data while nothing changes on the ground. Evaluations of twelve multimodal agents reveal that leading agents complete most analyses end to end but falter when an answer requires mapping from imagery. Further analysis shows that the record moves answers from prior …