Poster

LMM4-IC4K: A Large Multimodal Model Powered Integrated Circuit Footprint Geometry Understanding

Yida Wang ⋅ Taiting Lu ⋅ Runze Liu ⋅ Lanqing Yang ⋅ Zhe Chen ⋅ Yuehai Wang ⋅ Yixin Liu ⋅ Kaiyuan Lin ⋅ XiaoMeng Chen ⋅ Dian Ding ⋅ Yijie Li ⋅ Yifan Yang ⋅ Yi-Chao Chen ⋅ yincheng jin ⋅ Mahanth Gowda

Abstract

Printed-Circuit-board (PCB) footprint geometry labeling of integrated circuits (IC) is essential in defining the physical interface between components and the PCB layout, requiring precise visual perception. However, the unstructured nature of footprint drawings and abstract diagram annotations prevents direct IC footprint parsing and automated package geometry labeling methods from developing. Existing Large Multimodal Models (LMMs) struggle with inaccurate geometric perception, limiting their effectiveness in this task. To address these challenges, we propose LMM4-IC4K, a novel framework that treats IC mechanical drawings as images and leverages LMMs for structured geometric interpretation. To support such a framework, we introduce ICGeo8K, a multi-modal dataset with 8,608 labeled samples, including 4138 real-world IC footprint samples and 4470 synthetically generated samples. We further present a two-stage training framework to fine-tune LMMs for IC footprint labeling. Extensive experiments demonstrate that our model outperforms state-of-the-art LMMs on the proposed benchmark. The accurate translation of footprint diagrams enabled by LMM4-IC4K contributes to advancing automation and standardization within the PCB industry.