OmniSch

OmniSch is a benchmark for assessing large multimodal models on PCB schematic understanding and spatial netlist graph construction. It contains 1,854 real-world schematic diagrams and asks models to convert schematic diagrams into machine-readable, spatially weighted netlist graphs that capture component attributes, connectivity, and geometry.

The benchmark has four tasks: visual grounding for schematic entities, with 109,900 grounded instances aligning 423,400 diagram semantic labels to their visual regions; diagram-to-graph reasoning over topological relationships among diagram elements; geometric reasoning that constructs layout-dependent weights for each connection; and tool-augmented agentic reasoning for visual search.

The schematics come from real-world designs collected from open-source communities including SparkFun, Arduino, Adafruit, and GitHub, in Autodesk EAGLE format. The paper reports substantial gaps in current models, including unreliable fine-grained grounding, brittle layout-to-graph parsing, and inconsistent global connectivity reasoning. The project page is omnisch.com, and no public code repository was verified for this entry.