PCBBench (schematic synthesis)

227 schematic-synthesis tasks scored by a deterministic 5-layer structural verifier checking SKiDL output against real-IC pin and topology constraints.

Eval / BenchmarkSource-availableMaintainedECAD

What it does and how it connects

PCBSchemaGen is the code and data for a NeurIPS 2026 paper on reward-guided LLM code synthesis for PCB schematic design with structured verification. It ships two benchmark suites: PCBBench with 62 hand-authored tasks and Open-Schematics-Eval with 165 tasks drawn from public schematics, for 227 tasks in total, plus a knowledge-graph component library.

The model writes SKiDL code for a schematic, and a reference-free verifier scores the resulting netlist snapshot without any reference design. Before verification, generated code passes a syntax check and a sandboxed SKiDL execution with KiCad ERC. The verifier then applies layered checks: electrical invariants, power-electronics invariants, pin-role compatibility, subcategory templates, and topology signatures, with a piecewise reward from 0.0 for no code block to 1.0 when all checks pass.

The repository also ships a refinement loop that retries failed designs with Thompson sampling scheduling, prompt templates, and a board-calibration tool that converts the original Open-Schematics KiCad boards into verifier inputs. The benchmarks and knowledge graph are MIT licensed, while the framework code is PolyForm Noncommercial 1.0.0, for research, teaching, and other noncommercial purposes.

  • SchGen

    SchGen fine-tunes a model to generate editable KiCad schematics from natural language, while PCBSchemaGen benchmarks and verifies SKiDL code with a reference-free layered verifier.

  • PCB-Bench (digailab)

    PCB-Bench tests placement and routing knowledge with Q and A, while PCBSchemaGen tests schematic synthesis with a structural verifier.

  • OmniSch

    OmniSch tests visual reasoning over schematic diagrams and netlist-graph construction, while PCBSchemaGen tests schematic synthesis with a structural verifier.

  • PCB-QA

    PCB-QA asks questions about real boards from their KiCad files, while PCBSchemaGen tests schematic synthesis with a structural verifier.

  • mcp-kicad-sch-api

    mcp-kicad-sch-api is an MCP server for creating and editing KiCad schematic files, while PCBSchemaGen benchmarks schematic synthesis with a verifier.

Recurring errors it addresses

Error Index entries this tool is built to reduce or work around.

Sources

  1. 1READMEgithub.com
  2. 2Paper (arXiv 2602.00510)arxiv.org
  3. 3Benchmarks on Hugging Facehuggingface.co

Not verified

  • Pricing: none stated on the repo
  • Real user voices (no real linked post read for this page)
  • A named individual builder beyond the paper's author list (Zou et al.)

Last verified November 6, 2026. Listings are informational. The evidence score measures public, verifiable evidence and is not an endorsement or a compatibility claim.