Reproducibility Index · b4df2d29

hn:48111896

Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model

Independent reproduction of this paper. Validated on 2026-05-13 via a lab build. Required 1 repair round before passing.

Quality score
75%
Tests passed
41/41
Repair rounds
1
Status
reproduced

Checks

Syntax

syntax_parse blocking All 19 .py files parse cleanly

Imports

import_attenfunc blocking import attenfunc -- OK

Dependencies

dep_metadata major Found pyproject.toml

Tests

pytest_run major pytest: 41 passed, 0 failed, 0 errors (exit 0)

Packaging

pip_installable major pip install -e . --dry-run succeeded

Git State

worktrees_merged major No .worktrees directory
on_main_branch minor Current branch: master

Cleanup

no_venv_in_tree major .venv/ present (4984 MB) -- should be in .gitignore

Whole-Repo Review

claude_review info Claude review: 6/10 — The codebase implements a functional attention-only transformer for function calling with synthetic data generation and

Citation & embed

Badge

Embeddable SVG, no auth required.

Research Radar reproduction badge
<img src="https://api.research-radar.com/v1/validations/b4df2d29/badge.svg">

BibTeX

Drop into your .bib file.

Download .bib →