Tool-use review
Created · Instruction-Tuned · Long Context · Agentic Orchestrator
Tool-use profile
NVIDIA Nemotron 3.5 Lightning 30B (Thinking) achieves a Combined Score of 73.1 (Good) in the tool-use benchmark: P1 Execution 90, P2 Synthesis 55.8, fleet average 67.1.
Strongest test: HTTP Fetch & Extract (57.5). Weakest test: Web Search & Tool Selection (91). The spread between these two tests is -33.5 points.
Reliability status: Tool Call Valid No, Retry Not required, Hallucination Detected.
This data-driven auto-review is compiled from the available tool-use benchmark data. Once a detailed LLM-generated analysis (GPT 4.5) is available, it will automatically replace this template. The raw data and full methodology are documented in the GitHub project.