Reward Atlas
All field guidesEsc to close
Sign in
LLM / AgenticPublicPublishedv1.0Advanced

SQL-Detective-v1

A multi-turn agent answers analytics questions by querying a read-only SQLite sandbox. Tool use, verifiable rewards, 12-turn budget. Maintained by Bhaskar & Jaswanth · updated 28 Aug 2026.

Dataset
2,400 q · 12 DBs
Action
tool call | final answer
Turn cap
12
Best baseline
GRPO-7B 61.4%
02

Environment type & API

LLM policy
tool call | final answer
messages + tool result
SQLite sandbox

Mental model

An OpenEnv environment served over HTTP from a Docker container. The client exposes the familiar reset(), step(action) and state() calls. One step is one assistant turn: a single tool call or the final answer.

from reward_atlas_sql_detective import SQLDetectiveClient, SQLAction

with SQLDetectiveClient.from_docker_image("rewardatlas/sql-detective:1.0") as env:
    obs = env.reset()
    obs = env.step(SQLAction(tool="list_tables", args={}))
    print(obs.observation.tool_result)
Guide details
Version
Type
LLM / Agentic
API
OpenEnv
License
Apache-2.0
Seeds
3
Domains
tool-usedatacoding
Install
pip install reward-atlas-sql-detective

Issue with this step? Suggest an edit