Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# Claude Code settings
.claude/
6 changes: 3 additions & 3 deletions datasets/quick-start.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,9 @@
title: "Quick Start"
---

Datasets are simple data tables that you can use to manage your data for experiments and evaluation of your AI applications.
Datasets are available in the SDK, and they enable you to create versioned snapshots for reproducible testing.

<Frame>
<img
className="block dark:hidden"
Expand All @@ -10,9 +13,6 @@ title: "Quick Start"
<img className="hidden dark:block" src="/img/dataset/dataset-list-dark.png" />
</Frame>

Datasets are simple data tables that you can use to manage your data for experiments and evaluation of your AI applications.
Datasets are available in the SDK, and they enable you to create versioned snapshots for reproducible testing.

<Steps>
<Step title="Create a new dataset">

Expand Down
Binary file added img/playground/play-action-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-action-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-column-list-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-column-list-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-column-options-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-column-options-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-column-settings-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-column-settings-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-empty-table-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-empty-table-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-json-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-json-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-list-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-list-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-multi-select-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-multi-select-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-number-col-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-number-col-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-number-col-summary-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-number-col-summary-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-prompt-column-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-prompt-column-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-prompt-write-dark.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-prompt-write-light.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/playground/play-single-select-dark.png
Binary file added img/playground/play-single-select-light.png
14 changes: 14 additions & 0 deletions mint.json
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,20 @@
"group": "Prompt Management",
"pages": ["prompts/quick-start", "prompts/registry", "prompts/sdk-usage"]
},
{
"group": "Playgrounds",
"pages": [
"playgrounds/quick-start",
{
"group": "Columns",
"pages": [
"playgrounds/columns/data-columns",
"playgrounds/columns/prompt",
"playgrounds/columns/column-management"
]
}
]
},
{
"group": "Datasets",
"pages": ["datasets/quick-start", "datasets/sdk-usage"]
Expand Down
48 changes: 48 additions & 0 deletions playgrounds/columns/column-management.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
---
title: "Column Management"
description: "Learn all columns general functionalities"
---

Columns in the Playground can be reordered, edited, or deleted at any time to adapt your workspace as your analysis evolve. Understanding how to manage columns effectively helps you maintain organized and efficient playgrounds.

## Columns Settings
Column Settings lets you hide specific columns from the Playground and reorder them as needed. To open the settings, click the Playground Action button and select Column Settings
<img
className="block dark:hidden"
src="/img/playground/play-action-light.png"
/>
<img className="hidden dark:block" src="/img/playground/play-action-dark.png" />

To change the column order, use the six-dot handle on the right side of each column to simply drag the column into the desired position.

To hide a column, toggle its switch in the menu.
<img
className="block dark:hidden"
src="/img/playground/play-column-settings-light.png"
style={{maxWidth: '600px'}}
/>
<img
className="hidden dark:block"
src="/img/playground/play-column-settings-dark.png"
style={{maxWidth: '600px'}}
/>


## Columns Actions

Each column has a menu that lets you manage and customize it. From this menu, you can:
- Rename the column directly by editing its title
- Edit the column configuration
- Duplicate the column to create a copy with the same settings
- Delete the column if it’s no longer needed

<img
className="block dark:hidden"
src="/img/playground/play-column-options-light.png"
style={{maxWidth: '350px'}}
/>
<img
className="hidden dark:block"
src="/img/playground/play-column-options-dark.png"
style={{maxWidth: '350px'}}
/>
116 changes: 116 additions & 0 deletions playgrounds/columns/data-columns.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,116 @@
---
title: "Data Columns"
---

Columns are the building blocks of playgrounds, defining what kind of data you can store, process, and analyze.


<img
className="block dark:hidden"
src="/img/playground/play-column-list-light.png"
/>
<img className="hidden dark:block" src="/img/playground/play-column-list-dark.png" />


<Tip>
**Need to reorder, edit, or delete columns?**

Learn how to effectively manage your columns in the [Column Management](./column-management) guide.
</Tip>

## 📝 Data Input Columns
Store and manage static data entered manually or imported from external sources.

### Text field
Free-form text input with multiline support

### Numeric
Numbers, integers, and floating-point values

<img
className="block dark:hidden"
src="/img/playground/play-number-col-light.png"
style={{maxWidth: '300px'}}
/>
<img
className="hidden dark:block"
src="/img/playground/play-number-col-dark.png"
style={{maxWidth: '300px'}}
/>

The last row allows you to choose a calculation method for the column, such as average, median, minimum, maximum, or sum.


<img
className="block dark:hidden"
src="/img/playground/play-number-col-summary-light.png"
style={{maxWidth: '300px'}}
/>
<img
className="hidden dark:block"
src="/img/playground/play-number-col-summary-dark.png"
style={{maxWidth: '300px'}}
/>




### Single select
Single-choice columns let you define a set of predefined options and restrict each cell to one selection.
To create one, set the column name and add options in the Create Column drawer.
In the values box, type an option and press Enter to save it—once added, it will appear as a colored label.

In the table, each cell will then allow you to select only one of the defined options.
This column type is especially useful for manual tagging with a single tag.


<img
className="block dark:hidden"
src="/img/playground/play-single-select-creation-light.png"
/>
<img
className="hidden dark:block"
src="/img/playground/play-single-select-creation-dark.png"
/>



<img
className="block dark:hidden"
src="/img/playground/play-single-select-dark.png"
/>
<img
className="hidden dark:block"
src="/img/playground/play-single-select-dark.png"
/>
Comment on lines +79 to +85
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Fix light/dark image mismatch for Single select example

The light-mode image mistakenly points to the dark asset, so light theme will render the dark screenshot.

-<img
-  className="block dark:hidden"
-  src="https://github.com/img/playground/play-single-select-dark.png"
-/>
+<img
+  className="block dark:hidden"
+  src="https://github.com/img/playground/play-single-select-light.png"
+/>
 <img 
   className="hidden dark:block" 
   src="https://github.com/img/playground/play-single-select-dark.png"
 />
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
className="block dark:hidden"
src="https://github.com/img/playground/play-single-select-dark.png"
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-single-select-dark.png"
/>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-single-select-light.png"
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-single-select-dark.png"
/>
🤖 Prompt for AI Agents
In playgrounds/columns/data-columns.mdx around lines 79 to 85, the first
(light-mode) img tag incorrectly points to the dark asset; update the src for
the light-mode image to the correct light asset (e.g. change
"/img/playground/play-single-select-dark.png" to the corresponding light file
"/img/playground/play-single-select-light.png") so the light/theme-specific
images match their intended assets.

Comment on lines +79 to +85
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Bug: light/dark images point to the same dark asset

The light variant uses the dark image path, so users in light mode will see the wrong screenshot.

-<img
-  className="block dark:hidden"
-  src="https://github.com/img/playground/play-single-select-dark.png"
-/>
-<img 
-  className="hidden dark:block" 
-  src="https://github.com/img/playground/play-single-select-dark.png"
-/>
+<img
+  alt="Single‑select column in table (light)"
+  className="block dark:hidden"
+  src="https://github.com/img/playground/play-single-select-light.png"
+/>
+<img 
+  alt="Single‑select column in table (dark)"
+  className="hidden dark:block" 
+  src="https://github.com/img/playground/play-single-select-dark.png"
+/>
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
className="block dark:hidden"
src="https://github.com/img/playground/play-single-select-dark.png"
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-single-select-dark.png"
/>
<img
alt="Single-select column in table (light)"
className="block dark:hidden"
src="https://github.com/img/playground/play-single-select-light.png"
/>
<img
alt="Single-select column in table (dark)"
className="hidden dark:block"
src="https://github.com/img/playground/play-single-select-dark.png"
/>
🤖 Prompt for AI Agents
In playgrounds/columns/data-columns.mdx around lines 79 to 85, the light-mode
image tag (className="block dark:hidden") incorrectly points to the dark asset;
update that src to the corresponding light image path (e.g., replace
"/img/playground/play-single-select-dark.png" with the light variant
"/img/playground/play-single-select.png") so the light and dark img tags
reference their correct assets.



### Multi select
Multi-select columns let you define a set of predefined options and allow each cell to contain multiple selections. The setup process is the same as for single-select columns: define the column name, add options in the Create Column drawer, and save them as labels.

In the table, each cell can then include several of the defined options. This column type is especially useful for manual tagging with multiple tags.

<img
className="block dark:hidden"
src="/img/playground/play-multi-select-light.png"
/>
<img
className="hidden dark:block"
src="/img/playground/play-multi-select-dark.png"
/>


### JSON
A JSON column allows you to store and edit structured JSON objects directly in the Playground. Each cell can contain a JSON value, making it easy to work with complex data structures.

When editing a cell, an Edit JSON panel opens with syntax highlighting and formatting support, so you can quickly add or update fields.


<img
className="block dark:hidden"
src="/img/playground/play-json-light.png"
/>
<img
className="hidden dark:block"
src="/img/playground/play-json-dark.png"
/>
75 changes: 75 additions & 0 deletions playgrounds/columns/prompt.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
---
title: "Prompt Column"
description: "Execute LLM prompts with full model configuration"
---

### Prompt
A Prompt column allows you to define a custom prompt and run it directly on your Playground data.
You can compose prompts with messages (system, user, assistant or developer), insert playground variables, and configure which model to use.
Each row in your playground will be passed through the prompt, and the model’s response will be stored in the column.

<Info>
Prompt columns make it easy to test different prompts against real data, compare model outputs side by side.
</Info>

<img
className="block dark:hidden"
src="/img/playground/play-prompt-column-light.png"
style={{maxWidth: '400'}}
/>
<img
className="hidden dark:block"
src="/img/playground/play-prompt-column-dark.png"
style={{maxWidth: '400'}}
/>
Comment on lines +15 to +24
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Fix invalid inline styles and add alt text for accessibility (image 1/2 block).

style={{maxWidth: '400'}} is invalid CSS (string without unit). Use a number (interpreted as px) or a string with unit. Also add alt text.

-<img
-  className="block dark:hidden"
-  src="https://github.com/img/playground/play-prompt-column-light.png"
-  style={{maxWidth: '400'}}
-/>
+<img
+  className="block dark:hidden"
+  src="https://github.com/img/playground/play-prompt-column-light.png"
+  alt="Prompt column configuration in light mode"
+  style={{ maxWidth: 400 }}
+/>

-<img 
-  className="hidden dark:block" 
-  src="https://github.com/img/playground/play-prompt-column-dark.png"
-  style={{maxWidth: '400'}}
-/>
+<img 
+  className="hidden dark:block" 
+  src="https://github.com/img/playground/play-prompt-column-dark.png"
+  alt="Prompt column configuration in dark mode"
+  style={{ maxWidth: 400 }}
+/>
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-prompt-column-light.png"
style={{maxWidth: '400'}}
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-prompt-column-dark.png"
style={{maxWidth: '400'}}
/>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-prompt-column-light.png"
alt="Prompt column configuration in light mode"
style={{ maxWidth: 400 }}
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-prompt-column-dark.png"
alt="Prompt column configuration in dark mode"
style={{ maxWidth: 400 }}
/>
🧰 Tools
🪛 LanguageTool

[grammar] ~15-~15: There might be a mistake here.
Context: ...odel outputs side by side. <img className="block dark:hidden" src="/im...

(QB_NEW_EN)


[grammar] ~16-~16: There might be a mistake here.
Context: ...o> <img className="block dark:hidden" src="/img/playground/play-prompt-column-...

(QB_NEW_EN)


[grammar] ~17-~17: There might be a mistake here.
Context: ...playground/play-prompt-column-light.png" style={{maxWidth: '400'}} /> <img cla...

(QB_NEW_EN)


[grammar] ~18-~18: There might be a mistake here.
Context: ...n-light.png" style={{maxWidth: '400'}} /> <img className="hidden dark:block"...

(QB_NEW_EN)


[grammar] ~19-~19: There might be a mistake here.
Context: ...ight.png" style={{maxWidth: '400'}} /> <img className="hidden dark:block" ...

(QB_NEW_EN)


[grammar] ~20-~20: There might be a mistake here.
Context: ...ng" style={{maxWidth: '400'}} /> <img className="hidden dark:block" src="/i...

(QB_NEW_EN)


[grammar] ~21-~21: There might be a mistake here.
Context: ...> <img className="hidden dark:block" src="/img/playground/play-prompt-column-...

(QB_NEW_EN)


[grammar] ~22-~22: There might be a mistake here.
Context: .../playground/play-prompt-column-dark.png" style={{maxWidth: '400'}} /> ## Prompt ...

(QB_NEW_EN)


[grammar] ~23-~23: There might be a mistake here.
Context: ...mn-dark.png" style={{maxWidth: '400'}} /> ## Prompt Writing Write your prompt...

(QB_NEW_EN)

🤖 Prompt for AI Agents
In playgrounds/columns/prompt.mdx around lines 15 to 24, the inline style uses
an invalid value style={{maxWidth: '400'}} and both img tags lack alt text;
change the maxWidth to a valid value (either a number like maxWidth: 400 which
is treated as px, or a string with units like '400px' or '25rem') and add
descriptive alt attributes for each image to satisfy accessibility requirements.


## Prompt Writing

Write your prompt messages by selecting a specific role—System, User, Assistant, or Developer.

You can insert variables into the prompt using curly brackets (e.g., `{{variable_name}}`). These variables can then be mapped to existing column data, allowing your prompt to dynamically adapt to the playground


<img
className="block dark:hidden"
src="/img/playground/play-prompt-write-light.png"
style={{maxWidth: '400'}}
/>
<img
className="hidden dark:block"
src="/img/playground/play-prompt-write-dark.png"
style={{maxWidth: '400'}}
/>
Comment on lines +33 to +42
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Fix invalid inline styles and add alt text for accessibility (image 2/2 block).

-<img
-  className="block dark:hidden"
-  src="https://github.com/img/playground/play-prompt-write-light.png"
-  style={{maxWidth: '400'}}
-/>
+<img
+  className="block dark:hidden"
+  src="https://github.com/img/playground/play-prompt-write-light.png"
+  alt="Prompt message editor in light mode"
+  style={{ maxWidth: 400 }}
+/>

-<img 
-  className="hidden dark:block" 
-  src="https://github.com/img/playground/play-prompt-write-dark.png"
-  style={{maxWidth: '400'}}
-/>
+<img 
+  className="hidden dark:block" 
+  src="https://github.com/img/playground/play-prompt-write-dark.png"
+  alt="Prompt message editor in dark mode"
+  style={{ maxWidth: 400 }}
+/>
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-prompt-write-light.png"
style={{maxWidth: '400'}}
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-prompt-write-dark.png"
style={{maxWidth: '400'}}
/>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-prompt-write-light.png"
alt="Prompt message editor in light mode"
style={{ maxWidth: 400 }}
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-prompt-write-dark.png"
alt="Prompt message editor in dark mode"
style={{ maxWidth: 400 }}
/>
🧰 Tools
🪛 LanguageTool

[grammar] ~33-~33: There might be a mistake here.
Context: ...namically adapt to the playground <img className="block dark:hidden" src="/im...

(QB_NEW_EN)


[grammar] ~34-~34: There might be a mistake here.
Context: ...d <img className="block dark:hidden" src="/img/playground/play-prompt-write-l...

(QB_NEW_EN)


[grammar] ~35-~35: There might be a mistake here.
Context: .../playground/play-prompt-write-light.png" style={{maxWidth: '400'}} /> <img cla...

(QB_NEW_EN)


[grammar] ~36-~36: There might be a mistake here.
Context: ...e-light.png" style={{maxWidth: '400'}} /> <img className="hidden dark:block"...

(QB_NEW_EN)


[grammar] ~37-~37: There might be a mistake here.
Context: ...ight.png" style={{maxWidth: '400'}} /> <img className="hidden dark:block" ...

(QB_NEW_EN)


[grammar] ~38-~38: There might be a mistake here.
Context: ...ng" style={{maxWidth: '400'}} /> <img className="hidden dark:block" src="/i...

(QB_NEW_EN)


[grammar] ~39-~39: There might be a mistake here.
Context: ...> <img className="hidden dark:block" src="/img/playground/play-prompt-write-d...

(QB_NEW_EN)


[grammar] ~40-~40: There might be a mistake here.
Context: ...g/playground/play-prompt-write-dark.png" style={{maxWidth: '400'}} /> ## Configu...

(QB_NEW_EN)


[grammar] ~41-~41: There might be a mistake here.
Context: ...te-dark.png" style={{maxWidth: '400'}} /> ## Configuration Options ### Model ...

(QB_NEW_EN)

🤖 Prompt for AI Agents
In playgrounds/columns/prompt.mdx around lines 33 to 42, the two <img> elements
use an invalid inline style value (style={{maxWidth: '400'}}) and the second
image is missing alt text; update both imgs to use a valid CSS value (e.g.
style={{maxWidth: '400px'}} or style={{maxWidth: 400}}) and add descriptive alt
attributes for accessibility (e.g. alt="Playground prompt write — light" and
alt="Playground prompt write — dark"). Ensure both images include alt text and
use the same valid style format.


## Configuration Options

### Model Selection
Choose from supported LLM providers and models:
- **OpenAI**: GPT-5, GPT-5-Mini, GPT-5-Nano, GPT-4o, GPT-4o-mini and more
- **Anthropic**: Claude-3-Opus, Claude-3-5-Sonnet, Claude-3-5-Haiku and more
- **Gemini**: Gemini-2.5-Flash, Gemini-2.5-Pro and more

Comment on lines +46 to +51
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Verification agent

❓ Verification inconclusive

Avoid hardcoding model names that may change; switch to durable wording and gate by provider availability.

Listing “GPT‑5/GPT‑5‑Mini/Nano” is risky and may go stale or be incorrect by the time readers see this. Prefer durable guidance and defer to the model picker.

Proposed copy:

-### Model Selection
-Choose from supported LLM providers and models:
-- **OpenAI**: GPT-5, GPT-5-Mini, GPT-5-Nano, GPT-4o, GPT-4o-mini and more
-- **Anthropic**: Claude-3-Opus, Claude-3-5-Sonnet, Claude-3-5-Haiku and more
-- **Gemini**: Gemini-2.5-Flash, Gemini-2.5-Pro and more
+### Model Selection
+Choose from the models available in your workspace’s configured providers. The exact list changes over time and may vary by region and account. Use the model picker to see the latest options for:
+- OpenAI
+- Anthropic
+- Google Gemini

If you prefer keeping examples, please verify current public model names first:


🌐 Web query:

What OpenAI chat/completions models are currently available and publicly documented?

Error during web search


🌐 Web query:

What Claude 3.x/3.5 models are currently available and publicly documented by Anthropic?

Error during web search


🌐 Web query:

What Gemini 2.x models are currently available and publicly documented by Google?

Error during web search


Update Model Selection to Use Durable Wording

Hard-coding specific model names in the prompt documentation risks going out of date. Instead, defer to the live model picker so users always see the most current, region- and account-specific options.

Please revise playgrounds/columns/prompt.mdx around lines 46–51 as follows:

### Model Selection
- Choose from supported LLM providers and models:
- - **OpenAI**: GPT-5, GPT-5-Mini, GPT-5-Nano, GPT-4o, GPT-4o-mini and more
- - **Anthropic**: Claude-3-Opus, Claude-3-5-Sonnet, Claude-3-5-Haiku and more
- - **Gemini**: Gemini-2.5-Flash, Gemini-2.5-Pro and more
+ Choose from the models available in your workspace’s configured providers. The exact list changes over time and may vary by region and account.
+ Use the model picker to see the latest options for:
+ - OpenAI
+ - Anthropic
+ - Google Gemini

• This ensures the documentation never drifts out of sync with each provider’s current offerings.
• If you still want to show examples, please double-check each provider’s public model list before adding any names.

📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
### Model Selection
Choose from supported LLM providers and models:
- **OpenAI**: GPT-5, GPT-5-Mini, GPT-5-Nano, GPT-4o, GPT-4o-mini and more
- **Anthropic**: Claude-3-Opus, Claude-3-5-Sonnet, Claude-3-5-Haiku and more
- **Gemini**: Gemini-2.5-Flash, Gemini-2.5-Pro and more
### Model Selection
Choose from the models available in your workspace’s configured providers. The exact list changes over time and may vary by region and account.
Use the model picker to see the latest options for:
- OpenAI
- Anthropic
- Google Gemini
🧰 Tools
🪛 LanguageTool

[grammar] ~46-~46: There might be a mistake here.
Context: ...nfiguration Options ### Model Selection Choose from supported LLM providers and ...

(QB_NEW_EN)


[grammar] ~47-~47: There might be a mistake here.
Context: ...from supported LLM providers and models: - OpenAI: GPT-5, GPT-5-Mini, GPT-5-Nano,...

(QB_NEW_EN)


[grammar] ~48-~48: There might be a mistake here.
Context: ...GPT-5-Nano, GPT-4o, GPT-4o-mini and more - Anthropic: Claude-3-Opus, Claude-3-5-S...

(QB_NEW_EN)


[grammar] ~49-~49: There might be a mistake here.
Context: ...de-3-5-Sonnet, Claude-3-5-Haiku and more - Gemini: Gemini-2.5-Flash, Gemini-2.5-P...

(QB_NEW_EN)

🤖 Prompt for AI Agents
In playgrounds/columns/prompt.mdx around lines 46 to 51, the model list
hard-codes specific provider model names which can quickly go out of date;
replace the static list with durable wording that directs users to the live
model picker (or the provider’s current model list), e.g., a sentence like
“Select from available models via the live model picker (options vary by
region/account)” and, if you must keep examples, remove or verify exact model
names against each provider’s public docs before adding them; update the copy
accordingly so the doc defers to the dynamic picker rather than listing explicit
models.

### Structured Output
Structured output can be enabled for models that support it. You can define a schema either by writing a JSON structure in the JSON editor or by using the Visual editor to add parameters, specifying their names and types.

## Tools
Tools let you extend prompts by allowing the model to call custom functions with structured arguments. Instead of plain text, the model can return a validated tool-call object that follows your schema.

To create a tool, give it a name and description so the model knows when to use it. Then define its parameters with a name, description, type (string, number, boolean, etc.), and whether they are required.
### Advanced Settings
Fine-tune model behavior options:
- **Temperature** (0.0-1.0): Control randomness and creativity
- **Max Tokens**: Limit model output length (1-8000+ depending on model)
- **Top P**: Nucleus sampling parameter (0.0-1.0)
- **Frequency Penalty**: Reduce repetition (0.0 to 1.0)
- **Presence Penalty**: Encourage topic diversity (0.0 to 1.0)
- **Logprobs**: When enabled, returns the probability scores for generated tokens
- **Thinking Budget** (512-24576): Sets the number of tokens the model can use for internal reasoning before producing the final output
A higher budget allows more complex reasoning but increases cost and runtime
- **Exclude Reasoning from Response**: If enabled, the model hides its internal reasoning steps and only outputs the final response

Comment on lines +60 to +70
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Gate advanced parameters by model support; remove brittle numeric ranges.

Not all providers support Logprobs/Thinking Budget/Presence/Frequency penalties. Gate with “when supported” and avoid fixed ranges that may be inaccurate.

-### Advanced Settings
-Fine-tune model behavior options:
-- **Temperature** (0.0-1.0): Control randomness and creativity
-- **Max Tokens**: Limit model output length (1-8000+ depending on model)
-- **Top P**: Nucleus sampling parameter (0.0-1.0)
-- **Frequency Penalty**: Reduce repetition (0.0 to 1.0)
-- **Presence Penalty**: Encourage topic diversity (0.0 to 1.0)
-- **Logprobs**: When enabled, returns the probability scores for generated tokens
-- **Thinking Budget** (512-24576): Sets the number of tokens the model can use for internal reasoning before producing the final output
-A higher budget allows more complex reasoning but increases cost and runtime
-- **Exclude Reasoning from Response**: If enabled, the model hides its internal reasoning steps and only outputs the final response
+### Advanced Settings
+Fine‑tune model behavior (availability varies by provider/model):
+- **Temperature**: Controls randomness/creativity.
+- **Max tokens**: Limits the length of the model’s output.
+- **Top‑p**: Nucleus sampling parameter.
+- **Frequency/Persistence penalties**: Reduce repetition or encourage topic diversity (when supported).
+- **Logprobs**: Return token‑level probabilities (when supported).
+- **Reasoning budget**: Caps tokens used for internal reasoning before producing the final output (when supported). Higher budgets can improve reasoning at increased cost/latency.
+- **Hide reasoning in response**: Return only the final answer, omitting internal reasoning traces (when supported).

If you want to keep exact ranges/provider matrices, I can add a table keyed by provider/model.

📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
Fine-tune model behavior options:
- **Temperature** (0.0-1.0): Control randomness and creativity
- **Max Tokens**: Limit model output length (1-8000+ depending on model)
- **Top P**: Nucleus sampling parameter (0.0-1.0)
- **Frequency Penalty**: Reduce repetition (0.0 to 1.0)
- **Presence Penalty**: Encourage topic diversity (0.0 to 1.0)
- **Logprobs**: When enabled, returns the probability scores for generated tokens
- **Thinking Budget** (512-24576): Sets the number of tokens the model can use for internal reasoning before producing the final output
A higher budget allows more complex reasoning but increases cost and runtime
- **Exclude Reasoning from Response**: If enabled, the model hides its internal reasoning steps and only outputs the final response
### Advanced Settings
Fine-tune model behavior (availability varies by provider/model):
- **Temperature**: Controls randomness/creativity.
- **Max tokens**: Limits the length of the model’s output.
- **Top-p**: Nucleus sampling parameter.
- **Frequency/Persistence penalties**: Reduce repetition or encourage topic diversity (when supported).
- **Logprobs**: Return token-level probabilities (when supported).
- **Reasoning budget**: Caps tokens used for internal reasoning before producing the final output (when supported). Higher budgets can improve reasoning at increased cost/latency.
- **Hide reasoning in response**: Return only the final answer, omitting internal reasoning traces (when supported).

## Prompt Execution

A prompt can be executed across all cells in a column or on a specific cell.

Prompt outputs can be mapped to different columns by clicking a cell and selecting the mapping icon, or by double-clicking the cell
54 changes: 54 additions & 0 deletions playgrounds/quick-start.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
---
title: "Quick Start"
---

Playgrounds are interactive spreadsheet where you can organize your data and experiment with LLMs, evaluate outputs, and analyze data.
Think of them as powerful workbenches for AI development that combine the flexibility of a spreadsheet with the power of LLM evaluation and execution.
It’s designed for everyone, from product managers and analysts to QA, data engineers, and software developers.
Comment on lines +5 to +7
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Fix subject–verb agreement and pronoun consistency.

Switch “spreadsheet” to plural or change the subject to singular. Also align “It’s” with plural “Playgrounds”.

-Playgrounds are interactive spreadsheet where you can organize your data and experiment with LLMs, evaluate outputs, and analyze data. 
-Think of them as powerful workbenches for AI development that combine the flexibility of a spreadsheet with the power of LLM evaluation and execution.
-It’s designed for everyone, from product managers and analysts to QA, data engineers, and software developers.
+Playgrounds are interactive spreadsheets where you can organize your data, experiment with LLMs, evaluate outputs, and analyze results.
+Think of them as powerful workbenches for AI development that combine the flexibility of a spreadsheet with LLM evaluation and execution.
+They’re designed for everyone—from product managers and analysts to QA, data engineers, and software developers.
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
Playgrounds are interactive spreadsheet where you can organize your data and experiment with LLMs, evaluate outputs, and analyze data.
Think of them as powerful workbenches for AI development that combine the flexibility of a spreadsheet with the power of LLM evaluation and execution.
It’s designed for everyone, from product managers and analysts to QA, data engineers, and software developers.
Playgrounds are interactive spreadsheets where you can organize your data, experiment with LLMs, evaluate outputs, and analyze results.
Think of them as powerful workbenches for AI development that combine the flexibility of a spreadsheet with LLM evaluation and execution.
They’re designed for everyonefrom product managers and analysts to QA, data engineers, and software developers.
🧰 Tools
🪛 LanguageTool

[grammar] ~5-~5: There might be a mistake here.
Context: ...Ms, evaluate outputs, and analyze data. Think of them as powerful workbenches fo...

(QB_NEW_EN)


[grammar] ~6-~6: There might be a mistake here.
Context: ...e power of LLM evaluation and execution. It’s designed for everyone, from product...

(QB_NEW_EN)

🤖 Prompt for AI Agents
In playgrounds/quick-start.mdx around lines 5–7, fix subject–verb agreement and
pronoun consistency: either make "spreadsheet" plural and change "It’s" to
"They’re" (and adjust verbs to plural) or make the subject singular (e.g., "A
playground is an interactive spreadsheet...") and keep "It’s" — update the
surrounding verbs and pronouns so number matches (plural subjects use
"are"/"they"; singular use "is"/"it").


<Frame>
<img
className="block dark:hidden"
src="/img/playground/play-list-light.png"
/>
<img className="hidden dark:block" src="/img/playground/play-list-dark.png" />
</Frame>
Comment on lines +9 to +15
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Add alt text to images for accessibility.

 <Frame>
   <img
     className="block dark:hidden"
     src="https://github.com/img/playground/play-list-light.png"
+    alt="Playgrounds list in light mode"
   />
-  <img className="hidden dark:block" src="https://github.com/img/playground/play-list-dark.png" />
+  <img className="hidden dark:block" src="https://github.com/img/playground/play-list-dark.png" alt="Playgrounds list in dark mode" />
 </Frame>
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
<Frame>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-list-light.png"
/>
<img className="hidden dark:block" src="/img/playground/play-list-dark.png" />
</Frame>
<Frame>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-list-light.png"
alt="Playgrounds list in light mode"
/>
<img className="hidden dark:block" src="/img/playground/play-list-dark.png" alt="Playgrounds list in dark mode" />
</Frame>
🤖 Prompt for AI Agents
In playgrounds/quick-start.mdx around lines 9 to 15, the two <img> tags lack alt
attributes which hurts accessibility; add meaningful alt text to each image
(e.g., alt="Play list screenshot — light theme" for the light image and
alt="Play list screenshot — dark theme" for the dark image) so screen readers
can describe the images, keeping existing className and src attributes
unchanged.


## Playground Structure

A playground is organized as a table-like structure with three fundamental components: **rows**, **columns**, and **cells**. Understanding how these work together is essential for effective playground usage.

### Rows

Rows represent individual **data points** or **test cases** in your playground. Each row is a complete record that spans across all columns.

### Row Characteristics
Each row in the Playground is independent and can be executed on its own, maintains an order that can be rearranged as needed.

### Row Operations
- **Add Row**: Create new rows manually or through bulk operations
- **Delete Row**: Remove unwanted rows individually or in bulk
- **Duplicate Row**: Copy existing rows to create variations
- **Reorder Rows**: Drag and drop to change row order
- **Generate Rows**: Use AI to generate multiple similar rows based on patterns

## Create A Playground

Data can be imported from different sources:

1. CSV files
2. JSON file
3. From A Dataset
4. From production spans

You can create a Playground from scratch and import data later. Simply set a name for the Playground and start adding columns, rows, and data.
<Frame style={{margin: '80px'}}>
<img
className="block dark:hidden"
src="/img/playground/play-empty-table-light.png"
/>
<img className="hidden dark:block" src="/img/playground/play-empty-table-dark.png" />
</Frame>
Comment on lines +44 to +51
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Add alt text to empty‑table images for accessibility.

 <Frame style={{margin: '80px'}}>
   <img
     className="block dark:hidden"
     src="https://github.com/img/playground/play-empty-table-light.png"
+    alt="Empty Playground table in light mode"
   />
-  <img className="hidden dark:block" src="https://github.com/img/playground/play-empty-table-dark.png" />
+  <img className="hidden dark:block" src="https://github.com/img/playground/play-empty-table-dark.png" alt="Empty Playground table in dark mode" />
 </Frame>
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
You can create a Playground from scratch and import data later. Simply set a name for the Playground and start adding columns, rows, and data.
<Frame style={{margin: '80px'}}>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-empty-table-light.png"
/>
<img className="hidden dark:block" src="/img/playground/play-empty-table-dark.png" />
</Frame>
<Frame style={{margin: '80px'}}>
<img
className="block dark:hidden"
src="https://github.com/img/playground/play-empty-table-light.png"
alt="Empty Playground table in light mode"
/>
<img
className="hidden dark:block"
src="https://github.com/img/playground/play-empty-table-dark.png"
alt="Empty Playground table in dark mode"
/>
</Frame>
🤖 Prompt for AI Agents
In playgrounds/quick-start.mdx around lines 44 to 51, the two img elements for
the empty-table screenshots are missing alt attributes which harms
accessibility; add meaningful alt text (e.g., "Empty Playground table — light
theme" and "Empty Playground table — dark theme") to the respective img tags so
screen readers can describe the images, and ensure the alt strings are concise
and contextually accurate.



Ready to build more sophisticated playgrounds? Dive into the [complete documentation](./index) or explore specific [column types](./columns/data-columns) to unlock the full power of Traceloop Playgrounds!