mirror of
https://github.com/ggml-org/llama.vscode.git
synced 2026-05-07 01:15:23 +00:00
Page:
Custom eval tool
Pages
Agent commands
Chat with AI about llama vscode
Chat with AI
Code completion
Copilot chat model provider
Custom eval tool
Custom tool
Delete models
Edit agent
Edit with AI
Env
Generate commit message
Health check
Home
How to use
Llama agent
Local ai runner
Manage agents
Manage chat models
Manage chats
Manage completion models
Manage embeddings models
Manage envs
Manage tools models
Mcp support
Menu
Model selection
More context files
Parallel completions
Rules
Skills
Statusbar
Subagents
Update todos tool
Use cases
No results
3
Custom eval tool
igardev edited this page 2025-08-19 15:56:15 +03:00
Table of Contents
Custom eval tool
Overview
llama-vscode provides to the users the posibility to partially create their own tool. Custom eval tool is a simple one - has one parameters and and uses the provided by the user javascript function to calculate the result.
How to use it
Configure the description of the tool, the parameter description and provide a javascript function (one parameter, returns string) to be called when the tool is used.
Settings:
- Tool_custom_tool_eval_description: Description of the tool. This description will be used by the AI to decide if this tool should be used. Example: "Use this tool to check if a number is perfect."
- Tool_custom_eval_tool_property_description: Description of the tool only parameter. This description will be used by the AI to decide what to provide as parameter when using this tool. Example: "a natural number to check if it is perfect or not"
- Tool_custom_eval_tool_code: javascript function with one parameter, which returns string. Could be a path to a file with javascript function. Example: C:\temp\perfectNimber.js
https://github.com/user-attachments/assets/fb12d56f-61e8-409b-b888-0a524167e116
https://github.com/user-attachments/assets/7e928fc3-da14-4834-a414-0f8e23593155