dsh-tool-see-image

Glad to make a plugin for #deepseekharness （or #dsh）.

Give a text-only model (e.g. deepseek-v4-flash) the ability to "see" images: the see_image tool sends an image file to a configurable vision model (default: Zhipu GLM-4V-Flash, free), which describes it in text; the text-only model relays that description back to you.

How it works

You: "Look at this image" ──►  Text-only model (no vision)
                                  │ calls see_image(path, question)
                                  ▼
                             This plugin (Host plane)
                                  │ 1. ctx.fs resolves & reads the image (sandbox/observation policy aware)
                                  │ 2. encodes it as a base64 data URL
                                  │ 3. POST {baseURL}/chat/completions (OpenAI-compatible)
                                  ▼
                             Vision model (GLM-4V-Flash)
                                  │ text description
                                  ▼
                             Text-only model ──► reports to you

Install (DSH web profile)

1. Copy the plugin into your profile directory, e.g. $DSH_HOME/profiles/web/plugins/dsh-tool-see-image/ ($DSH_HOME is usually ~/.dsh).

2. Declare the dependency in $DSH_HOME/profiles/web/package.json:

   "dsh-tool-see-image": "file:plugins/dsh-tool-see-image"
   

   Then run pnpm install (creates a junction to the source under profiles/node_modules).

3. Compose it into the profile in $DSH_HOME/profiles/web/cordis.patch.yml:

   - insert:
       - id: tool-see-image
         name: 'dsh-tool-see-image'
         config:
           baseURL: https://open.bigmodel.cn/api/paas/v4
           apiKeyEnv: ZHIPU_API_KEY
           model: glm-4v-flash
   

4. Set your API key: create one at the Zhipu (bigmodel) console (format id.secret), then set the environment variable (Windows example):

   setx ZHIPU_API_KEY "your-key"
   

   Restart your terminal, then restart dsh web (the web profile does not hot-reload patch layers yet — tested).

5. Verify: in a new session the see_image tool should appear. Try it:

   Use see_image to look at path/to/your/image.png
   

Configuration (tool-see-image line in cordis.patch.yml)

Key	Default	Description
baseURL	https://open.bigmodel.cn/api/paas/v4	OpenAI-compatible endpoint; the plugin appends /chat/completions
apiKeyEnv	ZHIPU_API_KEY	Env var name that holds the API key
model	glm-4v-flash	Vision model id (free on Zhipu)
maxTokens	1024	Max output tokens. Note: glm-4v-flash caps at 1024 (higher returns 400 max_tokens参数非法; raise it if you switch to a bigger model)
timeoutMs	60000	Request timeout
maxBytes	15728640 (15MB)	Per-image size limit
prompt	(Chinese detailed-description instruction)	Default question; the question argument takes precedence

To use a different vision API, change these three keys, e.g. SiliconFlow:

config:
  baseURL: https://api.siliconflow.cn/v1
  apiKeyEnv: SILICONFLOW_API_KEY
  model: Qwen/Qwen2.5-VL-32B-Instruct

Uninstall / rollback

…