feat(image): integrate PoloX image editing workflows

Add WaveSpeed image editing and image tools plugins, canvas image editing workflows, layer selection, and Cloud Agent image tools with approval-safe transient references.
This commit is contained in:
Codex
2026-09-18 20:34:28 +08:00
parent c7c37f2d4f
commit 6abaa7b45a
34 changed files with 2537 additions and 75 deletions

View File

@@ -0,0 +1,29 @@
# WaveSpeed Image Edit
WaveSpeed 图片编辑协议插件(异步任务式):把 WaveSpeed 平台的图片编辑模型以 provider 形式接入影策画布,现有画布与已接入渠道可直接调用。
## 接入的模型端点(编辑类)
| 端点 ID | 模型 | 说明 |
| --- | --- | --- |
| `openai/gpt-image-2.5-sunburst/edit` | GPT Image 2.5 Sunburst | 高质量编辑,支持多图参考(≤16) |
| `openai/gpt-image-2.5-flare/edit` | GPT Image 2.5 Flare | 快速编辑,支持多图参考(≤16) |
| `bytedance/seedream-v5.0-pro/edit` | Seedream 5.0 Pro | 编辑与图层分解(≤10 图) |
| `google/nano-banana-2/edit` | Nano Banana 2 | 编辑(≤10 图) |
| `google/nano-banana-2-lite/edit` | Nano Banana 2 Lite | 轻量编辑 |
| `google/nano-banana-pro/edit` | Nano Banana Pro | 编辑 |
## 接入的模型端点(工具类)
| 端点 ID | 模型 | 说明 |
| --- | --- | --- |
| `bria/remove-background` | BRIA | 去背景 |
| `bytedance/seedream-v5.0-pro/layer-decomposition` | Seedream 5.0 Pro | 图层拆分 |
## 使用方式
1. 在画布设置中安装本插件,填入 WaveSpeed API Key。
2. 创建图片节点时选择「WaveSpeed Image Edit」渠道,模型选上述端点 ID。
3. 提供编辑提示词与源图,等待异步任务完成即可。
完整接口见 [docs/interface.md](docs/interface.md)。

View File

@@ -0,0 +1,297 @@
# WaveSpeed Image Edit 接口字段
## 协议身份
- 插件 ID:`wavespeed-image-edit`。
- Provider ID:`wavespeed-image-edit`。
- 能力:`image`。
- 默认 Base URL:`https://api.wavespeed.ai/api/v3`。
- 鉴权驱动:`bearer`。
- 创建:`POST /{{model}}`(model 为 WaveSpeed 图片编辑端点,如 `openai/gpt-image-2.5-sunburst/edit`)。
- 生命周期:异步任务(create 返回 task id,poll 轮询结果)。
## 配置字段
| 字段 | 类型 | 必填 | 含义 |
| --- | --- | --- | --- |
| `apiKey` | secret | 是 | WaveSpeed API Key |
## 统一字段映射
| 统一字段 | 类型 | 必填 | 上游映射 | 说明 |
| --- | --- | --- | --- | --- |
| `model` | string | 是 | `model` | WaveSpeed 图片编辑模型端点 ID。 |
| `prompt` | string | 是 | `prompt` | 编辑提示词。 |
| `images` | media[] | 否 | `images` | 编辑源图或参考图,按数组顺序透传 URL。 |
| `imageCount` | integer | 否 | `n/sample_count` | 输出数量(WaveSpeed 多数编辑模型不支持,留空)。 |
| `aspectRatio` | string | 否 | `aspect_ratio` | 比例或尺寸,如 `1:1`、`16:9`。 |
| `resolution` | string | 否 | `resolution/imageSize` | 分辨率档位(编辑模型一般不支持,留空)。 |
| `quality` | string | 否 | `quality` | 质量档位:`low` / `medium` / `high`。 |
| `providerOptions` | object | 否 | `provider-specific fields` | 插件命名空间内的厂商扩展字段。 |
## 上游请求模板逐字段清单
下表由插件请求模板生成,覆盖 body、query、headers 和 multipart 文件声明中的每个字段。
| 上游位置 | 值或转换表达式 |
| --- | --- |
| `create.method` | `"POST"` |
| `create.path` | `"/{{model}}"` |
| `create.contentType` | `"application/json"` |
| `create.body.prompt` | `{"$ref":"request.prompt"}` |
| `create.body.images` | `{"$map":{"from":{"$ref":"request.images"},"as":"media","in":{"$ref":"media.value"}}}` |
| `create.body.aspect_ratio` | `{"$omitEmpty":{"$ref":"request.aspectRatio"}}` |
| `create.body.quality` | `{"$omitEmpty":{"$ref":"request.quality"}}` |
| `create.body.output_format` | `{"$omitEmpty":{"$coalesce":[{"$ref":"request.providerOptions.wavespeed-image-edit.output_format"},"png"]}}` |
| `create.body.enable_base64_output` | `{"$omitEmpty":{"$ref":"request.providerOptions.wavespeed-image-edit.enable_base64_output"}}` |
| `create.body.enable_sync_mode` | `{"$omitEmpty":{"$ref":"request.providerOptions.wavespeed-image-edit.enable_sync_mode"}}` |
| `poll.method` | `"GET"` |
| `poll.path` | `"/predictions/{{taskId}}/result"`(taskId 来自 create 响应 `data.id`) |
| `poll.contentType` | `"application/json"` |
## Provider 扩展键
- `providerOptions.wavespeed-image-edit.output_format`
- `providerOptions.wavespeed-image-edit.enable_base64_output`
- `providerOptions.wavespeed-image-edit.enable_sync_mode`
动态模型或工作流允许使用文档声明的完整 `parameters/input/extra_body` 对象;该对象是协议本身的开放 schema,不会被宿主裁剪。
## 响应映射逐字段清单
| 映射位置 | 上游路径或转换表达式 |
| --- | --- |
| `response.taskId` | `{"$coalesce":[{"$ref":"response.data.id"},{"$ref":"response.id"}]}` |
| `response.status` | `{"$coalesce":[{"$ref":"response.data.status"},{"$ref":"response.status"},"pending"]}` |
| `response.message` | `{"$coalesce":[{"$ref":"response.data.error"},{"$ref":"response.data.message"},{"$ref":"response.error.message"},{"$ref":"response.message"}]}` |
| `response.images` | `{"$ref":"response.data.outputs"}` |
| `response.errorPaths[0]` | `"error.code"` |
| `response.resultEphemeral` | `true` |
WaveSpeed 异步任务响应结构:
- create 成功:`{"code":200,"data":{"id":"<taskId>"}}`
- poll 进行中:`{"code":200,"data":{"id":"<taskId>","status":"processing","outputs":null}}`
- poll 完成:`{"code":200,"data":{"id":"<taskId>","status":"completed","outputs":["https://cdn.wavespeed.ai/..."]}}`
- poll 失败:`{"code":200,"data":{"id":"<taskId>","status":"failed","error":"..."}}`
`images` 直接透传 `data.outputs` 字符串数组;宿主把每个字符串识别为结果媒体 URL(同时兼容对象数组取 `url` 字段的写法)。`resultEphemeral` 标记临时媒体 URL,由宿主立即下载持久化。
## 兼容边界
模型字段由所选端点决定:编辑类端点接受 `prompt + images[]`;图层分解端点(`bytedance/seedream-v5.0-pro/layer-decomposition`)接受 `image + prompt`(用 `providerOptions` 传额外字段);去背景端点(`bria/remove-background`)接受 `image`。宿主通过 `request.images` 统一提供源图,模型字段差异由调用方通过 providerOptions 补充。
<!-- YINGCE_MANIFEST_CONTRACT_START -->
## Manifest 完整接口定义
以下 JSON 与插件包内实际 `manifest.json` 逐字段一致,覆盖插件身份、权限、配置、鉴权、参数、校验、创建、Agent、查询、取消、结果下载、响应和 Agent 响应映射。`documentation` 字段的值就是当前完整文档;为避免文档在自身内部无限递归,JSON 中仅用等义占位文本表示正文。
```json
{
"apiVersion": "yingce.plugin/v2",
"id": "wavespeed-image-edit",
"name": "WaveSpeed Image Edit",
"version": "1.0.0",
"author": "WaveSpeed / 影策",
"description": "WaveSpeed 图片编辑协议插件:GPT Image 2.5 / Seedream 5.0 Pro / Nano Banana 的 Image to Image 编辑与图层分解、去背景。",
"permissions": [
"generation.run",
"media.read"
],
"configuration": {
"fields": [
{
"name": "apiKey",
"type": "secret",
"label": "WaveSpeed API Key",
"required": true
}
]
},
"contributes": {
"providers": [
{
"id": "wavespeed-image-edit",
"label": "WaveSpeed Image Edit",
"capabilities": [
"image"
],
"scopes": [
"admin.system-channel",
"user.custom-channel",
"canvas",
"creation",
"agent"
],
"baseUrl": "https://api.wavespeed.ai/api/v3",
"requiresPublicMediaUrls": true,
"auth": {
"type": "bearer",
"field": "apiKey"
},
"parameters": [
{
"name": "model",
"type": "string",
"required": true,
"mapping": "model",
"description": "WaveSpeed 图片编辑模型端点 ID,如 openai/gpt-image-2.5-sunburst/edit、bytedance/seedream-v5.0-pro/edit、google/nano-banana-2/edit。"
},
{
"name": "prompt",
"type": "string",
"required": true,
"mapping": "prompt",
"description": "编辑提示词,描述对源图的修改。"
},
{
"name": "images",
"type": "media[]",
"required": false,
"mapping": "provider image/reference fields",
"description": "编辑源图或参考图,role 由业务层确定;按数组顺序作为 images 入参。"
},
{
"name": "imageCount",
"type": "integer",
"required": false,
"mapping": "n/sample_count",
"description": "输出数量。"
},
{
"name": "aspectRatio",
"type": "string",
"required": false,
"mapping": "size/aspect_ratio",
"description": "比例或尺寸,如 1:1、16:9、9:16、4:3、3:4。"
},
{
"name": "resolution",
"type": "string",
"required": false,
"mapping": "resolution/imageSize",
"description": "分辨率档位。"
},
{
"name": "quality",
"type": "string",
"required": false,
"mapping": "quality",
"description": "质量档位:low/medium/high。"
},
{
"name": "providerOptions",
"type": "object",
"required": false,
"mapping": "provider-specific fields",
"description": "插件命名空间内的厂商扩展字段。"
}
],
"create": {
"method": "POST",
"path": "/{{model}}",
"contentType": "application/json",
"body": {
"prompt": {
"$ref": "request.prompt"
},
"images": {
"$map": {
"from": {
"$ref": "request.images"
},
"as": "media",
"in": {
"$ref": "media.value"
}
}
},
"aspect_ratio": {
"$omitEmpty": {
"$ref": "request.aspectRatio"
}
},
"quality": {
"$omitEmpty": {
"$ref": "request.quality"
}
},
"output_format": {
"$omitEmpty": {
"$coalesce": [
{
"$ref": "request.providerOptions.wavespeed-image-edit.output_format"
},
"png"
]
}
},
"enable_base64_output": {
"$omitEmpty": {
"$ref": "request.providerOptions.wavespeed-image-edit.enable_base64_output"
}
},
"enable_sync_mode": {
"$omitEmpty": {
"$ref": "request.providerOptions.wavespeed-image-edit.enable_sync_mode"
}
}
}
},
"poll": {
"method": "GET",
"path": "/predictions/{{taskId}}/result"
},
"response": {
"taskId": {
"$coalesce": [
{
"$ref": "response.data.id"
},
{
"$ref": "response.id"
}
]
},
"status": {
"$coalesce": [
{
"$ref": "response.data.status"
},
{
"$ref": "response.status"
},
"pending"
]
},
"message": {
"$coalesce": [
{
"$ref": "response.data.error"
},
{
"$ref": "response.data.message"
},
{
"$ref": "response.error.message"
},
{
"$ref": "response.message"
}
]
},
"images": {
"$ref": "response.data.outputs"
},
"errorPaths": [
"error.code"
],
"resultEphemeral": true
}
}
]
},
"documentation": "<当前插件的完整 documentation,由 README.md 与 docs/interface.md 拼接而成;为避免 JSON 递归,此处不重复展开正文。>"
}
```
<!-- YINGCE_MANIFEST_CONTRACT_END -->

File diff suppressed because one or more lines are too long