Local File Inspection
You have qwen-mm-plugins-core MCP tools available. Use them to read and visualize supported local files, inspect media metadata, crop/annotate images, and save document pages or video frames. Prefer these MCP tools over manual scripting.
In the default native mode, these tools return text and images for the agent to inspect without a model API call. With QWEN_MM_NATIVE_MODE=0, the shared caption fallback sends image results to the configured VL endpoint and returns text captions.
Check the qwen-mm-plugins-core tools in your tool list for full schemas and parameters.
When to Use Which Tool
Reading and inspection:
- Inspect metadata FIRST for any video/audio (duration, resolution, fps, codecs, bitrate, audio/video/subtitle tracks, rotation, chapters) →
media_info. Run it beforeread_videoand before any clip/edit — see Metadata first below. - See a file (PDF, Office, CSV, code, notebook, 3D, ...) →
visualize - Read an image with dynamic resolution →
read_image - Read a video (extract frames) →
read_video - Save specific frame(s) of a video to file →
save_view(passtimes=[...]) - Save document page(s) as images →
save_view(passpages="...")
Producing / annotating (writes an image file):
- Crop a rectangular region from an image →
crop - Photo coordinates:
read_image,crop, anddraw_bboxapply EXIF orientation. Use 0–1000 coordinates in the displayed image, including boxes returned bygrounding. - Draw bounding boxes on an image →
draw_bbox
Visualize — Supported Formats
| Category | Extensions | Notes |
|---|---|---|
| Documents | .pdf, .svg | Built-in (pypdfium2 + resvg) |
| Office | .docx, .pptx, .vsdx | Needs libreoffice |
| Data | .csv, .xlsx | Text table + chart image |
| Code | .js, .ts, .py, .go, .rs, .md, ... | Returns text (markdown code block) |
| Plain text | .txt, .text, .log | Returns text (fenced block) |
| Web pages | .html, .htm, .mhtml | Screenshot; needs playwright |
| Diagrams | .drawio | XML → SVG rendering |
| Subtitles | .srt, .vtt | Returns text |
| 3D Models | .obj, .stl, .glb, .gltf, .fbx, .ply, .step, .stp | Built-in; blender for best quality |
| Medical volumes | .nii, .nii.gz | Local/read-only (nibabel); 3 center slices; 4D pages selects volumes (default 1) |
| GIS/Geo | .geojson, .kml, .shp | Built-in |
| Notebooks | .ipynb | Text cells + embedded images |
| LaTeX | .tex | Compiles to PDF; falls back to source on failure |
| Images/Videos | .jpg, .mp4, ... | Delegates to read_image/read_video |
The table lists supported formats; files with unknown extensions return an unsupported-type error.
Use pages for page ranges, budget for resolution, max_pages to cap output.
NIfTI uses closest-canonical voxel axes without resampling and is intended for inspection, not clinical diagnosis.