AGENT SKILL

translate-and-dub

Translate one source video's speech into another language with sync. labs (sync.so) and re-sync the speaker's lips to the dubbed audio, from a local file, URL, or YouTube, TikTok, Instagram or Facebook link, into one or several languages. Use for "dub this video into Spanish", "translate my YouTube video to Japanese", AI dubbing, video translation, or a multilingual version of one video. Not for subtitles or captions only, translating a text document, lip-syncing audio the user already has (lipsync), or a whole campaign of several videos across markets (localize-campaign).

License 许可
MIT
最近更新
2026-11-14
Stars
★ 1.6k
Forks
491

01 前言 Front Matter

name
translate-and-dub
license
MIT
description
Translate one source video's speech into another language with sync. labs (sync.so) and re-sync the speaker's lips to the dubbed audio, from a local file, URL, or YouTube, TikTok, Instagram or Facebook link, into one or several languages. Use for "dub this video into Spanish", "translate my YouTube video to Japanese", AI dubbing, video translation, or a multilingual version of one video. Not for subtitles or captions only, translating a text document, lip-syncing audio the user already has (lipsync), or a whole campaign of several videos across markets (localize-campaign).
compatibility
Needs the sync. MCP server or a SYNC_API_KEY. See references/connect.md.

02 资源文件 4

03 SKILL.md 正文

Translate and dub a video

sync. labs | Translation and dubbing guide

Delivers one dubbed MP4 per target language, with lips matched to the new audio. The dubbed voice follows the original speaker's.

If no sync. tools are available, follow references/connect.md first. Without the MCP tools, use dubParams on POST /v2/generate as shown in references/api.md.

Inputs

  • Video: a local file, a public URL, a sync. video asset ID, or a social link. It needs its original speech on the audio track.
  • Target languages: ask if none were given. Use sourceLang: "auto" unless the user names the spoken language.

Tools

Step Tool
Check languages dubbing_get-options
Create the project projects_create
Save the video assets_upload, assets_create-upload-url + assets_create, or assets_create with a link
Quote generations_estimate-cost
Create dubbing_create, or jobs_create-many for 2 or more languages
Wait generations_get, or jobs_get-many for a set

Steps

  1. Languages. Call dubbing_get-options and check every requested language. For any that isn't supported, name the closest supported option.
  2. Project. Call projects_create with a new random UUID as id, a short name and defaultWorkflow: "translate_and_dub". Save the returned id as projectId. Pass it wherever a tool asks for projectId, and add projectIntent: "explicit" only on tools that take that field.
  3. Save the video into that project. Follow references/media-input.md.
  4. Quote. Call generations_estimate-cost with workflow: "translate-and-dub", model: "sync-3" and the video's length as duration in seconds. Show the returned estimate and its breakdown per language and in total. If it reports external provider charges as excluded, say they're extra.
  5. Confirm. Show the video, the languages and the estimate, and wait for approval. Skip the wait only if the user already approved this exact request and cost.
  6. Create. Each language is one dubbing_create with videoAssetId, targetLang, sourceLang, model: "sync-3", the projectId with projectIntent: "explicit", and its own new idempotencyKey, saved before the call.
    • One language: call dubbing_create once. If a response is lost, retry once with the same key and inputs.
    • 2 or more languages, with jobs_create-many listed: save a new UUID for the set, then call jobs_create-many once with tool: "dubbing_create", that UUID as idempotencyKey, and one item per language holding exactly those arguments. The one approval covers every language. If the response is unclear, send the identical call again. When it returns remaining, send remaining again exactly as returned once running languages finish; if the tool refuses a single remaining item, send that language with dubbing_create and the same key. A failed item with a 5xx or no status may still have started, so send it again with the same keys.
    • 2 or more languages without it: call dubbing_create once per language, as for one language.
  7. Wait and deliver. Poll generations_get with each id and wait: true until each is final, or pass the set's jobs to jobs_get-many with wait: true and call it again while some are still running. Dubbing takes longer than plain lipsync, so tell the user it may take several minutes. Give each exact outputMediaUrl, unchanged and labelled with its language.

Rules

  • One paid job per language. Never resubmit a language to check progress.
  • Several source videos across languages or markets is a campaign: hand it to the localize-campaign skill, which plans the matrix and pilots one version first.
  • If one language fails, report it and keep the others.
  • Text on screen isn't translated, and the output is dubbed video only. Don't offer subtitles or a translated transcript as a substitute.
  • If dubbing fails with a voice-provider error and the user connected their own ElevenLabs key to sync., the cause is usually that key's credits or validity. Say so.

04 同仓库更多 Skills

hashgraph-online
hashgraph-online/awesome-codex-plugins

worktable-review-with-annotations

Create, inspect, reply to, update, or resolve situated Worktable annotations. Use when feedback belongs to a Doc section, block, text range, or HTML Doc, or when the user asks to address existing review feedback and coordinate a requested artifact edit.

★ 1.6k
hashgraph-online
hashgraph-online/awesome-codex-plugins

worktable-find-and-synthesize-context

Find, assess, and synthesize context from Worktable Docs and Records. Use when the user asks what a workspace contains, wants workspace-backed research, needs current facts reconciled across artifacts, or requests a cited synthesis without changing workspace state.

★ 1.6k
hashgraph-online
hashgraph-online/awesome-codex-plugins

worktable-create-or-update-docs

Create, edit, rename, or maintain narrative Worktable Docs. Use for plans, decisions, briefs, notes, research syntheses, and other durable prose when the user requests a new artifact or a safe update to an existing one.

★ 1.6k
hashgraph-online
hashgraph-online/awesome-codex-plugins

worktable-create-or-manage-records

Organize repeated structured information as durable Worktable Records. Use for research datasets, inventories, directories, pipelines, trackers, and other collections whose items need identity, fields, filtering, links, validation, or individual updates.

★ 1.6k
hashgraph-online
hashgraph-online/awesome-codex-plugins

worktable-create-or-manage-interactive-html

Create or improve durable visual and interactive artifacts in Worktable. Use for dashboards, trackers, calculators, mini apps, slide presentations, and other requests that benefit from a polished HTML Doc.

★ 1.6k
hashgraph-online
hashgraph-online/awesome-codex-plugins

worktable-collaborate-threads

Read, answer, and hand off messages through durable Worktable threads with users or other authenticated participants. Use when the user asks to check addressed messages, reply to a participant, continue a thread, request another agent's help, wait briefly for a response, or watch for comments and messages sent to the agent.

★ 1.6k