设计与多媒体

gemini-omni

calesthio/openmontage

Generate and conversationally edit short videos with stable Google Gemini Omni Flash (`gemini-omni-1.1-flash`). Use when: (1) iterating on a clip with natural-language edits instead of regenerating ("make the phone invisible, keep everything else the same"), (2) generating 3-10s 720p clips with synthesized audio, rendered on-screen text, or timecoded beats, (3) binding reference images to roles with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags, (4) editing an existing uploaded video. Accessed via the `gemini_omni_video` tool using the project's GEMINI_API_KEY/GOOGLE_API_KEY — the same key as Imagen and Google TTS.

  • 872 次安装
  • 7.3万 星标
  • 收录于

安装命令

npx skills add https://github.com/calesthio/openmontage --skill gemini-omni

SKILL.md

Gemini Omni Flash (Google DeepMind)

Gemini Omni is Google DeepMind's video generation and editing model family. The OpenMontage direct adapter uses the generally available Gemini Omni 1.1 Flash model (gemini-omni-1.1-flash) through the Gemini Interactions API. Its implemented baseline generates 3–10 second clips at 720p/24fps with synthesized audio. Its differentiator in the OpenMontage fleet is stateful conversational editing: each stored generation returns an interaction_id, and a follow-up call with previous_interaction_id edits that video in place — no other wrapped provider can refine a clip without regenerating it.

OpenMontage wraps it as gemini_omni_video (native Gemini API, no gateway). It shares GOOGLE_API_KEY/GEMINI_API_KEY with google_imagen and google_tts — one key, three capabilities. Paid tier only: ~$0.10 per second of output video (exactly 5,792 output tokens/sec at $17.50/1M, before input and any text/thought output).

Other documented routes are available when the direct Google key is not the chosen provider:

Route OpenMontage call Important limitation
fal.ai gemini_omni_fal T2V, I2V, reference video, and edit endpoints; no Google interaction ID is returned
Runway runway_video, model: "gemini_omni_flash" T2V/I2V/V2V; video edits accept up to five image references
ComfyUI Partner Node Not a stable 1.1 fallback in this adapter The existing GeminiVideoOmni mapping targets the legacy preview node; migrate it separately to GeminiVideoOmniV2 before claiming Omni 1.1 support

Use the direct gemini_omni_video route for stateful conversational editing. Gateway routes return ordinary provider tasks and cannot preserve Google's previous_interaction_id workflow. The fal edit endpoint can still be iterated by feeding each output video URL into the next edit call.