Runway video Generator
Runway video Generator creates a short video with Runway video models. You can start from a written description alone or from an image you want to animate. The component waits until the video is ready and returns it so you can keep working with it in the flow.
Use it to produce short marketing clips, animate product photos or generate videos in series from a list of descriptions.
When to use it
- Turn a product photo into an animated clip for an ad.
- Create a short video from the copy of a campaign.
- Prepare versions of the same message in different formats (landscape, portrait, square).
- Generate one video for each item of a list, for example one per property in a portfolio.
- Give an agent the ability to create videos when a user asks for one.
Configuration
This component needs a credential of the Runway API service. See Credentials to create one.
| Field | What it does |
|---|---|
| Credential (required) | The credential of the Runway API service. Pick one with Choose an option or create one with Add new credential. |
| Generation Mode | How the video is created: text_to_video (from a description) or image_to_video (from an image). Default: text_to_video. |
| Video Model | The Runway model that creates the video: veo3 in text_to_video, and gen4_turbo or veo3 in image_to_video. Default: veo3. |
| Aspect Ratio | Video format: 16:9, 9:16, 1:1, 4:3 or 3:4. Default: 16:9. If the model does not support the exact format, the closest one it supports is used. |
| Duration (seconds) | Video length in seconds. Default: 5. Some models accept only certain lengths; in that case one the model accepts is used. |
| Prompt | The description of the video you want, up to 512 characters. You can type it or connect a text from another component. |
| Image Files | Appears in image_to_video mode. Connection point for the image you want to animate: an image file or its web address (URL). If you connect several, the first one is used. |
Advanced options
| Field | What it does |
|---|---|
| Seed | A number that fixes the starting point of the generation. With the same number and the same settings you get similar results; leave it empty so each video is different. |
Batch processing
With the Batch Mode switch on, the component runs once for each item of the list you connect to Batch Input and returns all the results together as a list. Parallel Executions sets how many items are processed at the same time (1 to 5). Skip if Empty Batch Input skips the component when the list arrives empty, and Skip Branch if Empty Output stops the following components when the result is empty. More in Key concepts.
Using it as an agent tool
You can connect this component to an agent’s Tools input. In the Tool tab, Tool Name and Tool Description are the name and explanation the agent uses to recognise the tool and decide when to call it: write a clear description of what it does.
Output
- Video: the generated video in MP4 format, with its file name. Pass it to the next components of the flow to save it, send it or keep processing it.
- Tool: the component as a tool, to connect to an agent’s Tools input. When the agent uses it, the video is saved with the conversation and the agent receives its name and the link to watch it.
Example
The estate agency Casas del Turia wants an animated clip of the front of each new home:
- Add Runway video Generator and choose the Runway API credential.
- Choose
image_to_videoin Generation Mode and one of the models in Video Model. - Connect the photo of the front of the house to Image Files.
- In Prompt, write: “Slow camera movement towards the entrance, afternoon light, trees moving in the breeze”.
- Choose
16:9in Aspect Ratio and run the flow. Connect Video to the component that saves or sends the file.
Good practices
- Keep the description short and concrete: the limit is 512 characters.
- To animate an image, explain what should move and how the camera moves.
- Try a single video before turning on Batch Mode with a long list: each video uses your Runway account.