Name: Character Creator Workflow
Uploaded: 2025-12-16T22:13:34.673Z
Description: Learn how to use the Character Creator featured Workflow.

Use this quick tutorial to learn how to use Runway's mobile app for iOS.

Use Runway's mobile app for AI generation. Learn how to create videos and images on iOS and Android devices with mobile-optimized features and tools.

Mobile App Tutorial

- Download the Runway app from the App Store app
- Sign into Runway using the same account you use on the web
- Circular purple button will initiate a new generation
- 1 second of video generation = 14 credits
    - To top up credits, click profile icon in the top right corner of the Home page and tap “Credits”
- To create a video, simply hold down the record button and let go when you’re finished
- Three main style settings:
    - Presets by Runway
    - Reference image: click “Add” to choose an image from your library; adjust style strength and seed number here
    - Text prompt
- Hit “Generate” — video will be queued and show a percentage status circle
- Generate new options in the meantime; videos will continue generating in the background
- Generations will be stored in library tab


Using the Mobile App

Runway Mobile

Learn how to seamlessly transition images into one another by using our Frame Interpolation AI Tool.

Generate smooth motion with frame interpolation. Learn how to create slow-motion effects, increase frame rates and produce fluid video using AI technology.

Frame Interpolation Tutorial

- Frame Interpolation works well to create videos with subtle movement from still images
- The more frames you have to work with, the better
- Keep the differences between photos subtle if possible for realistic effect
- Try using Erase and Replace to create new images to interpolate between!


Frame Interpolation

Learn how to create generative images using various AI Tools.

Master generative image workflows in Runway. Learn end-to-end processes for creating, refining and iterating on AI-generated images for professional results.

Image Generation Workflow

- Learn how to create a generative image using AI Tools
- AI Tools used:
    - Text to Image: creates an original generated image from a text-based prompt
    - Erase and Replace: eliminates a specific part of an image and replaces it seamlessly with a new image generated from a new text based prompt
    - Image to Image: uses an image as the input, and generates a brand new image based on both the original and a descriptive text based prompt
- When writing prompts, be descriptive. Include object colors, orientations, and artistic styles in your prompt.
- Refine as you go — the initial output does not have to be perfect. You can slowly work and refine your image with tools like Erase and Replace and Image to Image to gradually get your content to where you want it.


Generative Image Workflow

Learn to create a bespoke image sequence using Image to Image.

Transform images with Image to Image AI. Learn how to restyle, modify and reimagine existing images using advanced AI-powered transformation techniques.

Image to Image Transform

- Remove the background of your video with Green Screen and save as a PNG sequence for the most flexibility down the road
- Open Image to Image and use first frame in the sequence as a test frame
    - Describe the entire scene, touch on style that you want
    - Make sure the look is right — you’ll be committing to it in this workflow
    - Lock seed number and don’t change the prompt for images you like
    - Save to assets to make sure you can find them later
- Select every few frames if you don’t want to select them all
- String the frames together in the video editor


Image to Image

Learn how to use AI Tool Erase and Replace to easily modify images.

Remove and replace image elements with AI. Master techniques for erasing unwanted objects and generating new content in their place using Runway's tools.

Erase & Replace Tutorial

- Head to AI Tools to find Erase and Replace
- Choose an image asset from your computer or asset library
- Adjust brush size using the slider on the right sidebar
- Brush over the portion of the image you’d like to replace
- Enter a text prompt and click “Replace”
- “Add to assets” to add to your Runway asset library
- “Download” to download locally to your computer
- Use “Clear” to generate something new with a new prompt


Erase and Replace

Transform a low resolution image into a high resolution image with Upscale Image.

Upscale images with AI enhancement. Learn how to increase resolution, improve quality and enhance image details using Runway's upscaling technology.

Upscale Image Resolution

- Use Upscale Image to add more detail to increase image resolution
- Upload an image asset
- Select desired size under “Scale” and click “Process”
- That’s all there is to it!
- Download the image or add to your assets by hovering over it and clicking the icons on the top right


Upscale Images

Use this tutorial to learn how to use the Text to Image AI Tool in Runway.

Generate images from text descriptions. Master prompt writing, style control and AI image creation techniques using Runway's text-to-image tools.

Text to Image Generation

- Head to AI Tools to find Text to Image
- Enter a simple text prompt
- Open up “Advanced” under “Settings” sidebar to explore refinement options
    - Size, style, medium, mood, prompt weight
- Prompt weight will determine how much the text prompt is taken into consideration; higher number = most consideration, lower number = least
- Experiment with more complex prompts
- “Add to assets” to save to your Runway asset library
- “Download” to download locally to your computer


Text to Image

Bring still images to life and learn how to create a living portrait in Runway.

Create living portraits with AI animation. Learn how to bring portrait photos to life, add subtle motion and create engaging animated portraits in Runway.

Animate Portrait Photos

Step 1: Brush out and replace the parts of your image you'd like to change using either Erase & Replace or Infinite Image.
Step 2: Head over to Frame Interpolation to animate your various images into a video.
Step 3: Behold the beauty of your new living image.


Create a Living Portrait

AI Tools

Learn about credits and how they’re used in Runway.

Understand how Runway's credit system works. Learn about credit costs, how generations are calculated, purchasing credits, and maximizing your subscription value.

Understanding Credits System

- Runway uses a credit system for generative tools and custom model training
- Your plan tier will determine how many credits are in your account
- To see plan tier and credit balance, head to “Workspace Settings” > “Plans & Billing”
- Only account owners and admins can see these settings
- 1 credit = $.01
    - Image generation: 5 credits per image
    - Gen-1: 14 credits per second
    - Gen-2: 5 credits per second
    - Custom model: 1000 credits per model
- For individual plans, credit balance will refresh every month
    - These allotments do not carry over into the following month(s)
- Additional credits may be purchased at any time
    - Purchased credits do carry over into the following month(s)
- For Enterprise plans, credit balance will refresh every month, but everyone on the team is taking credits from the same pool
    - Each Enterprise team has their own unique credit allotment
    - More credits may also be purchased on Enterprise plans if needed


Generation Credits

Learn about workspaces and how they function within Runway.

Navigate Runway workspaces efficiently. Learn how to organize projects, switch between workspaces, and manage your AI video generation environment effectively.

Workspace Navigation Guide

- When you first sign up for a Runway account, you’ll be assigned a personal workspace, which can be viewed by clicking on the top left icon on the Dashboard
- Invite other members to your workspace to turn it into a team workspace
    - Note: you will be charged on a per person basis for each additional member
- If you’ve been invited to and accepted to a team, you can toggle between teams/workspaces using the top left icon on the Dashboard
- Make sure you are using the correct team workspace since each workspace’s plans and credits may differ


Navigating Workspaces

Learn how to add, organize and share assets in Runway.

Manage assets in Runway effectively. Learn best practices for organizing, tagging, sharing, and maintaining your library of AI-generated videos and images.

Manage Generated Assets

- Navigate to “Assets” and click “Upload”
- Media is labelled by type for easy sorting later
- Folders will automatically be created after using certain AI Tools, like Gen-1 or Gen-2
- View all recent exports, or toggle between “Private” and “Shared” at the top of your Assets screen
- If you’d like to share assets with other members of your team, select the asset(s), right click, and “Move to Team”
- You can always move assets back to “Private”
- To organize assets, you can sort by many different types
- Hold down Shift + click for batch actions, like organizing or deleting


Asset Management

Learn how to navigate the Runway Dashboard.

Navigate Runway's dashboard interface. Learn about key features, tool locations, project management, and how to access all AI generation capabilities efficiently.

Complete Guide to Runway Dashboard

- From the main dashboard homepage, you have access to featured AI Tools, popular AI Tools, tutorials, and community content
- If you click on “view all tools” button, you’ll see the full list of the AI Tools
- Or, you can use the categorized buttons on the left side
- “Projects” is where you’ll find all of your saved Runway projects, including editing timelines, Green Screen clips, and Inpainting clips
- “Shared with me” contains projects that you’ve been specifically invited to
- “Assets” is where all of your uploaded and creative assets will be stored
    - Sort and organize assets with folders and categories
    - Sort assets by type for easier navigation
    - Shift + click to batch organize or delete assets
    - By default, all assets that you create or upload will appear in your “Private” assets
- Dashboard may change slightly over time


Dashboard Overview

Learn how to join a team/workspace in Runway.

Join a Runway team workspace. Learn how to accept invitations, access shared projects, and start collaborating on AI video generation with your team.

Join a Team Workspace

- Once you’ve been invited to a team workspace, you will get an invite to your email inbox
- Log in using Google, Apple, or sign up with Runway
- Team workspace is indicated by top left name and icon on your dashboard


How to Join a Team

Create a team workspace in Runway. Learn how to set up collaborative environments, invite members, and organize team-based AI video generation projects.

Create a Team in Runway

- Click on the “Invite Collaborators” button from the primary account holder’s dashboard
- Enter the emails of the team members you’d like to invite
- Choose from view access, editing access, or admin access
    - can view: can view and download assets, but can’t utilize AI Tools
    - can edit: can access all AI Tools, use credits, and manage projects and assets
    - admin: can adjust workspace roles, adjust billing information, and edit/view assets
- Typical team: 1-2 admins, plus editors
- To change name/profile image, head to “My Workspace Settings”


How to Create a Team

Getting Started

Learn how to use Generative Audio to add speech to your images and videos.

Learn about Runway's generative audio features. Understand AI sound generation, audio-video synchronization and how to create soundscapes for your videos.

AI Audio Generation Overview

- Find Generative Audio on the Runway dashboard
- At the top, you’ll find an area to write anything you want and turn it into a spoken audio file
- After you type out your text, you can preview and choose voices from the default voice menu
- Once you choose a voice, click on the “Generate” button
- Generate times depend on script length, but are generally pretty quick
- Audio generations are automatically saved to the “Generative Audio” folder inside of the main assets folder, but can be saved elsewhere
- Custom Voice training only requires a few minutes of clean audio with no background noise — import or record in Runway
- Finally, to create a Lip Sync video, you’ll need a video or image of a person whose face is fully in the frame
    - upload your own or use one of the characters in the list
    - Lip Sync can be used with generated audio from Text to Speech, recorded audio or uploaded audio
    - choose a voice and click “Generate”
- Tip: turn your image into a video with Gen-2, then upload that video into the Generative Audio tool to add Lip Sync to your video
- If your audio is longer than your video, once your video reaches the end of its duration, it will reverse and go back to the beginning for the duration of the audio
    - avoid using general camera motion controls and instead use Motion Brush, which makes the reverse effect less noticeable


Generative Audio Overview

Audio

Learn how to generate using Styles in Frames.

Use styles with Gen-4 Frames feature. Learn how to apply consistent visual styles, maintain aesthetic continuity and create styled character videos.

Apply Styles in Frames

- Enter a Generative Session, then click on the paint palette icon to access Styles
- Click on any Style to activate it, then enter a prompt into the prompt box
- Simple and long prompts both work well with Styles, with primary focus on the subject and environment
- Choose an aspect ratio, then click “Generate”
- To see the prompt that was used for any of the Styles, click on the top right corner of any of the Styles thumbnails
    - This is helpful to learn what prompt modifiers are being used to create the Style
- To create your own Style, click on “Create,” give it a name, and write the prompt in the prompt box
    - Creating your own Style is a fast and easy way to create images that are in the same stylistic universe, without the need to type the same prompt structure over and over again
    - Focus on stylistic elements (color tones, lighting, shadows, textures, etc.) and avoid things that are too specific, like subject or location details to ensure your Style works for a wide variety of prompts
    - For specific location Styles, be as descriptive and detailed as possible
- Try using Aesthetic Range with Styles to continue exploring new ideas and environments


Using Styles in Frames

Learn how to generate images with Frames.

Generate videos using Frames feature. Master techniques for character consistency, reference-based generation and creating cohesive video sequences.

Generate with Frames

- Open a Generative Session and select the “Image” tab
- Choose aspect ratio, then start prompting
- To get the most out of Frames, it’s helpful to structure your prompt with the following format: [art style] [subject] [scene] [lighting] [color]
    - For example: A cinematic photo of a peacock in the water. The lighting is even, creating subtle shadows, with a muted natural color palette.
- Within each section of the prompt, you can keep descriptions general or choose to get more granular for more specific results
- It’s not necessary to include all of these categories every time - Frames does well understanding simple prompts as well
- Experiment with Aesthetic Range, which allows you to dial up and down the overall creative variation that you’ll see across a set of four generations
    - Lower values will remain stylistically close to the original prompt, with minimal changes to camera angles, lighting and color grading
    - Higher values will introduce more extreme stylistic changes to your image while keeping your subject the same
- Once you’ve generated images, you can download, favorite or click the “vary” button to generate four more similar images
- Click the “Use” button to swap the Generative Session UI into video mode, using the Frames output as an Image to Video input
- Check out [runwayml.com/worlds-of-frames](http://runwayml.com/worlds-of-frames) for inspiration


Generating with Frames

Frames

Learn how to use a restyled first frame for more control with Video to Video.

Apply styles with Restyled First Frame. Learn how to transform video aesthetics, apply artistic styles, and create stylized content using AI transformation.

Restyled First Frame Tutorial

- Inside of a Generative Session, choose a video you’d like to stylize
- Click on “Styled first frame” icon
    - From here, you can download the first frame of your original video to apply stylization to it
    - During the stylization process, make sure the image dimensions remain the same
- Upload the styled frame into Video to Video
- Add a text prompt for additional context if you want, then click “Generate”
- Default Structure Transformation is set to 3, but try experimenting with different values to get different video motion results
- You can even try adding or changing elements from the original frame instead of completely restyling it, to turn Video to Video into a VFX engine
- If you feel like getting experimental, you can upload a completely different image than the first frame, which will give you unexpected and interesting results
    - For this method, increasing the Structure Transformation above 5 is typically helpful for getting better looking videos


Using Restyled First Frame

Learn how to use Character Reference Videos in Act-One.

Create character videos with Act-One. Learn how to animate characters, transfer expressions and produce performance-driven video content using AI technology.

Act-One Character Animation

- Head to Generative Sessions tool and open up Act-One in Gen-3 Alpha or Gen-3 Alpha Turbo
- You can now use a video as your character input, in addition to images
- Upload or record your driving performance, choose a video clip for your character reference video, adjust motion intensity if you’d like, and hit “Generate”
- Keep in mind: if your driving performance video is longer than your character reference video, the output will automatically reverse at the end of the clip to fill the duration
- Character reference videos in Act-One can be live action videos, giving you the freedom and flexibility of changing performances in post
- You can also bring in your Gen-3 Alpha videos as character videos, giving your generative workflows a huge boost in expressiveness
- You can even run your video clips through Video to Video before bringing them into Act-One to completely control every aspect of your performance


Character Videos in Act-One

Learn how to use Expand Video in Gen-3 Alpha Turbo.

Expand video dimensions with Gen-3 Alpha. Learn how to extend frame boundaries, change aspect ratios, and add content around existing footage using AI.

Expand Video Tutorial

- Expand Video allows you to seamlessly generate beyond the edges of a frame to turn horizontal videos into vertical videos, and vice versa - without compromising details or framing
- Open Gen-3 Alpha Turbo to use Expand Video
- If you upload a horizontal video, the model will automatically default into turning it into a vertical video
- You’ll have a few options:
    - Click the Generate button without providing a text prompt
    - Provide a detailed text prompt telling the model what you’re hoping to see in the parts of the frame that aren’t visible
    - Provide the model with an outpainted image of the first frame of your video
- Best practices:
    - Subject is close to center of the frame
    - No graphics or text present in the video
    - Use a guiding text prompt
- If you run multiple expansions in a row, you can create wide shots of the scene — then by overlaying the original footage onto the expanded canvas, you can create super zooms


Gen-3 Alpha Expand Video

Learn how to use Camera Control in Gen-3 Alpha Turbo.

Control camera movement in Gen-3 Alpha. Master techniques for pans, tilts, zooms, and precise camera motion control in AI-generated video content.

Camera Control Tutorial

- Head to Generative Video, then Gen-3 Alpha Turbo and upload an image
- Camera Control allows you to plan out specific camera movements for your scene: left/right, up/down, in/out, pan left/right, tilt up/down, rotate clockwise/counter-clockwise
- The camera speed is determined by how close your subject is to the camera
    - Use smaller values when your subject is closer and larger values when your subject is far away
- Camera Control will generally work better if you provide a text prompt to help guide your generation (example: where you want the camera to move, what you want your subject to be doing, add more to the scene)
- Try using presets for inspiration, found underneath the prompt box


Gen-3 Alpha Camera Control

Learn how to use Act-One to generate expressive performances using a single driving video and character image.

Get started with Act-One character animation. Learn the basics of facial performance capture, character setup, and creating expressive AI-driven animations.

Act-One Beginner Guide

- Head into Generative Video with Gen-3 Alpha selected
- Click “Act-One” icon on the left sidebar
- Add your source footage
    - Act-One can work with characters positioned at varying angles as long as it’s not too extreme
    - Maintain lively facial expressions with the entire face in view, with minimal body movement and clear audio
- Add your reference image
    - Upload your own image or choose from one of our presets
- Once ready, hit “Generate”
    - Your result will be a seamless animation preserving all of the subtle expressions and movements from your performance, but transposed onto the character from your reference image


Getting Started with Act-One

Learn how to use Video to Video in Gen-3 Alpha.

Transform videos with Gen-3 Alpha Video to Video. Learn how to restyle footage, change aesthetics, and apply AI transformations to existing video content.

Video to Video Tutorial

- Open up Generative Video and select Gen-3 Alpha
- Upload a source video
    - input videos 5s or less cost 50 credits, input videos longer than 5s (up to 10s) cost 100 credits
- Add a text prompt describing how you’d like to stylize your video
- Adjust structure transformation slider in settings
    - lower values will adhere to the source video structure more
    - higher values will allow you to slightly deviate from structure of input video
- Click “Generate”
- Use custom style presets to experiment with new styles
    - edit the purple text in the text prompt with a quick description of your scene


Gen-3 Alpha Video to Video

Learn how to extend Gen-3 Alpha generations.

Extend video length with Gen-3 Alpha. Learn how to add frames, continue motion, and seamlessly expand video duration using AI generation technology.

Extend Videos Tutorial

- Choose Gen-3 Alpha from the model dropdown in the Text/Image to Video tool (extensions aren’t available in Gen-3 Alpha Turbo yet)
- Generate a video from a text prompt or an image
- Click “Extend” — choose to extend it by 5s or 10s for a maximum of three extensions total
- If you click the “Extend” button with no additional prompt, Gen-3 Alpha will automatically continue the motion from the previous video
- If you’d like, you can add a text prompt to your extension for more control, or to add something new
- From your assets folder, you can always navigate back to a previous Gen-3 Alpha generation and extend it from there
- Extensions are a great way to get more out of Gen-3 Alpha — showcasing the environment, transitioning the scene or just continuing the action


Gen-3 Alpha Extensions

Learn how to blend live action video with Generative Visual Effects.

Create visual effects with Gen-3 Alpha. Learn how to add VFX elements, enhance footage, and integrate AI-generated effects into your video projects.

AI for VFX Teams – Tips and Tricks

- Find or shoot a source video
    - Suggested camera settings: auto focus off, auto white balance off, camera on tripod
- Next, scrub through your footage and export a still image from where you want to add visual effects
- Bring the still image into Gen-3 Alpha Image to Video
- Depending on your idea, you can choose to input the image as the first frame or last frame
- In this example, we’ll select the first frame and add a text prompt describing the effect
- Once you have a shot you like, composite (combine two or more images together to make one final image) the source video with the generated video
- For the final output, feel free to add color correction or masking if needed
- Gen-3 Alpha Image to Video allows you to achieve various levels of VFX — from singular assets to fully blended live action and generated content


Generative Visual Effects

Learn how to use Image to Video with Runway’s newest video model, Gen-3 Alpha.

Animate images with Gen-3 Alpha. Learn how to convert still images into video, control motion direction, and create dynamic content from static visuals.

Gen-3 Image to Video

- From your Runway dashboard, click on “Text/Image to Video” and upload an image
- If you’d like, you can click the “Generate” button with no additional prompt guidance, and the model will interpret the image to give you the best results
- You can also provide a text prompt alongside your image which will help guide the result better or, introduce new elements or movements throughout the video
- Image to Video is a great way to start with a specific style, character or composition for added control and intention when generating


Using Image to Video in Gen-3 Alpha

Learn how to use Text to Video with Runway’s newest video model, Gen-3 Alpha.

Get started with Gen-3 Alpha video generation. Learn the fundamentals of text-to-video, image-to-video, and essential features for creating AI video content.

Gen-3 Alpha Beginner Guide

- Head to Text/Image to Video tool and select Gen-3 Alpha from the model dropdown
- Add a text prompt
- Select 5s or 10s video to generate
- 720p generations take about 60s for a 5s video, or 90s for a 10s video
- The more detailed you can make the text prompt, the more Gen-3 Alpha will shine
    - Include things like subject, scene, lighting, camera, movements and more
- In addition to visual details, Gen-3 Alpha can be prompted for subject action, camera action, speed, transition and more
- Gen-3 Alpha works with a wide variety of prompt structures, from super simple to more complex
- If you’re looking for inspiration, separate prompt into a visual description and a camera description
    - Example: Visual: A pillow fort in a cozy living room. The pillow fort is made from an assortment of quilts, fabrics and pillows Camera motion: Hand held camera smoothly zooms into the entrance of the pillow fort, revealing an ancient castle in the interior
- For more helpful resources, check out our [Help Center](https://help.runwayml.com/hc/en-us) or [Discord](http://discord.gg/invite/runwayml)


Getting Started with Gen-3 Alpha

Gen-3 Alpha

Create videos using Gen-4 Chat Mode. Learn conversational video generation, iterative refinement, and how to guide AI through natural dialogue interactions.

Gen-4 Chat Mode Tutorial

- Chat Mode can be accessed from within a Generative Session
- Allows you to use all the same Gen-4 creative functions that you’re used to, in a more conversational way
- Examples of what is possible in Chat Mode
    - Ask for the character you’re looking for
    - Once the image is generated, ask for changes to the image in a back and forth iterative process
    - Supply reference images to edit or comp images
    - Ask for feedback for other ideas on how to change shots
    - Generate videos from images and upscale to 4K
- All Chat creations are saved in Generative Sessions and Assets


Creating with Chat Mode

Learn how to use 3D assets in Gen-4 References.

Use 3D assets with Gen-4 References. Learn how to incorporate 3D models, control camera angles, and maintain consistency in AI video generation workflows.

3D Assets in Gen-4

- Using 3D assets as part of your generative workflow allows you to control specific scene elements contained in your reference image
- While you can’t use 3D models directly in Runway, you can still create pre-comp images that can be brought in and used with References
- Start by using your 3D application of choice
    - Build out a very basic 3D scene
    - Use the 3D camera to get the angle that you’re looking for
    - Export the camera POV as a single still image
- Import that image into References, and combine it with a style reference image and a text prompt
    - The prompt should look something like “render image 1 in the style of image 2”
- Try swapping out image 2 with different style references for different results
- Once you get an image you like, try asking References for different angles of the scene, or closeups on specific elements
- Choose your favorite images, turn them into videos with Gen-4, then edit them together for your final video result


Using 3D Assets in Gen-4 References

Learn how to use References in Gen-4 for consistent characters, locations and more.

Master Gen-4 References for consistent generation. Learn how to use reference images, control style, maintain character consistency, and guide AI output precisely.

Gen-4 References Guide

- Gen-4 References allows you to visualize and create consistent characters and locations, new shots and angles and so much more
- Open a new Session and click on the “Image” tab
- Drag in up to 3 Reference images to use
- If you’d like to save a Reference into your library for a quick recall later, hover over the Reference image to give it a name
    - Use Saved References by using the @ command in your text prompt
- Be conversational with your prompts - ask for new angles or characters
- Choose any part of the image to reference - lighting, color grading, compositions, poses and more
- Reference different images directly by using tags/saved References, or simply reference “image 1” or “image 2” in your prompts according to the upload order of your images
- Currently, References primarily supports character and location preservation, but we will be making updates in the future to support objects, styles and more


Gen-4 References

Animate images with Gen-4 Image to Video. Learn techniques for bringing still images to life, controlling motion, and creating dynamic video from photographs.

Gen-4 Image to Video

- Open a Generative Session and make sure that Gen-4 is selected from them model dropdown
- Upload an image to use it as the first frame of your video
- Gen-4 supports Image to Video with multiple aspect ratios and will automatically adhere to the closest aspect ratio to your image, but feel free to change it
- Providing a text prompt with your image provides more control of your scene and camera
- Prompting should focus on the things you want to happen in the video, specifically the subject action and camera action
- Or, you can use Gen-4 with no prompts at all for stunning results
- Gen-4 works well in a visual effects workflow, prompting for scene actions to take place, or by animating visual effects assets that can be used in a more traditional compositing workflow
- Don’t forget to combine Runway workflows and models together, like Act-One to make your characters speak, or Expand Video to see more of your scene, run your outputs through Video to Video to reimagine them, or upscale your videos to 4K for higher fidelity


Gen-4

Learn how to edit and transform videos with Aleph.

Transform videos using Runway Aleph. Master techniques for changing scenes, modifying environments and applying AI transformations to existing footage.

Video Transformation with Aleph

- Aleph is a powerful general purpose video model that can accomplish a wide variety of transformation tasks, like viewpoint changes, inpainting, outpainting, relighting, reanimation, style transfer and more
- To access Aleph, simply drag a video clip into the prompt box of a session or in Chat Mode
    - For best results, video dimesions should be 1280x720 and no more than 5s long
- Example prompts:
    - Relighting: Add warm light to the side of the man’s face.
    - Night to day transformation: Change the time of day to sunrise.
- Add as much detail as possible to the prompt to achieve the best results
- Ask Aleph to keep certain parameters the same, like camera motion or lighting, while changing the main subject entirely
- You can also provide Aleph with image references, giving you more control over your generations
- Try applying rough animations over a still image as your video input to have Aleph bring it to life


How to Transform Videos

Learn how to generate new angles with Runway Aleph.

Generate new camera angles with Aleph. Learn how to create alternative perspectives, change viewpoints and expand scene coverage using AI technology.

Create Camera Angles with Aleph

- Upload your video into Chat Mode, then prompt for a camera angle change
- Repeat this step with the same input video and change the camera angle description for different angles


Generate New Angles with Aleph

Learn how to generate next shots with Runway Aleph.

Generate sequential shots with Aleph. Learn how to extend scenes, create narrative continuity and produce the next shot in your video sequence using AI.

Continue Scenes with Aleph

- Upload a video clip, then ask Aleph to predict the next shot in the sequence
- If you want something more specific, just ask Aleph for those details to be included


Generate the Next Shot with Aleph

Learn how to change environments with Runway Aleph.

Change video environments using Aleph. Master techniques for replacing backgrounds, modifying settings and creating new locations in existing footage with AI.

Transform Backgrounds with Aleph

- Upload a video clip, then simply ask Aleph to change the environment
- Repeat the process for different environments


Change Environments with Aleph

Learn how to add scene elements with Runway Aleph.

Add elements to scenes using Aleph. Learn how to insert objects, props and effects into existing video footage with AI-powered scene manipulation.

Add Objects with Aleph

- Upload a video clip and simply ask Aleph to add an element to the scene
- Repeat the process to add new or different elements


Add Scene Elements with Aleph

Aleph

Learn how to replace character voices with Act-Two.

Change character voices using Act-Two. Learn how to modify vocal performances, adjust voice characteristics and create varied character dialogue with AI.

Change Voice in Act-Two

- Load a driving video into Act-Two
- Click on the Voices tab and listen through some of the voice options
- Select a voice and click “Generate Voice” to re-render your driving video back into your session
- This is a great way to augment the voice of an existing video - live action or generated
- Drag and drop the new driving video into Act-Two, select a character and click the Generate button
- If you generate an Act-Two video with no voice modification applied to it, you can click the actions menu underneath the video in your session, choose Change Voice, then choose the character voice and click “Generate”


How to Change Voices

Learn how to create expressive character performances with Act-Two, our most advanced motion capture yet.

Create expressive performances with Act-Two. Master techniques for capturing emotion, facial expressions and realistic character animations using AI motion capture.

Character Animation with Act-Two

- Access Act-Two in a Generative Session from the video tab
- Then, load in or record your driving performance video in the top slot, and add a character image or video in the bottom slot
- You’ll get the best results out of Act-Two if your driving performance video and character are facing the same general direction and taking up similar screen space
    - If you’re standing too far away or facing the wrong direction, your results may vary
    - Pro tip: correct your character’s pose and eyeline by running it through References
- Open up Settings:
    - Facial expressiveness allows you to dial up or down the expressiveness of your character performance output - lower values will tame, higher values will amplify
- The Gestures toggle (on by default) will capture your body gestures, including your hands for your character performance
    - If your character input has visible hands, make sure that your hands are also visible in the driving video to achieve the best results


Act-Two Expressive Character Performances

Act-Two

Learn how to use the Character Creator featured Workflow.

- Access Character Creator in the Featured section of Workflows
- The first node is the prompt for the character description, which then gets fed into an LLM node
    - The LLM node helps describe the character in more detail and adds rules
- The first character image gets created and serves as the global foundational image reference so that the character stays consistent in every generation
- The first set of images that are generated are neutral expression, full body and close ups
- From there, the character gets created in T pose, right profile and left profile - these poses are generated with the help of a reference chart
- To get your character into a new pose:
    - Drag your original character reference image into a new part of the canvas to create a new image reference node
    - Add a text node, image upload node and an image generation node
    - Upload any pose reference image
    - In prompt box, say something like “show me the character in image 1 in the same pose as the reference image in image 2”
- Going back to the main Workflow, we have additional images showcasing various character expressions and angles
- Under all of these image nodes, there are some video keyframe nodes that use the wide body shot as the first frame, and the close up expressions as the last frame, which creates a dynamic zoom-in expressive character video
- There are also some additional videos being created:
    - 360° character rotation plate - helpful to extract any angle of your character
    - Character speaking video
- You can explore new characters or add more nodes to customize this Workflow further


Character Creator Workflow

Learn how to build custom workflows in Runway.

How to Build Custom Workflows

Learn how to start building your own custom tools inside of Runway using Workflows.

Using Runway Workflows

- Access Workflows from the left side panel on your dashboard
- At the top, you'll find featured workflows pre-designed for specific tasks, like the storyboard generator
- Copy a featured workflow to your account and give it a name to use or customize it
- Move around the canvas freely, zoom in and out, click to move nodes, or hit delete to remove them
- To run a workflow: add your text prompt, then run the whole workflow to get results
- Understanding workflow logic: text prompts flow into LLM nodes (enhanced by system prompts), which feed into image nodes to achieve desired results
- To customize further, right-click the canvas and add new nodes (like Gen 4 video)
- Connect outputs to inputs: link your image output to the Gen 4 image input, and connect the same prompt to the prompt connector
- Run individual nodes or the entire workflow to go from text to image to video in one step
- Pro tip: Check out workflow help articles or visit Discord to see how the creative community is using workflows
