Artist instantly creating a flowing animation, illustrating real-time video generation

FastFrames-L: Interactive Video

FastFrames-L is a new video diffusion model from Apple. It generates 480p video. It operates at interactive latency. The model is autoregressive and uses a two-step process.

Apple released FastFrames-L, a video diffusion model that generates 480p video at interactive latency.

Robot toy rapidly assembling, symbolizing fast 480p video generation from diffusion model

TL;DR

FastFrames-L is a new video diffusion model from Apple. It generates 480p video. It operates at interactive latency. The model is autoregressive and uses a two-step process.

Key facts

  • Maker: Apple
  • What's new: FastFrames-L (14B) and FastFrames-S (1.3B) models
  • Context: Builds on Wan2.1 and Causal Forcing++
  • License: Apple Sample Code License, CC BY-NC-SA 4.0 for LingBot-World v2
  • Access: Hugging Face repository, interactive demo with LingBot
Apple workstation showing AI character and neural network, representing model details and access

What is it?

FastFrames-L is a video generation model. It is a large version with 14 billion parameters. It generates video at 480p resolution. The model is designed for interactive latency.

How does it work?

FastFrames-L is an autoregressive, two-step video diffusion model. It uses a causal teacher trained on latents from Wan2.1-14B. It then trains a pixel decoder and KV refinement network.

Why does it matter?

The model's ability to generate video at interactive latency is important. This allows for fluid camera-conditioned control. It can produce 81 frames at 16 frames per second.

Who is it for?

Developers and researchers working on video generation and real-time AI applications.

Try it

Available on Hugging Face with an interactive demo using LingBot. Requires Linux x86-64 with an NVIDIA GPU and CUDA 12.8-compatible driver.

Frequently asked questions

What is FastFrames-L?

FastFrames-L is a video generation model from Apple. It is a 14 billion parameter model that creates 480p videos. It is designed to operate with interactive latency.

What is the resolution of videos generated by FastFrames-L?

FastFrames-L generates videos with a resolution of 480p. Specifically, it outputs 832 x 480 video. It can produce 81 frames at 16 frames per second.

What license does FastFrames-L use?

The FastFrames code is licensed under the Apple Sample Code License. LingBot-World v2 code and weights follow their upstream CC BY-NC-SA 4.0 license.

Sources

  1. Hugging Face

Follow news like this automatically

RAI AI watches news, X, Telegram and Reddit for the topics you choose and sends a short AI summary to the app, email or Telegram. Try RAI AI free for 7 days