AI column

Video@donghyeok99Staff

HyperFrames: write HTML, get a video, built for agents

Someone handed Claude Code a raw screen recording and got back a promo with a sound effect on every click

Three lines of index.html become timeline tracks; the playhead sweeps across, captures each frame and packs them into one MP4.
Three lines of index.html become timeline tracks; the playhead sweeps across, captures each frame and packs them into one MP4.
Who
Open source from HeyGen, which uses it in production. For anyone who wants a coding agent to make their videos.
When
Released in March 2026. The latest is v0.8.217 (2026-10-29), the third release in two days.
Where
Works in agents that read skills: Claude Code, Codex, Cursor, Gemini CLI. Renders on your own machine, in Docker or on AWS Lambda.

What was hard

Even a short launch video meant opening an editor, trimming clips and lining up the moment the title appears by hand. You could hand the job to a coding agent, but what agents write well is web pages, not video files.

What it does about it

You write the video as one HTML page. Data attributes say when each element appears and how long it stays, and animations sit on a paused timeline. At render time a browser steps that timeline one frame at a time, so, by the README, the same HTML gives the same video every run. For the agent, the /hyperframes skill carries these rules and the order of work from plan to render.

Biennale Yellow, one of the frame.md design templates
Biennale Yellow, one of the frame.md design templates
Bold Poster, from the same frame.md set
Bold Poster, from the same frame.md set

What people made with it

Redditu/ZibbyRun2026-09-23

They gave it a screen recording of their web app and got a promo cropped to what matters, with a title and a sound on every click; after one round of notes it reused the setup for six more promos.

I opened Claude Code with the HyperFrames plugin, which renders video from an HTML file, and dictated what I wanted in my own words, the way I'd brief a human editor.
Redditu/Top_Tomatillo_45552026-09-23

A data video about rain in London, maps and charts included, made entirely in HyperFrames from 1991–2020 averages by the Met Office, NOAA and Australia's Bureau of Meteorology.

Made the whole thing in hyperframes (because. why not lol XD), map charts all of it.

How it runs inside

  1. 1

    /hyperframes skill → Claude Code

    The render contract and work loopThe agent learns to give every timed element class=clip, data-start and data-duration and to register a paused timeline.skills/hyperframes/SKILL.md
  2. 2

    Claude Code → index.html

    Scenes written as HTMLVideo, title and music go on their own tracks; GSAP or another library puts the motion on the timeline.skills/hyperframes/references/format.md
  3. 3

    index.html → hyperframes CLI

    npx hyperframes check --jsonFinds contract breaks and layout problems and returns each with a Fix line.packages/cli/src/commands/check.ts
  4. 4

    hyperframes CLI → Headless Chrome

    npx hyperframes renderCompiles the HTML, probes duration and media, and loads it in headless Chrome.packages/producer/src/services/render/stages/compileStage.ts
  5. 5

    Headless Chrome

    Seek, then screenshot, per frameSteps the timeline in window.__timelines one frame at a time and captures that moment.packages/engine/src/services/frameCapture.ts
  6. 6

    Headless Chrome → MP4 file

    Frames into FFmpeg (image2pipe)Each captured frame streams straight into FFmpeg, which encodes the video.packages/engine/src/services/streamingEncoder.ts
  7. 7

    hyperframes CLI → MP4 file

    Audio muxed, MP4 finishedThe audio is trimmed to the frame count, muxed in, and the file is made to play from a partial download.packages/producer/src/services/render/stages/assembleStage.ts

What goes in, what comes out

A 10-second product intro with a fade-in title, background video and subtle music (the README's sample prompt)The /hyperframes skill writes the HTML and renders an MP4
A raw screen recording of a web appA promo cropped to what matters, with a title and sound effects (u/ZibbyRun)
npx hyperframes add data-chartAn animated chart block added to the project

Is it for you

Good for

  • Handing launch and feature videos to an agent
  • Turning a screen recording into a short promo
  • Data videos with charts, maps and moving numbers
  • Batches of short social clips with captions and music
  • Turning docs or a website into an explainer video

Not for

  • Rendering needs Node.js 22+ and FFmpeg.
  • Per the README, the desktop app is for Mac and Linux; the CLI and skills work without it.
  • Some media, such as avatars and generated video, goes through HeyGen; the rest uses free local tools.
  • Cloning the whole repository for development pulls about 240 MB of test videos through Git LFS.

Reviewed by Devalley’s editor before publishing. How the column is made

Sign in to post, comment and like.Sign in

Report

Reason

Read the community rules