ablx.directory

HyperFrames Feedback Starter

v0.1.0template

Minimal Ableton × HyperFrames feedback-video starter: wiring the Anthropic + HeyGen APIs

Vance Ingallsmanifest author: youNo ratings yet

Unverified listing. This repo is new or has little community activity and the developer has not claimed it. Extensions run code inside Live — read the source, check the author, and only install things you trust.

README · rendered from GitHubView source

HyperFrames Feedback Starter

The smallest working version of the feedback extension: right-click an arrangement selection → Create Feedback Video from Selection… → Claude reviews the selection and the review is rendered into a short video, imported back into your Set.

It exists to show the two API wire-ups clearly, in as little code as possible:

  • Anthropic (src/feedback.ts) — the review. How to call Claude with a JSON Schema so the response is structured (score + points), streamed, with the refusal check.
  • HyperFrames Cloud / HeyGen (src/render.ts) — the render. The full upload → submit → poll → download flow, and why a HeyGen key is required: Live's managed host sandboxes Node child processes, so the local hyperframes CLI can't run in a real install — rendering has to be a network call.

Unlike the full extension, the composition here is a fixed template (template/composition.html), not authored per-project by the model. That keeps the starter focused on the pipeline; the "Claude designs the video" step is the advanced move you can add next (see the full extension).

The loop

Ableton Live ──▶ Extensions SDK ──▶ Anthropic ──▶ HyperFrames Cloud ──▶ MP4 → Set
 selection       getProjectSummary   review (JSON)  render (HeyGen)      importIntoProject

Prerequisites

  • Node 20+
  • Ableton Live 12.4.5+ Suite (Beta) with the Extensions SDK (a private beta from the Ableton beta program — not included here). The SDK tarballs are referenced by package.json at ../../extensions-sdk-1.0.0-beta.0/*.tgz; place the SDK bundle beside the repo or edit that path.
  • An Anthropic API key (the review).
  • A HeyGen API key (HyperFrames Cloud rendering). Both are entered in Live on first use and stored locally; or set ANTHROPIC_API_KEY / HEYGEN_API_KEY in the env.

Quick start

cd hyperframes-starter
npm install
npm run check     # build + offline load-check (no Ableton needed)
npm run run       # build + launch the dev host (Developer Mode ON in Live)

Then in Live: select a range across tracks in Arrangement view → right-click → Create Feedback Video from Selection…. It prompts for the two keys on first use. With a HeyGen key it renders in the cloud (works in an installed .ablx); without one it falls back to the local CLI, which only works on the dev host.

File map

FileWhat it is
src/main.tsThe whole loop: read → review → render → import, plus the key prompts.
src/liveAdapter.tsThe only file that imports the SDK. Selection + getProjectSummary, host services.
src/feedback.tsAPI #1 — Anthropic. Structured review + key storage.
src/render.tsAPI #2 — HyperFrames Cloud. Upload/submit/poll/download (+ local for the dev host).
src/feedbackTypes.tsProjectSummary, FeedbackReport, and the JSON Schema for structured output.
template/composition.htmlThe fixed HyperFrames composition (a paused GSAP timeline). Edit this to change the look.
template/gsap.txtGSAP, inlined into the bundle and written next to the composition at render time.
src/polyfill.ts · src/webglobals.tsRestore the web globals the host strips (imported first).
tools/build.mjs · tools/load-check.cjsesbuild bundle (with the text loaders) + offline load check.

Make it yours

  • Different look: edit template/composition.html. Everything must be a pure function of the timeline's seek time — one paused gsap.timeline({paused:true}) on window.__timelines['main'], no Date.now()/Math.random() — or frames won't be reproducible.
  • Richer review: extend the prompt and schema in feedback.ts / feedbackTypes.ts.
  • Let the model design the video: instead of the fixed template, have Claude author the composition and lint-fix it before rendering — that's what the full hyperframes-feedback extension does.

Rate this extension

One rating per account; you can change it any time.

No ratings yet — be the first

Comments

Sign in to join the discussion.Sign in

No comments yet.