music-to-3d choreography → unreal engine

AI Dance Animation for Unreal

mvntSTUDIO turns a track into 3D choreography in the browserand gives you a GLB download today.Here is how to inspect that file now and plan the future FBX/BVH workflow for Unreal.

Open mvntSTUDIO How music-to-dance works

A dance clip is not a Skeleton asset

Unreal is stricter than most engines about animation, and the strictness is concentrated in one idea: an Animation Sequence does not exist on its own. It belongs to a Skeleton asset. Every bone name and every parent-child relationship in the incoming file is checked against that Skeleton, and if they disagree the import either fails outright or produces a sequence that binds to nothing. Almost every "my AI dance animation for Unreal will not import" thread resolves to this.

mvntSTUDIO generates the motion itself. It is a music-to-3D-choreography tool — you supply a track, including sources such as YouTube, Suno, or SoundCloud, and it produces a dance scene in the browser with no install. Once you sign in you can download the current GLB export. FBX and BVH exports are coming soon, so the Unreal import sequence below is a planned workflow for when those formats arrive. There is no Unreal plugin and no automatic retarget service; today you can inspect the GLB in a glTF viewer or Blender, while the future FBX path will provide Unreal’s native skeletal import flow.

GLB, BVH, or FBX — what is available for Unreal today

GLB is available today; FBX and BVH are coming soon. GLB is the current download for viewing or Blender, while the Unreal-native FBX workflow is planned for a future export.

  • FBX Coming soon

    FBX export is coming soon. When it launches, Unreal’s skeletal animation pipeline will use the FBX import dialog for the settings that matter — the Skeleton to bind against, Import Uniform Scale, whether to import the mesh, the animation, or both — and it will produce Skeletal Mesh, Skeleton, Physics Asset, and Animation Sequence assets in a single pass. Nothing else on this list provides that planned native workflow.

  • BVH Coming soon

    BVH export is coming soon. It will carry a joint hierarchy and rotation channels and nothing else — no mesh, no skinning weights, no materials. It is a DCC-level format, useful when your target is a rig you already own and you plan to retarget in Blender or MotionBuilder before using the planned FBX export for Unreal.

  • GLB Available now

    GLB is the current download. It is a single self-contained file carrying mesh, skin, and animation, so it is a quick way to look at the motion outside the engine — any glTF viewer or Blender opens a .glb immediately. The FBX and BVH exports are coming soon for engine-oriented workflows.

What Unreal will argue with

In rough order of how often each one stops people, and how quickly it can be fixed once you know where to look.

1. Centimetres, not metres

Unreal’s unit is one centimetre. Most authoring tools work in metres, which is why a metre-scale FBX imports one hundred times too small and why the Import Uniform Scale field exists. When the planned MVNT FBX export arrives, confirm the export scale in the release notes and start with Import Uniform Scale at 1.0 unless the export documentation says otherwise. Sanity-check against the default mannequin before you build anything on the asset. Scale is baked at import, so correcting it later means reimporting.

2. Z-up, and which way is forward

Unreal is Z-up, and characters conventionally face along +X. When the planned FBX export becomes available, it should be typically Y-up and Unreal’s importer should perform the axis conversion, so you should not be hand-rotating the mesh after import. What the importer cannot guess is authoring intent about facing direction; the future import options include Force Front XAxis for content authored to a different convention. If the dancer imports upright but performs sideways relative to the rest of your characters, that setting — or a rotation on the actor — is the fix, not a rotation baked into the asset.

3. Binding to the right Skeleton asset

When the planned FBX export is available and you import an animation-only file, Unreal will ask which Skeleton it belongs to. The incoming bone hierarchy must be compatible with that Skeleton’s bone names and parenting. If you point a fresh future export at an unrelated Skeleton — the UE mannequin’s, for instance — you will get a mismatch rather than an automatic conversion, because Unreal does not retarget at import time. The reliable first-time path will be to import the FBX with the skeletal mesh included and the Skeleton field left empty, letting Unreal create the Skeleton, Skeletal Mesh, and Animation Sequence together from the same source. Every later dance exported from the same rig can then be imported as animation-only against that Skeleton, and it should bind on the first try.

4. Getting it onto a different character — the IK Retargeter

Moving the clip onto a skeleton it was not authored for is a deliberate step in Unreal 5, not a checkbox. You build an IK Rig asset for the source skeleton: pick the retarget root, usually the pelvis, and define retarget chains for spine, arms, and legs. You do the same for the target skeleton, or use an IK Rig it already ships with. Then an IK Retargeter asset maps chain to chain and lets you export a new Animation Sequence built against the target Skeleton. Bone-name mismatch is not fatal here, because you are matching chains by hand rather than relying on names — which is exactly why this is the tool for moving generated choreography onto a character that was rigged somewhere else.

5. Root motion, and what the capsule does

An Animation Sequence has an Enable Root Motion flag. Turning it on tells Unreal to take the root bone’s movement out of the animation and apply it to the actor, which is what you want when a dance travels across the floor and the collision capsule should travel with it. That only works when the imported rig has a dedicated root bone carrying travel. Until the planned FBX export is available and its root-bone convention is documented, treat root motion as a verification step rather than an assumption: test whether Unreal can extract a root track, or retarget onto a rig with a known dedicated root bone.

6. Frame rate and materials

Two smaller things that will matter when the planned FBX workflow arrives. The Animation Sequence carries its own sample rate; if that disagrees with your project or Sequencer frame rate, Unreal resamples, and fast footwork is where you will see it. And the materials that arrive with an FBX are placeholders — expect to author real materials in Unreal rather than treating the imported ones as final. Neither is a blocker, but both are easier to handle at import than after a scene is built.

Import checklist

The current GLB handoff, followed by the planned FBX import sequence.

  1. 1 Download GLB from Studio. Generate the choreography from your track in mvntSTUDIO, sign in, and download the current GLB export.
  2. 2 Inspect GLB or plan the first FBX import. Open the GLB in a glTF viewer or Blender today. When FBX export is available, drag it into the Content Browser, leave Skeleton empty, keep Import Mesh and Import Animations enabled, and leave Import Uniform Scale at 1.0 if the export is centimetre-scale.
  3. 3 Plan verification for the future asset. When the planned FBX export arrives, open its Animation Sequence and scrub it in the Animation Editor. Confirm height against the default mannequin and confirm facing direction before building on the asset, while reimporting is still cheap.
  4. 4 Plan playback on a character. For the future FBX asset, select the Skeletal Mesh Component, set Animation Mode to Use Animation Asset, and choose the sequence for a quick check. For gameplay, drive it from an Animation Blueprint — a state machine, or a slot node played as a montage.
  5. 5 Plan Sequencer use. For future FBX cinematics, add the skeletal mesh actor to a Level Sequence and add the Animation Sequence to an animation track. Check that the sequence frame rate and the Level Sequence frame rate agree.
  6. 6 Plan retargeting if needed. When the planned FBX workflow is available, move the dance onto another skeleton by building IK Rigs for source and target, creating an IK Retargeter between them, and exporting a new Animation Sequence against the target Skeleton.

Symptom to cause

A quick lookup table for the usual failures.

The character imports at a tiny fraction of the expected size
A metre-scale source imported against Unreal’s centimetre unit. When the planned mvnt FBX export arrives, check that Import Uniform Scale is left at 1.0 rather than raised to 100 if its centimetre-scale metadata is present.
Import fails or the sequence binds to nothing
The chosen Skeleton does not match the incoming bone hierarchy. Import the mesh and animation together to create a matching Skeleton first.
Enable Root Motion does nothing
Check whether the exported rig has a dedicated root bone carrying travel. If it does not, Unreal has no separate root track to extract; use the clip as in-place animation, or retarget onto a rig that has a real root bone.
The dance plays but the character faces the wrong way
Authoring convention mismatch. Use Force Front XAxis at import, or rotate the actor — do not rotate the mesh inside the asset.
Footwork looks softer than it did in the browser
Frame-rate resampling. Compare the sequence sample rate with your project and Sequencer frame rate.

Where generated choreography fits in an Unreal project

Generated dance is a drafting and volume tool. It fills the crowd, the background NPC, and the first pass, and it leaves the hero performance to an animator.

DimensionHand-keyed or mocap dancemvntSTUDIO music-to-3D choreography
Starting point An empty timeline, or a booked capture sessionA song — Studio reads the track and builds motion against it
Beat alignment Counted and keyed by hand, or cleaned up after captureGenerated against the rhythm, tempo, and structure of the audio
What you take away Whatever your DCC exportsGLB download from the browser today, with BVH and FBX coming soon
Best used for Final hero performances and signature choreographyDrafts, background crowds, emotes, and fast iteration

AI dance animation for Unreal — common questions

Which export format should I use for Unreal?
GLB is the current download, and you can inspect it in a glTF viewer or Blender. FBX is the planned format for Unreal’s native skeletal animation import path; when that export becomes available, its import dialog will provide Skeleton binding, uniform scale, and animation options.
Why does my dance animation import at the wrong scale in Unreal?
Unreal measures in centimetres — one unit is one centimetre. When the planned mvnt FBX export is available, its expected centimetre authoring means Import Uniform Scale should stay at its default 1.0. A character that arrives a hundred times too large usually means that field was set to 100 on advice written for metre-scale sources. Scale is baked at import time, so changing it means importing again.
Can I play the animation on the Unreal mannequin?
The current GLB can be inspected outside Unreal, but it is not the planned native skeletal import path. When FBX export is available, the sequence will bind to the Skeleton it was imported against. Use the IK Retargeter: build an IK Rig for the source skeleton with retarget chains for spine, arms, and legs, pair it with the mannequin’s IK Rig in an IK Retargeter asset, and export a retargeted Animation Sequence against the mannequin Skeleton.
Why did my animation-only import fail with a skeleton error?
This is a future FBX workflow concern: the Skeleton you select must match the incoming file’s bone hierarchy and names. Unreal validates the hierarchy against the Skeleton asset and does not convert between them at import. Once FBX export is available, import the skeletal mesh and animation together from the same file first — that creates a Skeleton the animation is guaranteed to match.
Will the character move around the level?
Not automatically. Enable Root Motion needs a dedicated root bone carrying travel, so confirm that convention on the actual export you import. If Unreal cannot extract a root track, move the capsule from your own code or retarget onto a rig that has a real root bone.
Is there an Unreal plugin for mvntSTUDIO?
No. Studio runs in the browser and produces the current GLB download, which you can inspect in a glTF viewer or Blender. FBX export is planned for a future Unreal-native pipeline; there is no mvnt plugin dependency either way.