Remove a background with the AI tool
You will cut a person, or any other subject, out of a clip or a still picture without a green screen, so it appears over another picture. This uses Background Removal, a tool that runs an AI model. It is optional: Kinoklip works without it, and the model is only downloaded when you ask.
What you need
-
A clip with a person in it, or a still picture (a product on a white table, a portrait). Plain, well-lit footage works best; the subject should not be tiny.
-
The model, downloaded once (see step 3). There are two: the people model for video is about 14 MB; the any-subject model for still pictures is about 214 MB, needs about 7 GB of free memory and a few seconds per picture. Kinoklip asks for the one your clip needs.
-
A background: another video or a picture. Put it on track V1 and the clip with the person on V2, right above it.
Is it private?
Yes. The model is downloaded once and then runs entirely on your computer. Nothing is uploaded, no account is needed, and Kinoklip sends no usage information. You can delete the model again at any time in Preferences > System > AI Models.
Steps
For a still picture the steps are the same; Kinoklip picks the any-subject model by itself.
- Click Effects at the top left to open the effects library.
-
Open Video Effects > Key, find Background Removal and drag it onto the clip with the person. You can also type "background" in the search field.
-
Click the clip, then open the Effects tab of the Inspector. At the top of the settings you see the AI label and a status line. If the model is missing it says so. Press Download Model.... A window shows the name of the model, its size, its licence and where it comes from. Nothing is downloaded until you press Download in that window; Cancel closes it.
-
When the download is finished, the person is cut out. The first frames of a clip show the normal picture for a moment: the cutting out happens in the background, so playing never stops. Each finished frame is kept on disk, so the clip is only cut out once.
-
To have the whole clip ready before you play it, press Process Whole Clip. A progress bar shows how far it is. Cancel stops it.
-
Check the edges. Set Output to Matte Only to see what stays (white) and what is removed (black), then set it back to Foreground.
Settings
| Setting | What it does |
|---|---|
| Model | Automatic uses the any-subject model for a still picture and the people model for video. People in video (temporal) always uses the people model: it is quick and keeps the edges steady from frame to frame, but it only knows people. Any subject (per frame) always uses the any-subject model: it cuts out objects, animals and people on any background, also white, but it is slow for a whole video and each frame is judged on its own, so edges can shimmer a little. Each model has its own cached cut-outs. |
| Output | Foreground keeps the person. Matte Only shows the cut-out as black and white. Background Only keeps everything except the person. |
| Threshold | Where the edge is drawn. Higher removes more of the soft edge area. |
| Edge Softness | How gradual the step from kept to removed is. 0 is a hard edge. |
| Shrink / Grow | Moves the edge inwards (negative) or outwards (positive), in pixels. Shrink a little to lose a light fringe. |
| Feather | Blurs the edge, in pixels. |
| Quality | Preview (fast) looks at a small picture and keeps up with playing. Full (slow) looks at a larger picture and finds finer edges, such as hair; use it for the final video. Each quality has its own cached cut-outs. |
Good to know
-
Playing and exporting. While you play, a frame that is not cut out yet shows the normal picture. When you export (and when Kinoklip builds its render cache), it waits for every frame, so the finished video never has an uncut frame.
-
Speed. A computer without a graphics card for AI work still manages this: it runs on the processor. The people model needs a fraction of a second per frame at the preview quality, and longer at full quality. The any-subject model needs several seconds per picture: fine for a still picture (it is cut out once and kept), too slow to use on a long video. Process the clip once and it is ready from then on.
-
A still picture that was not cut out before. Clips from older projects use Automatic, so a still picture now gets the any-subject model. If you liked the old result, set Model to People in video.
-
When it is greyed out or says "not available". The status line gives the reason: the model is not downloaded yet, or this copy of Kinoklip was built without the AI runtime.
-
Clean up. Preferences > System > AI Models shows the model, how much room the cut-outs use, and has Remove Model and Clear Matte Cache.
-
The cut-out is made from the clip as it is in the media file. Other effects above it in the list, and cropping, do not change the cut-out.
Found a mistake? Edit this article on GitHub.