Video Segmentation

The Segment Anything 2 modifier follows a subject through a video and turns it into a mask. This is useful when an effect or composite should apply to a moving subject without drawing the mask on every frame.

Create a mask

  1. Select a visual clip and add the Segment Anything 2 modifier.

  2. Move the playhead to a frame where the subject is clear.

  3. Click the subject in the preview to add a foreground point. Right-click or Control-click to mark background that should be excluded.

  4. Add more points as needed, or drag across the preview to draw a box around the subject.

  5. Select Analyze and keep the compute server running until the mask is ready.

Adjust the result

Use Threshold to change the mask boundary and Edge softness to feather it. Invert swaps the selected and unselected regions.

Changing a prompt makes the existing analysis out of date. Select Reanalyze after moving points, changing the box, or selecting a different SAM 2 model.

Shrimply offers SAM 2.1 tiny, small, base-plus, and large variants when they are available from the server. Larger variants generally trade more resource use for model capacity.