Skip to content
AI Segmentation
QGIS
Tutorial

AI Segmentation for QGIS: The Complete Guide

Same zone, one word changes:
Aerial imagery of a residential neighbourhood, then the same view with every detected building filled in its own colour (after)
Aerial imagery of a residential neighbourhood, then the same view with every detected building filled in its own colour (before)
BeforeAfter
Drag to compare
155 buildings over a residential neighbourhood, squared and coloured one per object.
Watch the video tutorial

AI Segmentation turns imagery you already have open in into clean vector layers. Each of those is one run, and the count is the layer's own feature count.

It works two ways.

Automatic

Every object in a zone, at once

What it does
Draw a zone, name an object, get every instance.
Where it runs
In the cloud. Nothing heavy on your machine.
What it costs
Counts the ground it covers, shown before you start.
Use it for
Hundreds or thousands of objects over an area.

Semi-Auto

One object per click

What it does
Click an object. The AI outlines it, you save it.
Where it runs
On your computer after a one-click setup, or on ours. You pick.
What it costs
Free on your computer with no counter, and it works offline.
Use it for
Ten exact objects, or a boundary you control.

This guide walks Automatic live in QGIS, then the review, where you tune the layer without paying for a second run.

Install and sign in

In QGIS, open Plugins -> Manage and Install Plugins, search for AI Segmentation, and install it. The panel opens on the right.

Sign in from the panel and you are ready. Both modes are free to start: Automatic covers a free area of ground every month, and Semi-Auto runs on your own machine with no counter at all.

A switch at the top picks the mode, and below it you choose the raster.

Automatic: your first run

Goal: pull every building footprint out of a residential neighbourhood, in one run. Here it is end to end, from an empty panel to detections on the map.

0:00 / 0:00
One run, start to finish: pick the imagery, draw the zone, name the object, detect.

The five steps behind that clip, one at a time.

Pick your imagery and start

Choose the raster, then click Start Automatic AI Segmentation. The layer locks for the run, so nothing shifts under you halfway through.

Draw your zone

Click around the area and close the loop on the first point. Any shape you like: a free account covers 3 km² of ground a month, and Pro covers 300 km² with no limit on the zone you draw. Backspace undoes a point.

Describe what to find

One or two words: building, tree, car. This is the step where a first run goes wrong, so the Library next to the box lets you pick from real before/after previews instead of guessing.

Show what it looks like

One word is not always enough. Draw on the map outlines one object from your own imagery and the AI looks for the look-alikes. Up to three examples, and two work better than one.

Set the Precision

Your zone is cut into tiles, each detected at full resolution then stitched back seamless, so an object crossing a seam comes out whole. More precision means smaller objects found and more ground counted. The panel shows what the run covers before you start it.

The whole setup fits in one screen before you spend any of your allowance. Above the Library templates sit your own runs: Recent with its object and tile counts, Favorites for the ones you starred. Reopening one brings its wording back.

Then click Detect objects. Tiles go out, polygons draw on the map as they come back. This run returned 646 candidates.

The review: three steps, walked in any order

Detection opens a review rather than a finished layer, and most of the work happens here. The green button names the next step, but nothing forces that order.

1Keep

Which objects survive

  • Confidence
  • Min / max size

2Correct

Fix one polygon at a time

  • Edit by AI or by hand
  • Add, merge, delete

3Shapes

How every outline looks

  • Right angles, fill holes
  • Points, trim, grow

Go back to any step, in any order. Instant, and free.

1 Keep: decide which objects survive

Every detection carries a score. Confidence sets the floor, Size hides anything outside a ground-area range, and the line under the header counts what survives: 51 of 646 shown · 595 hidden by the filters. Anything you fixed or drew by hand survives both sliders.

0:00 / 0:00
Confidence and Size, live. The map and the counter follow the sliders.

Almost everything the two sliders throw away is small, low-scoring, and not your object.

2 Correct: fix one polygon at a time

Click a polygon and it opens on its own. Nothing else on screen moves while you work.

A switch at the top picks how you fix it. It reads AI | Manual, and here Manual just means "by hand, on this one polygon".

The AI method uses the model on your machine. Click the spot it missed and the outline grows, right-click a part it grabbed and the outline retreats.

0:00 / 0:00
The AI method: click what it missed, right-click what it took, save.

The by-hand method hands you QGIS's own digitizing tools on that polygon, with Move points, Redraw edge and Split.

0:00 / 0:00
The by-hand method: the corners become handles and QGIS's own tools take over.

The same step also handles what is missing and what should not be there.

  • Add a missing polygon. Point at an object the run never caught and the local model outlines it, free. Or draw its corners yourself.
  • Merge with neighbours joins a building the model split in two.
  • Delete this polygon drops one you do not want.
  • Clean up this outline opens shape controls for that object alone. By hand it reads Simplify this outline first and opens on Points, because thinning a 96-point outline is what makes its corners draggable.
  • Undo last and Clear all walk the corrections back.

3 Shapes: clean every outline at once

The last step reshapes the whole layer, live, and touches outlines only. Shape decides how an outline is styled, Outline fine-tunes the edges.

0:00 / 0:00
Every control reshapes the whole layer at once, and you see it as you drag.

Seven controls, and you rarely touch more than two on a given run.

ControlWhat it doesReach for it when
Right anglesSnaps walls to 90 and 45 degreesBuildings, pools, solar panels
Round cornersSoftens the outlineTrees, bushes, anything grown
Fill holesCloses interior gaps, up to a size you setRoofs come back speckled
PointsSets how many points each outline keepsOutlines look like a pixel staircase
SimplifyDrops points close to a straight edgeYou want the older distance-based reducer
Trim spikesShaves thin ragged bits off the edgeObjects have hairs and tendrils
Grow / shrinkPushes every boundary out or inThe layer sits consistently short or long

Right angles and Round corners are opposite choices, so ticking one greys out the other. On buildings, Right angles changes the most and Points comes next: a mask traced pixel by pixel carries a point every few centimetres, so lowering it drops the smallest detail first and keeps the corners.

One last control appears only when the run looks like land cover. Shared borders gives neighbouring shapes one exact border instead of a hairline gap. Between two buildings that gap is real data, so there the option does not exist.

Export, and go round again

Four ways to look at the same layer. View detections as sits at the bottom of the panel through every step. It changes what you see, never the geometry.

0:00 / 0:00
The same layer, four ways to look at it, switchable at any step of the review.
  • Distinct, one colour per object, to check neighbours came out separate rather than fused.
  • Outline, boundaries only, to check them against the imagery underneath.
  • Confidence, shaded by score, so the Keep slider shows what you are about to lose.
  • Normal, one clean colour for the finished layer.
The same detections shown four ways: Distinct, Outline, Confidence and Normal
Side by side: Distinct, Outline, Confidence and Normal.

Going back and forth is the point. A polygon you corrected becomes that polygon's new base, and the Shapes controls re-apply to it along with everything else. Go round as often as you like: it is instant and it costs nothing. The only control that spends your allowance is Re-run the whole zone, for when the wording itself was wrong.

Then export. Export polygons writes a styled GeoPackage, named after the object and the date, carrying Label, Class, Confidence, Area (m²) and Perimeter (m). Areas and lengths are in ground metres, so what you read off the file agrees with what QGIS computes.

The QGIS attribute table of an exported AI Segmentation layer, first as rows for every polygon, then as a form for a single one
The exported layer in the QGIS attribute table: every polygon as rows, and one polygon on its own.

Semi-Auto: one object at a time

The other mode segments one object per click. Click an object and it outlines it in one shot. Left-click adds what it missed, right-click drops what it grabbed, then you save the outline.

Reach for it when you need ten exact objects rather than a thousand approximate ones, or full control over a boundary.

Two cards next to the Start button ask which AI answers the click:

  • My computer. The model runs on your own machine, so nothing is sent anywhere and there is no counter. It downloads once, a few hundred MB, and it works offline afterwards.
  • Cloud AI. The bigger model answers instead. Nothing to install, so you can start on your first click, and it is more accurate. Clicking is free. One object from your monthly allowance goes when you save it, and saving that same object again never counts twice.

You pick at Start, and the next session can pick the other one.

0:00 / 0:00
One click, one object. Keep it on your own machine and it costs nothing.

Try it on your own map

The test that counts is a zone you actually work on. Install AI Segmentation, run it there, and compare what comes out with what you would have digitized by hand. If anything behaves oddly, the ? button carries Contact us and Report a problem.