Illustration of our interactive segmentation pipeline. A user draws an outline (in red) around the object of interest (left). The outline is considered foreground and its Blum medial axis is considered foreground (center). The GrabCut algorithm is then applied to extract a segmentation maskl (right).

Outlining Objects for Interactive Segmentation on Touch Devices

M. Pizenberg, A. Carlier, E. Faure, V. Charvillat.
ACM Multimedia, 2017

PDF Slides Poster

Abstract

Interactive segmentation consists in building a pixel-wise partition of an image, into foreground and background regions, with the help of user inputs. Most state-of-the-art algorithms use scribblebased interactions to build foreground and background models, and very few of these work focus on the usability of the scribbling interaction. In this paper we study the outlining interaction, which is very intuitive to non-expert users on touch devices. We present an algorithm, built upon the existing GrabCut algorithm, which infers both foreground and background models out of a single outline. We conducted a user study on 20 participants to demonstrate the usability of this interaction, and its performance for the task of interactive segmentation.