Semi-automatic and Automatic Video Annotation

The annotation of image and video data of large datasets is a fundamental task in multimedia information retrieval and computer vision applications. The aim of annotation tools is to relieve the user from the burden of the manual annotation as much as possible. To achieve this ideal goal, many different functionalities are required in order to make the annotations process as automatic as possible. Motivated by the limitations of existing tools, we have developed the iVAT: an interactive Video Annotation Tool. It supports manual, semi-automatic and automatic annotations through the interaction of the user with various detection algorithms. To the best of our knowledge, it is the first tool that integrates several computer vision algorithms working in an interactive and incremental learning framework. This makes the tool flexible and suitable to be used in different application domains.

Publications

An interactive tool for manual, semi-automatic and automatic video annotation
(Simone Bianco, Gianluigi Ciocca, Paolo Napoletano, Raimondo Schettini) In Computer Vision and Image Understanding, volume 131, pp. 88-99, Elsevier, 2015.

Download BibTex Doi Project Page

@article{bianco2015interactive,
 author = {Bianco, Simone and Ciocca, Gianluigi and Napoletano, Paolo and Schettini, Raimondo},
 year = {2015},
 pages = {88-99},
 title = {An interactive tool for manual, semi-automatic and automatic video annotation},
 volume = {131},
 publisher = {Elsevier},
 journal = {Computer Vision and Image Understanding},
 pdf = {/download/bianco2015interactive.pdf},
 doi = {10.1016/j.cviu.2014.06.015},
 projectref = {http://www.ivl.disco.unimib.it/research/ivat/}}

A semi-automatic annotation tool for cooking video
(Simone Bianco, Gianluigi Ciocca, Paolo Napoletano, Raimondo Schettini, Roberto Margherita, Gianluca Marini, Giorgio Gianforme, Giuseppe Pantaleo) In Image Processing: Machine Vision Applications VI, volume 8661, pp. 866112, SPIE, 2013.

BibTex Doi Project Page

@inproceedings{bianco2013semiautomatic-annotation,
 author = {Bianco, Simone and Ciocca, Gianluigi and Napoletano, Paolo and Schettini, Raimondo and Margherita, Roberto and Marini, Gianluca and Gianforme, Giorgio and Pantaleo, Giuseppe},
 year = {2013},
 pages = {866112},
 title = {A semi-automatic annotation tool for cooking video},
 volume = {8661},
 publisher = {SPIE},
 booktitle = {Image Processing: Machine Vision Applications VI},
 doi = {10.1117/12.2003878},
 projectref = {http://www.ivl.disco.unimib.it/research/ivat/}}

Cooking action recognition with iVAT: an interactive video annotation tool
(Simone Bianco, Gianluigi Ciocca, Paolo Napoletano, Raimondo Schettini, Roberto Margherita, Gianluca Marini, Giuseppe Pantaleo) In 17th International Conference on Image Analysis and Processing (ICIAP 2013), volume 8157 of Lecture Notes in Computer Science, pp. 631-641, Springer Berlin / Heidelberg, 2013.

BibTex Doi Project Page

@inproceedings{bianco2013cooking-action,
 author = {Bianco, Simone and Ciocca, Gianluigi and Napoletano, Paolo and Schettini, Raimondo and Margherita, Roberto and Marini, Gianluca and Pantaleo, Giuseppe},
 year = {2013},
 pages = {631-641},
 title = {Cooking action recognition with iVAT: an interactive video annotation tool},
 volume = {8157},
 publisher = {Springer Berlin / Heidelberg},
 series = {Lecture Notes in Computer Science},
 booktitle = {17th International Conference on Image Analysis and Processing (ICIAP 2013)},
 doi = {10.1007/978-3-642-41184-7_64},
 projectref = {http://www.ivl.disco.unimib.it/research/ivat/}}

Example videos

Publications