COVER software for video annotation - Milan - ULg

Dec 2, 2010 - Customizable Observation Video imagE Record. • Tool for displaying images and playing videos. • Make annotations. • Standalone software ...
8MB taille 2 téléchargements 295 vues
COVER software for video annotation Cyril Carré 2/12/2010 Carré

1 /37

Plan • • • •

What is COVER? Input / Output data Main functions Distribution and evolution

Carré

2 /37

What is COVER? • COVER Customizable Observation Video imagE Record

• Tool for displaying images and playing videos • Make annotations • Standalone software Carré

3 /37

Input data • Tables (Biotic Cover, Surface Geology Anthropogenic impact,…) • Navigation • Images • Videos Carré

4 /37

Input data Knowledge tables concept Classic list

TAXA Lophelia pertusa Desmophyllum dianthus

Knowledge table

Madrepora oculata AphiaID

Phylum

Class

Order

Family

Genus

Species

ScientificName

135161

Cnidaria

Anthozoa

Scleractinia

Caryophylliidae

Lophelia

pertusa

Lophelia pertusa

135159

Cnidaria

Anthozoa

Scleractinia

Caryophylliidae

Desmophyllum

dianthus

Desmophyllum dianthus

135209

Cnidaria

Anthozoa

Scleractinia

Oculinidae

Madrepora

oculata

Madrepora oculata

COVER can use simple lists and knowledge tables. Carré

5 /37

Input data Knowledge table – descriptor Color black red white

Carré

6 /37

Input data Knowledge table – without hierarchy AphiaID

ScientificName

Autor

135161

Lophelia pertusa

Linnaeus

1758

135159

Desmophyllum dianthus

Esper

1794

135209

Madrepora oculata

Linnaeus

1758

Carré

Year

7 /37

Input data Knowledge table – with hierarchy

AphiaID

Phylum

Class

Order

1363

Cnidaria

Anthozoa

Scleractinia

135161

Cnidaria

Anthozoa

Scleractinia

Caryophylliidae

Lophelia

pertusa

Lophelia pertusa

135159

Cnidaria

Anthozoa

Scleractinia

Caryophylliidae

Desmophyllum

dianthus

Desmophyllum dianthus

135209

Cnidaria

Anthozoa

Scleractinia

Oculinidae

Madrepora

oculata

Madrepora oculata

Carré

Family

Genus

Species

ScientificName Scleractinia

8 /37

Output data • Observation table – Annotations

• Observation table with coordinates – Observation table + Navigation => Position of each annotation

Carré

9 /37

Output data Observation table TIMECODE

RECORDTIME

OBSERVER

AphiaID

2002-06-25 02:26:56.379 2002-06-25 02:45:27.761

ScientificName

2010-08-14 08:28:16.437

Cyril

135161

Lophelia pertusa

2010-08-14 08:32:65.964

Cyril

135209

Madrepora oculata



“TIMECODE”: the acquisition time during the dive. “RECORDTIME”: the time when the observation is made (the computer time). “OBSERVER”: the name of the person who makes the annotation. “Data”: new columns added by the user to store the annotations.

Carré

10 /37

Input / Output data Relation between knowledge tables and annotation table Knowledge table AphiaID

Phylum

Class

Order

Family

135161

Cnidaria

Anthozoa

Scleractinia

Caryophylliidae

Genus Lophelia

Species pertusa

ScientificName Lophelia pertusa

Link

Observation table TIMECODE

RECORDTIME

2002-06-25 02:26:56.379 2002-06-25 02:45:27.761 Carré

OBSERVER

AphiaID

ScientificName

2010-08-14 08:28:16.437

Cyril

135161

Lophelia pertusa

2010-08-14 08:32:65.964

Cyril

135209

Madrepora oculata 11 /37

Input / Output data Relation between knowledge tables and annotation table Knowledge table

Knowledge table

Color AphiaID 135161



ScientificName



Red

Lophelia pertusa

White

Link

Link

Observation table TIMECODE

RECORDTIME

2002-06-25 02:26:56.379 2002-06-25 02:45:27.761 Carré

OBSERVER

AphiaID

ScientificName

Color

2010-08-14 08:28:16.437

Cyril

135161

Lophelia pertusa

Red

2010-08-14 08:32:65.964

Cyril

135209

Madrepora oculata

White 12 /37

Main functions • • • • •

Display images Play videos Snapshots generator Visualizing navigation and vehicle date Make annotations

Carré

13 /37

Main functions

Carré

14 /37

Main functions Basic Image viewer • Select one or all cameras • Zoom in and out • Synchronized with the video

15 /37

Carré Photo © NUI Galway – CE0908

Main functions Advanced image viewer • Display points • Measure distance on vertical camera image

Photo © Ifremer – BobGeo

Carré

16 /37

Photo © Ifremer – BobGeo

Carré

17 /37

Photo © Ifremer – BobGeo

Carré

18 /37

Photo © Ifremer – BobGeo

Carré

19 /37

Photo © Ifremer – BobGeo

Carré

20 /37

Measure distance

Photo © Ifremer – BobGeo

Carré

21 /37

Main functions Play videos • Increase or decrease play speed • Move frame by frame • Make snapshots • Synchronized with the images Photo © NUI Galway – CE0908

Carré

22 /37

Video control Image control pause Carré

23 /37 Photo © NUI Galway – CE0908

Main function Image control pause • Load an images file list • Play in high speed between two images • Stop on the next image Photo © NUI Galway – CE0908

Carré

24 /37

Main functions Image control pause

Carré

25 /37

Main functions Snapshots Generator

Two modules • Regular time interval • Regular distance interval Carré

26 /37

Main functions Visualizing Navigation • Synchronized with the images and video Underwater vehicle position

Carré

27 /37

Main functions Visualizing data

• Synchronized with the images and videos Carré

28 /37

Main functions Annotation Interface • Automatically generated from a XML file • Custom components • Based on knowledge tables

Carré

29 /37

Main functions Annotation Interface - main structure

Block « Substratum »

Block « Taxa »

Carré

30 /37

Shortcut Block Slider Custom button Display value Combo list New line Remember function Free comment Delete last annotation Carré

31 /37

Example : Basic interface

3 species (“LD”, “LH” and “SP”) - “P”: Presence OR - “A”: Absence

Carré

32 /37

Descriptors

Carré

33 /37

Photo © Ifremer – DYNECO - Baie de Morlaix

Count point Additional information: - Descriptors - Comment Carré

34 /37

Thank you for your attention.

Carré

35 /37