Semantic (Video) Indexing

Semantic indexing

presented at the 2008 Video Search Summit

by Dr Marcel Worring, Head of Research for the MediaMill University of Amsterdam.

Marcel discusses the 2 problems that exist, namely, the Semantic Gap, and the Sensory Gap. He then takes you through an incredible video where he demonstrates video visuals of the Semantic Pathfinder Algorithm.

视频不错,把图像处理的过程介绍得很形象。

The sensory gap is the gap between the object in the world and the information in a (computational) description derived from a recording of that scene.[1]

For broad image domains in particular, one has to resort to generally valid prin-ciples.

  • Is the illumination of the domain white or colored?
  • Does it assume fullyvisible objects, or may the scene contain clutter and occluded objects as well?
  • Is it a 2D-recording of a 2D-scene or a 2D-recording of a 3D-scene?

The given characteristics of illumination, presence or absence of occlusion, clutter, and differences in camera viewpoint, determine the demands on the methods of retrieval.

The sensory gap makes the description of objects an ill-posed problem: it yields uncertainty in what is known about the state of the object. The sensory gap is particularly poignant when a precise knowledge of the recording conditions is missing.

The 2D-records of different 3D-objects can be identical.Without further knowledge,one has to decide that they might  represent the same object.

Also, a 2D-recording of a 3D- scene contains information accidental for that scene and that sensing but one does not know what part of the information is scene related.

The uncertainty due to the sensory gap does not only hold for the viewpoint, but also for occlusion(where essential parts telling two objects apart may be out of sight), clutter, and illumination.

[1] A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, “Content-based image retrieval at the end
of the early years,” IEEE Trans. on PAMI, vol. 22, no. 12, pp. 1349–1380, Dec. 2000.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

生活在西班牙

自己动手丰衣足食

BlueAsteroid

Just another WordPress.com site

Jing's Blog

Just another WordPress.com site

Start from here......

我的心情魔方

天才遠私廚

希望能做一個分享各種資訊的好地方

语义噪声

西瓜大丸子汤的博客

笑对人生,傲立寰宇

Just another WordPress.com site

Where On Earth Is Waldo?

A Project By Melanie Coles

the Serious Computer Vision Blog

A blog about computer vision and serious stuff

Cauthy's Blog

paper review...

Cornell Computer Vision Seminar Blog

Blog for CS 7670 - Special Topics in Computer Vision

datarazzi

Life through nerd-colored glasses

Luciana Haill

Brainwaves Augmenting Consciousness

槑烎

1,2,∞

Dr Paul Tennent

and the university of nottingham

turn off the lights, please

A bunch of random, thinned and stateless thoughts around the Web

%d bloggers like this: