Overview of the Semantic Gap - What is it? The semantic gap is the difference between human perception of observations, activities, and objects and their computational or machine-based representations(). It is a split between high level features, or semantic information, and low-level features, of which there are many types. High-level features can include keywords, concepts, categories, or ontologies - virtually all things that lead to determining meanings of text-based information and phrases. Low-level features can include color, texture, resolution, encoding, salient points, etc. which are all measurable aspects of content-based information, or non-text information, such as images and videos. The spread of multimedia on the web is widening
…show more content…
(2) What is latent semantic indexing, and how has it impacted the research of CBIR and bridging the semantic gap? (3) How are 5 current methods impacting CBIR differently, and which are best for bridging the semantic gap? (4) What limitations have there been in the current research, and why are they worth investigating? (5) What are some future implications for the semantic gap, and how to better approach the research process for CBIR? The layout of the paper will present the rationale of why the semantic gap is an important area concerning IR, discuss background work pertaining to the semantic gap and image retrieval, and CBIR with high level semantics. What has been learned in the course will then be discussed, as well as some insights gained from what was learned. A personal assessment will follow, highlighting areas of research that need to be further investigated, such as balancing methods and emphasizing user experience research more. Finally, conclusions of progressions made in the research as well as areas for future study will be followed by a closing section on what the reader should have learned from the topics …show more content…
Low-level features of multimedia involve detailed perceptual aspects, while high-level features of multimedia involve semantic aspects and the general concepts of visual data. Bridging the gap between these low-level and high-level features has been a focal point in research, but remains a great challenge to resolve. Such challenges include poorly defined text descriptors, and the lack of integration between image processing, data visualization, and indexing
(2) What is latent semantic indexing, and how has it impacted the research of CBIR and bridging the semantic gap? (3) How are 5 current methods impacting CBIR differently, and which are best for bridging the semantic gap? (4) What limitations have there been in the current research, and why are they worth investigating? (5) What are some future implications for the semantic gap, and how to better approach the research process for CBIR? The layout of the paper will present the rationale of why the semantic gap is an important area concerning IR, discuss background work pertaining to the semantic gap and image retrieval, and CBIR with high level semantics. What has been learned in the course will then be discussed, as well as some insights gained from what was learned. A personal assessment will follow, highlighting areas of research that need to be further investigated, such as balancing methods and emphasizing user experience research more. Finally, conclusions of progressions made in the research as well as areas for future study will be followed by a closing section on what the reader should have learned from the topics …show more content…
Low-level features of multimedia involve detailed perceptual aspects, while high-level features of multimedia involve semantic aspects and the general concepts of visual data. Bridging the gap between these low-level and high-level features has been a focal point in research, but remains a great challenge to resolve. Such challenges include poorly defined text descriptors, and the lack of integration between image processing, data visualization, and indexing