Collaborative annotation, analysis, and presentation interfaces for digital video

2009 2009

Other formats: Order a copy

Abstract (summary)

Information quality speaks to a degree of excellence in communicating knowledge or intelligence and encompasses aspects of validity, accuracy, reliability, bias, transparency, and comprehensiveness among others. Professional news, public relations, and user generated content alike all have their own subtly different information quality issues. With so much recent growth in online video, it is also apparent that more and more consumers will be getting their information from online videos and that understanding the quality of video information becomes paramount for a consumer wanting to make decisions based on it.

This dissertation explores the design and evaluation of collaborative video annotation and presentation interfaces as motivated by the desire for better information quality in online media. We designed, built, and evaluated three systems: Videolyzer, Audio Puzzler, and Videolyzer CE which contribute both to interface methods for video annotation and to mechanisms for enhancing objective metadata such as transcripts as well as subjective notions of information quality of the video itself.

Videolyzer is a semi-structured manual analysis system for a video, its transcript, and its annotations which was designed to aid bloggers and journalists collect, aggregate, and share analyses of the information quality of a video. Its interface design and evaluation explored many questions of general interest to video annotation including: granularity, transcript integration, argumentation systems, and automation. The construction of Videolyzer also entailed adequately defining information quality and operationalizing it as a set of annotations available to jumpstart people's analyses. We evaluated Videolyzer in a laboratory study and found that users' awareness and understanding of comprehensiveness, multiple perspectives, context, and quality of the video were enhanced.

One component of the evaluation of the Videolyzer interface was the effect that the inclusion of a time synchronized transcript would have on the user experience. This in turn motivated the need for a high quality time-stamped transcript of the video that would allow for interactions with the transcript to be mirrored on the video timeline. Because the accuracy of automatically produced transcriptions of video is generally poor under real-world conditions we developed Audio Puzzler, a game which as a by-product of play produces time-stamped transcripts of videos. We show that Audio Puzzler is an engaging game and further demonstrate a high accuracy of transcript metadata by leveraging an aggregation algorithm to merge many people's independently produced output.

Finally, once we had built an integrated system for analyzing videos with transcripts, we asked the question whether and to what degree the credibility of video information could be modulated for end consumers by these collected annotations. Our goal was to syndicate the knowledge collected using Videolyzer to a class of users that was less engaged, but that would still find benefit in having the additional annotation information. To do this we built and evaluated the credibility impact of simplified visualizations which showed annotation activity, polarity, and sources packaged into an online video player. Our evaluation showed that these graphics could influence people's perceptions of the credibility of a video with stronger effects exhibited for more engaged people.

Indexing (details)

Electrical engineering
0544: Electrical engineering
Identifier / keyword
Applied sciences; Collaborative annotation; Digital video; Motion estimation; Video quality
Collaborative annotation, analysis, and presentation interfaces for digital video
Diakopoulos, Nicholas A.
Number of pages
Publication year
Degree date
School code
DAI-B 70/09, Dissertation Abstracts International
Place of publication
Ann Arbor
Country of publication
United States
Essa, Irfan
Georgia Institute of Technology
University location
United States -- Georgia
Source type
Dissertations & Theses
Document type
Dissertation/thesis number
ProQuest document ID
Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works.
Document URL
Access the complete full text

You can get the full text of this document if it is part of your institution's ProQuest subscription.

Try one of the following:

  • Connect to ProQuest through your library network and search for the document from there.
  • Request the document from your library.
  • Go to the ProQuest login page and enter a ProQuest or My Research username / password.