Efficient Term Cloud Generation for Streaming Web Content

Odysseas Papapetrou, George Papadakis, Ekaterini Ioannou, Dimitrios Skoutas
L3S Research Center, University of Hannover

{papapetrou, papadakis, ioannou, skoutas}@L3S.de

Abstract: Large amounts of information are posted daily on the Web, such as articles published online by traditional news agencies or blog posts referring to and commenting on various events. Although the users sometimes rely on a small set of trusted sources from which to get their information, they often also want to get a wider overview and glimpse of what is being reported and discussed in the news and the blogosphere. In this paper, we present an approach for supporting this discovery and exploration process by exploiting term clouds. In particular, we provide an eventscient method for dynamically computing the most frequently ap- pearing terms in the posts of monitored online sources, for time intervals specified at query time, without the need to archive the actual pub- lished content. An experimental evaluation on a large-scale real-world set of blogs demonstrates the accuracy and the eventsciency of the proposed method in terms of computational time and memory requirements.

Appeared in International Conference of Web Engineering (ICWE) 2010