My paper “Building a Scalable Collaborative Web Filter with Free and Open Source Software” has been accepted for publication and presentation at this year’s IEEE International Conference on Signal-Image Technology & Internet-based Systems (SITIS) which will be held in Bali, Indonesia, from November 30 - December 03, 2008.

Abstract

In this case study, we describe the design and architecture of a scalable collaborative web filtering service, TaggyBear, which is powered by free and open source software. We will introduce the reader to the ideas and concepts behind TaggyBear, and discuss why we picked the software components that form the basis of the service. We will talk about how we combined or extended their functionality to build the TaggyBear service, and provide some initial benchmarking results and performance figures.

Note for fellow developers: The described system components include Pylons, MySQL, Tokyo Cabinet/Tokyo Tyrant, Pylog (custom app based on Twisted), Hadoop, and on the client side a Firefox Add-On.

Full Paper & Presentation

• M. G. Noll, C. Meinel, Building a Scalable Collaborative Web Filter with Free and Open Source Software (PDF), Proceedings of 4th IEEE Signal-Image Technology & Internet-based Systems (SITIS), IEEE CS Press, Bali, Indonesia, November 2008, pp. 563-571, ISBN 978-0-7695-3493-0 (IEEE Link, BibTeX)

Related Links

• List of my publications
• Design and Anatomy of a Social Web Filtering Service, Proceedings of 4th International Conference on Cooperative Internet Computing (CIC), Hong Kong, October 2006, pp. 35-44, ISBN 978-981-281-109-7