Boilerplate Removal using a Neural Sequence Labeling Model

The extraction of main content from web pages is an important task for numerous applications, ranging from usability aspects, like reader views for news articles in web browsers, to information retrieval or natural language processing. Existing approaches are lacking as they rely on large amounts of hand-crafted features for classification. This results in models that are tailored to a specific distribution of web pages, e.g. from a certain time frame, but lack in generalization power. We propose a neural sequence labeling model that does not rely on any hand-crafted features but takes only the HTML tags and words that appear in a web page as input. This allows us to present a browser extension which highlights the content of arbitrary web pages directly within the browser using our model. In addition, we create a new, more current dataset to show that our model is able to adapt to changes in the structure of web pages and outperform the state-of-the-art model.

Tags
Data and Resources
To access the resources you must log in
  • Link to Publication

    The resource: 'Link to Publication' is not accessible as guest user. You must login to access it!
Additional Info
Field Value
Author Leonhardt, Jurek leonhardt@l3s.de
Author Anand, Avishek anand@L3S.de
Author Khosla, Megha khosla@L3S.de
DOI https://doi.org/10.1145/3366424.3383547
Group Select Group
Publisher ACM Digital Library
Source WWW '20: Companion Proceedings of the Web Conference 2020 April 2020 Pages 226–229
Thematic Cluster Web Analytics [WA]
system:type ConferencePaper
Management Info
Field Value
Source https://arxiv.org/abs/2004.14294
Author Wright Joanna
Maintainer Jurek Leonhardt
Version 1
Last Updated 6 May 2021, 13:30 (CEST)
Created 8 February 2021, 13:22 (CET)