ExperimentationΒΆ

In this section, some experiments with Scrapple are provided. There are two main types of tools that can be implemented with the Scrapple framework :

  • intro/tutorials/single_linear
  • intro/tutorials/link_crawler

Once you’ve installed Scrapple, you can see the list of available commands and the related options using the command

$ scrapple --help

The configuration file is the backbone of Scrapple. It specifies the base page URL, selectors for the data extraction, the follow link for the link crawler and several other parameters.

Examples for each type are given.

This Page