Add URLs to Blacklist

Adding a URL into the Blacklist bucket helps in keeping a specific URL away from your project collection. However, you can make it domain specific, to keep that website/domain blacklisted from your project.

If you are certain about the domains you want to blacklist, do the following:

  1. Open a project and navigate to Harvester.
  2. Click Blacklist.
  3. Enter the domain names using a wildcard (* or ?) and click Save.
    • It is recommended you use the asterisk, *, as a wildcard. This is because an asterisk replaces or represents one or more than one characters.
    • Adding a wildcard This keeps the domain, not just the URL, blacklisted from the selected project.

If you want to preview the results, add the URLs and edit them as domains, do the following:

  1. Select Harvest Search Query, enter the search items in the Text Queries box, and select a Search Engine.
  2. Select Preview & Refine.
  3. Clear the URLs from the Preview & Refine window, and click Add Unselected to the Project Blacklist.
  4. Navigate to the Blacklist tab and edit the URLs. Use wildcard (* or ?) to make them domain specific.

    A result extracted from Twitter is not needed, and you realise that you would never need any content from Twitter for this project, type *twitter.com* to keep it blacklisted from the project.

  5. Click Save.