Tutorials

• Finding URLs for web corpora
  • Existing corpus resources
  • URL directories
  • Social Networks
  • Search Engines
  • Selecting random documents from the Web
  • Remarks and references
• Tutorial: Gathering a custom web corpus
  • Get your system up and running
  • Content discovery
  • Link filtering
  • Process a list of links
• Tutorial: From a list of links to a frequency list
  • Get your system up and running
  • Process a list of links
  • Build frequency lists
• Tutorial: Validation of TEI files
  • Producing TEI files
  • Validating existing files
• Work with the data
  • Generic solutions in Python
  • XML and XML-TEI
  • NLP
• Tutorial: DWDS-Korpusdaten reproduzieren
  • Ziel
  • Bedingungen
  • Von der einfachen Abfrage zur Einsicht der Quellen
  • Download der Daten

External resources

• Youtube playlist: Web scraping how-tos and tutorials.

• GLAM-Workbench

  • Harvesting collections of text from archived web pages

  • Compare two versions of an archived web page

• User Ethics & Legal Concerns

• Download von Web-Daten & Daten aufbereiten und verwalten (Tutorials in German by Noah Bubenhofer)