ahCrawler



Description

ahCrawler is a set to implement your own search on your website and an analyzer for your web content.
It consists of

  • crawler (spider) and indexer
  • search for your website
  • website analyzer (http header, short titles and keywords, linkchecker, ...)


You need to install it on your own server. So all crawled data stay in your environment. If you made fixes - the rescan of your website to update search index or analyzer data is under your control.

GNU GPL v 3.0

The project is hosted on Github: ahcrawler

Download

Requirements


  • any webserver with PHP 5.5+ or 7 (PHP 7 is recommended)
  • php-curl (included in php-common)
  • php-pdo and database extension (sqlite or mysql)
  • php-mbstring
  • php-xml







Copyright © 2015-2018 Axel Hahn
project page: GitHub (en)
Axels Webseite (de)
results will be here