ahCrawler

Description

ahCrawler is a set to implement your own search on your website and an analyzer for your web content.
It consists of

• crawler (spider) and indexer
• search for your website
• website analyzer (http header, short titles and keywords, linkchecker, ...)

You need to install it on your own server. So all crawled data stay in your environment. If you made fixes - the rescan of your website to update search index or analyzer data is under your control.

GNU GPL v 3.0

The project is hosted on Github: ahcrawler

Download