Metis is a tool to collect information from the content of web sites. This was written for the Ideahamster Group for finding the competitive intelligence weight of a web server and assists in satisfying the CI Scouting portion of the Open Source Security Testing Methodology Manual (OSSTMM). The tool is distributed under the GNU Public license.
The too is written in Java and is composed of 2 packages:
The web spider engine : the faust.sacha.web java package
This package handles the web spidering process, collects and stores the information in memory.
The data analysis part : Metis org.idehamster.metis java package
This package reads the data collected by the spider and generate a report