A web crawler that extract everything of an URL

httpmapper

httpmapper is a web crawler made in Python.

What is this?

httpmapper is a web crawler made in Python.

• [X] Source code of an URL.
• [X] Links of a Website.
• [X] Navigate in the web just using an URL.
• [X] Get e-mails of a Website.
• [X] See Cookies of a Website.
• [X] Grab metadatas.

Usage

Python >= 3.6

git clone https://github.com/vLeeH/httpmapper.git 
cd httpmapper
pip install -r requirements.txt
python src/main.py

How it works

Firstable run the file main.py and enter the website URL.

Then choose which tool you want to use.

GitHub

https://github.com/vLeeH/httpmapper