Requires Python 3.8 or higher, expects Ubuntu 20.04 or more recent.
Poetry is tool to handle dependency installation as well as building and packaging of Python packages.
curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python3
More details in the the installation guide.
You will need a running instance, and the preferred way is via Docker.
|If you installed Lookyloo on Windows, you already installed docker. You only have to execute the second line of the following snippet|
|On Ubuntu, you may want to have a look at this installation guide, which will provide a more recent version of docker.|
And if you just want to get going on linux, here it is:
sudo apt install docker.io sudo docker pull scrapinghub/splash
Redis: An open source (BSD licensed), in-memory data structure store, used as a database, cache and message broker.
|Redis should be installed from the source, and the repository must be in the same directory as the one you will be cloning Lookyloo in to.|
In order to compile and test redis, you will need a few packages:
sudo apt-get update sudo apt install build-essential tcl
git clone https://github.com/antirez/redis.git cd redis git checkout 6.2 make # Optionally, you can run the tests: make test cd ..
In order to use the Universal Whois you have to install uwhoisd from Lookyloo repository and the whois package:
sudo apt-get update sudo apt-get install whois
git clone https://github.com/Lookyloo/uwhoisd cd uwhoisd poetry install
Then configure the service file
sudo cp etc/systemd/system/uwhoisd.service.sample /etc/systemd/system/uwhoisd.service cd .. sudo systemctl daemon-reload sudo systemctl start uwhoisd sudo systemctl status uwhoisd
If everything is ok, activate the service for reboot
sudo systemctl enable uwhoisd
Poetry is installed.
Redis is installed from the source. The repository must be in the same directory as the one you will be cloning Lookyloo in to.
Splash is installed.
Clone the Lookyloo repository.
git clone https://github.com/Lookyloo/lookyloo.git
Run the commands:
poetry install echo LOOKYLOO_HOME="'`pwd`'" > .env
If you have error messages about python 2.7, it is an issue with poetry,
and the quick and dirty fix is to edit
Initialize the user configuration
cp config/generic.json.sample config/generic.json cp config/modules.json.sample config/modules.json
Edit the config files accordingly to your needs: see the
_noteskey in the JSON file. You can also look at the integration page for more information regarding the modules, and the configuration page for the generic configuration options.
Make sure the configuration files are valid, and pull the 3rd party dependencies for the website
poetry run update --yes
From another terminal, run the following command:
sudo docker run -p 8050:8050 -p 5023:5023 scrapinghub/splash --disable-browser-caches # If you have a lot of ram at hand, you may want to run it this way: # sudo docker run -p 8050:8050 -p 5023:5023 scrapinghub/splash -s 100 -m 50000 --disable-browser-caches
Note: you may want to remove
--disable-browser-caches, as it is causing issue on some websites (generally, splash segfaults).
Unless you changed the default in
config/generic.json, the web interface will be reachable at