Requires Python 3.7 or higher, expects Ubuntu 20.04 or more recent.
Poetry is tool to handle dependency installation as well as building and packaging of Python packages.
curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python3
More details in the the installation guide.
You will need a running instance, and the preferred way is via Docker.
sudo apt install docker.io sudo docker pull scrapinghub/splash
Redis: An open source (BSD licensed), in-memory data structure store, used as a database, cache and message broker.
|Redis should be installed from the source, and the repository must be in the same directory as the one you will be cloning Lookyloo in to.|
In order to compile and test redis, you will need a few packages:
sudo apt install build-essential tcl
git clone https://github.com/antirez/redis.git cd redis git checkout 6.0 make # Optionally, you can run the tests: make test cd ..
Poetry is installed.
Redis is installed from the source. The repository must be in the same directory as the one you will be cloning Lookyloo in to.
Splash is installed.
Clone the Lookyloo repository.
git clone https://github.com/Lookyloo/lookyloo.git
Run the commands:
poetry install echo LOOKYLOO_HOME="'`pwd`'" > .env
If you have error messages about python 2.7, it is an issue with poetry,
and the quick and dirty fix is to edit
Initialize the user configuration
cp config/generic.json.sample config/generic.json cp config/modules.json.sample config/modules.json
Edit the config files accordingly: see the
_noteskey in the JSON file.
Make sure the configuration files are valid, and pull the 3rd party dependencies for the website
poetry run update --yes
From another terminal, run the following command:
sudo docker run -p 8050:8050 -p 5023:5023 scrapinghub/splash --disable-browser-caches # If you have a lot of ram at hand, you may want to run it this way: # sudo docker run -p 8050:8050 -p 5023:5023 scrapinghub/splash -s 100 -m 50000 --disable-browser-caches
Unless you changed the default in
config/generic.json, the web interface will be reachable at