CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
Lookyloo is a web interface allowing to scrape a website and then displays a tree of domains calling each other. https://lookyloo.circl.lu/
1,338 Commits
8 Branches
29 Tags
66 MiB
Go to file
Raphaël Vinot 30d7678d75 new: Add recent UA file 2022-04-25 13:35:22 +02:00
.github chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
bin chg: Use packaged playwright capture module 2022-04-25 13:34:01 +02:00
cache chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
config new: Switch away from splash to use playwright 2022-04-21 14:55:07 +03:00
contributing Initial set up contrib guide 2020-08-24 13:33:14 +01:00
doc new: Add installation notes 2020-08-14 15:38:01 +02:00
etc chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
indexing chg: programmatically shutdown DBs 2021-11-26 12:35:15 -05:00
known_content chg: More cleanup, support clean shutdown of multiple async captures 2021-08-25 16:40:51 +02:00
known_content_user chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
lookyloo new: Switch away from splash to use playwright 2022-04-21 14:55:07 +03:00
tools chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
user_agents new: Add recent UA file 2022-04-25 13:35:22 +02:00
website new: Switch away from splash to use playwright 2022-04-21 14:55:07 +03:00
.dockerignore chg: Do not put the content of scraped in the package. 2020-07-07 13:56:58 +02:00
.gitignore chg: Block mac files 2021-10-25 11:38:21 -04:00
.pre-commit-config.yaml chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
Dockerfile Fix SRI and discarded scrapes for lookyloo container 2022-04-08 15:18:58 +03:00
LICENSE Update LICENSE 2021-02-09 14:51:53 +01:00
README.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
SECURITY.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
code_of_conduct.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
docker-compose.yml Fix SRI and discarded scrapes for lookyloo container 2022-04-08 15:18:58 +03:00
poetry.lock chg: Use packaged playwright capture module 2022-04-25 13:34:01 +02:00
pyproject.toml chg: Use packaged playwright capture module 2022-04-25 13:34:01 +02:00
setup.py chg: Bump deps, version 2022-03-31 12:32:45 +02:00

README.md

Lookyloo icon

Lookyloo is a web interface that captures a webpage and then displays a tree of the domains, that call each other.

Gitter

What's in a name?!

Lookyloo ...

Same as Looky Lou; often spelled as Looky-loo (hyphen) or lookylou

1. A person who just comes to look.
2. A person who goes out of the way to look at people or something, often causing crowds and disruption.
3. A person who enjoys watching other people's misfortune. Oftentimes car onlookers that stare at a car accidents.

In L.A., usually the lookyloos cause more accidents by not paying full attention to what is ahead of them.

Source: Urban Dictionary

No, really, what is Lookyloo?

Lookyloo is a web interface that allows you to capture and map the journey of a website page.

Find all you need to know about Lookyloo on our documentation website.

Here's an example of a Lookyloo capture of the site github.com Screenshot of Lookyloo capturing Github

REST API

The API is self documented with swagger. You can play with it on the demo instance.

Installation

Please refer to the install guide.

Python client

pylookyloo is the recommended client to interact with a Lookyloo instance.

It is avaliable on PyPi, so you can install it using the following command:

pip install pylookyloo

For more details on pylookyloo, read the overview docs, the documentation of the module itself, or the code in this GitHub repository.

Contributing to Lookyloo

To learn more about contributing to Lookyloo, see our contributor guide.

Code of Conduct

At Lookyloo, we pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community. You can access our Code of Conduct here or on the Lookyloo docs site.

Support

  • To engage with the Lookyloo community contact us on Gitter.
  • Let us know how we can improve Lookyloo by opening an issue.
  • Follow us on Twitter.

Security

To report vulnerabilities, see our Security Policy.

Credits

Thank you very much Tech Blog @ willshouse.com for the up-to-date list of UserAgents.

License

See our LICENSE.