CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
Lookyloo is a web interface allowing to scrape a website and then displays a tree of domains calling each other. https://lookyloo.circl.lu/
1,960 Commits
8 Branches
29 Tags
66 MiB
Go to file
Raphaël Vinot 353015096e new: Use S3FS in archiving script instead, remove python 3.12 uspport 2023-10-23 13:35:29 +02:00
.github new: Use S3FS in archiving script instead, remove python 3.12 uspport 2023-10-23 13:35:29 +02:00
bin new: Use S3FS in archiving script instead, remove python 3.12 uspport 2023-10-23 13:35:29 +02:00
cache chg: Use more recent config file for redis 2022-08-25 10:40:57 +02:00
config new: Don't attempt to initialize indexes if they're on a s3fs mount 2023-10-04 11:06:02 +02:00
contributing Initial set up contrib guide 2020-08-24 13:33:14 +01:00
doc new: Add installation notes 2020-08-14 15:38:01 +02:00
etc fix: Allow upload of bigger files 2022-09-21 15:26:40 +02:00
indexing chg: Use more recent config file for redis 2022-08-25 10:40:57 +02:00
known_content new: yet another single px GIF 2023-07-18 12:54:07 +02:00
known_content_user chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
logs new: Logging config in file 2022-11-23 15:54:22 +01:00
lookyloo fix: Avoid exception when there is no URL to send to VT 2023-10-21 16:59:23 +02:00
tools chg: Bump deps, supports urllib3 2023-10-21 21:22:20 +02:00
user_agents chg: Improve somewhat the useragents available for capturing 2022-06-09 18:58:17 +02:00
website fix: Update legend with downloaded icon 2023-09-28 17:15:48 +02:00
.dockerignore chg: Do not put the content of scraped in the package. 2020-07-07 13:56:58 +02:00
.gitignore chg: Block mac files 2021-10-25 11:38:21 -04:00
.pre-commit-config.yaml chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
Dockerfile fixes for running lookyloo using docker-compose 2023-03-06 09:04:26 +01:00
LICENSE Update LICENSE 2021-02-09 14:51:53 +01:00
README.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
SECURITY.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
code_of_conduct.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
docker-compose.yml fix: Add few more volumes for docker 2023-03-06 14:49:03 +01:00
poetry.lock new: prepare s3fs support for archives 2023-10-22 01:18:34 +02:00
pyproject.toml new: Use S3FS in archiving script instead, remove python 3.12 uspport 2023-10-23 13:35:29 +02:00

README.md

Lookyloo icon

Lookyloo is a web interface that captures a webpage and then displays a tree of the domains, that call each other.

Gitter

What's in a name?!

Lookyloo ...

Same as Looky Lou; often spelled as Looky-loo (hyphen) or lookylou

1. A person who just comes to look.
2. A person who goes out of the way to look at people or something, often causing crowds and disruption.
3. A person who enjoys watching other people's misfortune. Oftentimes car onlookers that stare at a car accidents.

In L.A., usually the lookyloos cause more accidents by not paying full attention to what is ahead of them.

Source: Urban Dictionary

No, really, what is Lookyloo?

Lookyloo is a web interface that allows you to capture and map the journey of a website page.

Find all you need to know about Lookyloo on our documentation website.

Here's an example of a Lookyloo capture of the site github.com Screenshot of Lookyloo capturing Github

REST API

The API is self documented with swagger. You can play with it on the demo instance.

Installation

Please refer to the install guide.

Python client

pylookyloo is the recommended client to interact with a Lookyloo instance.

It is avaliable on PyPi, so you can install it using the following command:

pip install pylookyloo

For more details on pylookyloo, read the overview docs, the documentation of the module itself, or the code in this GitHub repository.

Contributing to Lookyloo

To learn more about contributing to Lookyloo, see our contributor guide.

Code of Conduct

At Lookyloo, we pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community. You can access our Code of Conduct here or on the Lookyloo docs site.

Support

  • To engage with the Lookyloo community contact us on Gitter.
  • Let us know how we can improve Lookyloo by opening an issue.
  • Follow us on Twitter.

Security

To report vulnerabilities, see our Security Policy.

Credits

Thank you very much Tech Blog @ willshouse.com for the up-to-date list of UserAgents.

License

See our LICENSE.