CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
Lookyloo is a web interface allowing to scrape a website and then displays a tree of domains calling each other. https://lookyloo.circl.lu/
1,443 Commits
10 Branches
33 Tags
22 MiB
Go to file
Raphaël Vinot e89e9a20cb fix: Force BG processor to index all the recent captures 2022-08-12 01:08:28 +02:00
.github chg: Remove cron from docker publish 2022-08-10 18:54:01 +02:00
bin fix: Force BG processor to index all the recent captures 2022-08-12 01:08:28 +02:00
cache chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
config fix: Typo in modules config file 2022-07-19 11:24:14 +02:00
contributing Initial set up contrib guide 2020-08-24 13:33:14 +01:00
doc new: Add installation notes 2020-08-14 15:38:01 +02:00
etc chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
indexing chg: programmatically shutdown DBs 2021-11-26 12:35:15 -05:00
known_content chg: More cleanup, support clean shutdown of multiple async captures 2021-08-25 16:40:51 +02:00
known_content_user chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
lookyloo fix: properly handle listing configuration, clear None from queries before pasing to redis 2022-08-10 18:53:14 +02:00
tools chg: Cleanup website status in monitoring 2022-07-28 15:33:04 +02:00
user_agents chg: Improve somewhat the useragents available for capturing 2022-06-09 18:58:17 +02:00
website chg: Display size of rendered page 2022-08-05 16:43:41 +02:00
.dockerignore chg: Do not put the content of scraped in the package. 2020-07-07 13:56:58 +02:00
.gitignore chg: Block mac files 2021-10-25 11:38:21 -04:00
.pre-commit-config.yaml chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
Dockerfile fix: Mypy, docker 2022-04-26 00:59:57 +02:00
LICENSE Update LICENSE 2021-02-09 14:51:53 +01:00
README.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
SECURITY.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
code_of_conduct.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
docker-compose.yml chg: Remove splash from docker stuff 2022-04-25 15:48:07 +02:00
poetry.lock chg: Bump deps 2022-08-12 00:06:59 +02:00
pyproject.toml chg: Bump deps 2022-08-12 00:06:59 +02:00
setup.py chg: Bump version 2022-08-08 15:18:41 +02:00

README.md

Lookyloo icon

Lookyloo is a web interface that captures a webpage and then displays a tree of the domains, that call each other.

Gitter

What's in a name?!

Lookyloo ...

Same as Looky Lou; often spelled as Looky-loo (hyphen) or lookylou

1. A person who just comes to look.
2. A person who goes out of the way to look at people or something, often causing crowds and disruption.
3. A person who enjoys watching other people's misfortune. Oftentimes car onlookers that stare at a car accidents.

In L.A., usually the lookyloos cause more accidents by not paying full attention to what is ahead of them.

Source: Urban Dictionary

No, really, what is Lookyloo?

Lookyloo is a web interface that allows you to capture and map the journey of a website page.

Find all you need to know about Lookyloo on our documentation website.

Here's an example of a Lookyloo capture of the site github.com Screenshot of Lookyloo capturing Github

REST API

The API is self documented with swagger. You can play with it on the demo instance.

Installation

Please refer to the install guide.

Python client

pylookyloo is the recommended client to interact with a Lookyloo instance.

It is avaliable on PyPi, so you can install it using the following command:

pip install pylookyloo

For more details on pylookyloo, read the overview docs, the documentation of the module itself, or the code in this GitHub repository.

Contributing to Lookyloo

To learn more about contributing to Lookyloo, see our contributor guide.

Code of Conduct

At Lookyloo, we pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community. You can access our Code of Conduct here or on the Lookyloo docs site.

Support

  • To engage with the Lookyloo community contact us on Gitter.
  • Let us know how we can improve Lookyloo by opening an issue.
  • Follow us on Twitter.

Security

To report vulnerabilities, see our Security Policy.

Credits

Thank you very much Tech Blog @ willshouse.com for the up-to-date list of UserAgents.

License

See our LICENSE.