CIRCL
/
lookyloo
mirror of https://github.com/CIRCL/lookyloo
2
0
Fork 0
Code Issues Releases Wiki Activity
Lookyloo is a web interface allowing to scrape a website and then displays a tree of domains calling each other. https://lookyloo.circl.lu/
1,611 Commits
8 Branches
33 Tags
19 MiB
Go to file
Raphaël Vinot b7302d09b5 fix: pass the browser to the brower key. 2022-12-02 14:26:08 +01:00
.github fix: numpy install issue with python < 3.10 2022-10-27 13:47:52 +02:00
bin fix: pass the browser to the brower key. 2022-12-02 14:26:08 +01:00
cache chg: Use more recent config file for redis 2022-08-25 10:40:57 +02:00
config new: URL Haus module 2022-11-30 18:38:41 +01:00
contributing Initial set up contrib guide 2020-08-24 13:33:14 +01:00
doc new: Add installation notes 2020-08-14 15:38:01 +02:00
etc fix: Allow upload of bigger files 2022-09-21 15:26:40 +02:00
indexing chg: Use more recent config file for redis 2022-08-25 10:40:57 +02:00
known_content chg: More cleanup, support clean shutdown of multiple async captures 2021-08-25 16:40:51 +02:00
known_content_user chg: Cleanups, allow to add context from ressources page 2020-09-03 16:32:53 +02:00
logs new: Logging config in file 2022-11-23 15:54:22 +01:00
lookyloo fix: Do not pass the user_agent if a device_name is set 2022-12-02 09:57:56 +01:00
tools chg: Bump datatables 2022-11-18 11:40:43 +01:00
user_agents chg: Improve somewhat the useragents available for capturing 2022-06-09 18:58:17 +02:00
website fix: do not keep the selected os-type on page reload (Firefox bug only) 2022-12-02 09:57:03 +01:00
.dockerignore chg: Do not put the content of scraped in the package. 2020-07-07 13:56:58 +02:00
.gitignore chg: Block mac files 2021-10-25 11:38:21 -04:00
.pre-commit-config.yaml chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
Dockerfile fix: remove setup.py from dockerfile 2022-08-31 17:42:01 +02:00
LICENSE Update LICENSE 2021-02-09 14:51:53 +01:00
README.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
SECURITY.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
code_of_conduct.md chg: Add basic pre-hook config 2022-03-31 11:30:53 +02:00
docker-compose.yml chg: Remove splash from docker stuff 2022-04-25 15:48:07 +02:00
poetry.lock chg: Bump deps 2022-12-02 10:37:35 +01:00
pyproject.toml chg: Bump deps 2022-12-02 10:37:35 +01:00

README.md

Lookyloo icon

Lookyloo is a web interface that captures a webpage and then displays a tree of the domains, that call each other.

Gitter

What's in a name?!

Lookyloo ...

Same as Looky Lou; often spelled as Looky-loo (hyphen) or lookylou

1. A person who just comes to look.
2. A person who goes out of the way to look at people or something, often causing crowds and disruption.
3. A person who enjoys watching other people's misfortune. Oftentimes car onlookers that stare at a car accidents.

In L.A., usually the lookyloos cause more accidents by not paying full attention to what is ahead of them.

Source: Urban Dictionary

No, really, what is Lookyloo?

Lookyloo is a web interface that allows you to capture and map the journey of a website page.

Find all you need to know about Lookyloo on our documentation website.

Here's an example of a Lookyloo capture of the site github.com Screenshot of Lookyloo capturing Github

REST API

The API is self documented with swagger. You can play with it on the demo instance.

Installation

Please refer to the install guide.

Python client

pylookyloo is the recommended client to interact with a Lookyloo instance.

It is avaliable on PyPi, so you can install it using the following command:

pip install pylookyloo

For more details on pylookyloo, read the overview docs, the documentation of the module itself, or the code in this GitHub repository.

Contributing to Lookyloo

To learn more about contributing to Lookyloo, see our contributor guide.

Code of Conduct

At Lookyloo, we pledge to act and interact in ways that contribute to an open, welcoming, diverse, inclusive, and healthy community. You can access our Code of Conduct here or on the Lookyloo docs site.

Support

  • To engage with the Lookyloo community contact us on Gitter.
  • Let us know how we can improve Lookyloo by opening an issue.
  • Follow us on Twitter.

Security

To report vulnerabilities, see our Security Policy.

Credits

Thank you very much Tech Blog @ willshouse.com for the up-to-date list of UserAgents.

License

See our LICENSE.