Inspector

Inspector

Command-line tool that investigates sites for third-party content and bootstraps content pages.

Name Last Update
ValueTypesPackage Loading commit data...
.gitignore Loading commit data...
CHANGELOG Loading commit data...
CONTRIBUTING.md Loading commit data...
ContentIndex.coffee Loading commit data...
ContentIndexTest.coffee Loading commit data...
GlobalStatistics.coffee Loading commit data...
HTTPArchive.coffee Loading commit data...
HTTPArchiveTest.coffee Loading commit data...
LICENSE Loading commit data...
ParsedHAR.coffee Loading commit data...
Statistics.coffee Loading commit data...
StringExtensions.coffee Loading commit data...
Template.coffee Loading commit data...
TemplateTest.coffee Loading commit data...
dev Loading commit data...
index.coffee Loading commit data...
inquiry Loading commit data...
inquiry.coffee Loading commit data...
inspect Loading commit data...
inspect.coffee Loading commit data...
install Loading commit data...
linkify.coffee Loading commit data...
logo.coffee Loading commit data...
package.json Loading commit data...
readme.md Loading commit data...
stats Loading commit data...
stats.coffee Loading commit data...

Inspector

Inspector is a series of tools that helps bootstrap investigations into web malware (trackers, etc.)

How it works

Inspector loads in a web page from a URL (or a local HAR file) and generates an HTTP Archive (HAR file) from it and saves it in ~/better.fyi/archive/.

It then analyses the HAR file and:

  • Generates a draft entry for the site itself under ~/better.fyi/drafts/sites/
  • Generates a draft list of third-party content that is accessed by the site and adds them to ~/better.fyi/drafts/trackers/
  • Non-destructively updates the list of trackers in published site entries under ~/better.fyi/content/sites/

Drafts are just that, drafts. They are meant as a convenient starting point to an investigation with space to note what we find, not as final documents.

Drafts should never be checked into published content without manual review and editing.

This point cannot be stressed enough: the manual investigation and editing process is the heart and soul of Better.

Inquiry

Inquiry is a tool that runs inspections on the domains currently being tracked by Better.

Installation

./install

Usage

./inspect <URL>         : non-interactive
./inspect <URL> -i      : interactive
./inspect -f <path>     : analyse HTTP Archive file (.har/.har.gz) at path

./inquiry               : start an inquiry
./inquiry --local       : re-examine the existing HTTP Archives in the archive

License

Inspector is released under GNU AGPLv3.