Urx Documentation

v0.9.0

The URL Extraction Tool
for Security Research

A fast, Rust-based CLI tool that extracts URLs from OSINT archives for bug bounty hunting, security research, and attack surface mapping.

Terminal
$ urx example.com --subs -e js,php --patterns api
https://example.com/api/v1/users.js
https://example.com/api/v2/config.php
https://sub.example.com/api/auth.js
https://dev.example.com/api/graphql.php
...
$ urx example.com --providers wayback,cc,otx,vt -f json -o results.json
Fetching from 4 providers... done (1,247 URLs collected)

Multi-Source Collection

Fetch URLs from Wayback Machine, Common Crawl, OTX, VirusTotal, URLScan, and ZoomEye in parallel.

Advanced Filtering

Filter by extensions, patterns, or presets. Control URL length, host parts, and more.

Flexible Output

Plain text, JSON, and CSV formats. Stream to console, file, or pipe into other tools.

URL Validation

Check HTTP status codes, extract additional links, and filter by response status.

Caching & Incremental

Built-in SQLite and Redis caching. Incremental scanning returns only new URLs.

Built with Rust

Async processing, parallel requests, and minimal resource footprint for maximum speed.