Difference between revisions of "Finding subdomains"

From Archiveteam
Jump to navigation Jump to search
m (More formatting fixes)
(Add additional suggestions)
Line 6: Line 6:
# Search Chrome User Experience Report origin lists, which contain domains collected using telemetry in the Chrome browser. See https://archive.org/details/crux_origin_list
# Search Chrome User Experience Report origin lists, which contain domains collected using telemetry in the Chrome browser. See https://archive.org/details/crux_origin_list
# Use Cisco Umbrella (OpenDNS) top domains lists: http://s3-us-west-1.amazonaws.com/umbrella-static/index.html
# Use Cisco Umbrella (OpenDNS) top domains lists: http://s3-us-west-1.amazonaws.com/umbrella-static/index.html
# https://osint.sh/subdomain/
# Certificate transparency logs https://crt.sh/
# Subfinder, which includes several of the above methods https://github.com/projectdiscovery/subfinder
# Twitter search
# Additional methods: https://blog.appsecco.com/a-penetration-testers-guide-to-sub-domain-enumeration-7d842d5570f6

Revision as of 22:52, 2 January 2023

There are several ways to attempt to find subdomains for a given domain, such as example.com.

  1. Perform web searches. The two primary search indexes are Bing and Google, and many other search engines use these indexes internally. Bing also has an API available. You can run queries as follows:
    Google: site:example.com.
    Bing: site:example.com+
  2. Look for existing archived subdomains in the Internet Archive CDX (which also includes data from Common Crawl):
    Get page count: https://web.archive.org/cdx/search/cdx?url=*.example.com&collapse=original&fl=original&showNumPages=1
    Iterate through pages: https://web.archive.org/cdx/search/cdx?url=*.example.com&collapse=original&fl=original&page=0
  3. Use Subdomain Finder: https://subdomainfinder.c99.nl/ Paid API also available.
  4. Search Chrome User Experience Report origin lists, which contain domains collected using telemetry in the Chrome browser. See https://archive.org/details/crux_origin_list
  5. Use Cisco Umbrella (OpenDNS) top domains lists: http://s3-us-west-1.amazonaws.com/umbrella-static/index.html
  6. https://osint.sh/subdomain/
  7. Certificate transparency logs https://crt.sh/
  8. Subfinder, which includes several of the above methods https://github.com/projectdiscovery/subfinder
  9. Twitter search
  10. Additional methods: https://blog.appsecco.com/a-penetration-testers-guide-to-sub-domain-enumeration-7d842d5570f6