OSINT: Content Discovery

Name: OSINT: Content Discovery
Rating: 3.8 (326 reviews)

Learn how to scan webservers

Created byPeter A

Last updated 7/2022

English

What you'll learn

How to find Websites Hidden Directories
How to find Websites Hidden Files
How to find Websites Deleted Information
How to do Automated Discovery on Websites
How to use Google More Effectively

Course content

1 section • 8 lectures • 40m total length

Introduction9:11
Identify hidden content on a web server, including admin panels and backups, using manual and automated discovery. Analyze robots.txt and favicon hashes to infer technologies.
HTTP Headers6:20
Learn how HTTP headers reveal a server’s platform and software by using curl -v to view responses, identifying ubuntu linux, Engine X, and potential vulnerabilities via exploit db.
Web Technologies3:03
Identify the technologies powering a website using a discovery tool. Learn to analyze content management systems, payment processors, frameworks, analytics, and widgets by entering a url.
Google Dorking4:07
Discover how open source intelligence tools like Google use advanced search features, site and file type filters, and title or URL queries to uncover exposed files across websites.
Wayback Machine2:23
Explore the wayback machine to view archived versions of websites, including past pages, pdfs, and contact information, and learn how these past exposures can inform osint investigations.
Github2:04
Explore GitHub as a version control tool used for collaboration, and learn how searching public projects may reveal target website information, passwords, or usernames.
Automated Discovery8:57
Discover hidden content on target websites using automated discovery with word lists and tools like Go Buster to scan for directories and files such as admin, images, and robots.txt.
Updates4:15
update your software continually to apply security updates that close vulnerabilities hackers exploit, as shown by WannaCry; keep backups and update antivirus databases across all systems.

Requirements

No prior knowledge required. Kali Linux recommended

Description

OSINT (open-source intelligence) is not a single topic. It is, in short, open-source intelligence. OSINT is as old as the internet and goes by many names including intelligence gathering (IG), information gathering (IG).

The same techniques have been used by network administrators to monitor network traffic and detect intrusions, by social media analysts to monitor hashtags and topics on Twitter, in the military to monitor potential adversaries, and in marketing to monitor competitors.

In this course we'll focus on web servers. You will learn how to find hidden directories and files on any web server or website. You'll learn how to get access to older versions of a website, about web technologies, how to view HTTP headers and how to do automated scans.

Hackers will do content discovery as part of their hacking process, if they find a web server is running. From there, they may find out ways to exploit the scripts (php, node), find documents and more.

This is a beginners course, you don't need any prior knowledge. But, you should have Kali Linux at hands. Kali Linux is a free system designed for Cyber Security and Ethical Hacking, it has around 600 hacking programs. The easiest way to start it is from a USB disk or inside Virtual Box.

Who this course is for:

Beginner Ethical Hackers
Software Developers
Detectives
Investigators