OSINT: Advanced Web Monitoring and Automation

Open enrolment and in-house options available

To be effective, OSINT should allow as much time as possible for reading, analysis, insight generation and reporting. To this end, practitioners should know how to simplify or automate routine workflows, particularly those that support the rest of the intelligence value chain. They should also know how to leverage an extended range of sources, including those in foreign languages. This course builds on our OSINT: Foundations program to help you accelerate the collection and processing of information. We will also show you how to use standard office productivity tools to automate data processing and support collation, analysis and reporting.

Course Outline

Advanced Feed Generation and Exploitation

Advanced Source Discovery

  • Defining and working with “topic ecologies”
  • Expanding your source base
  • Building and maintaining a source directory
  • Validating your sources

Feed Discovery and Processing

  • Feed discovery strategies
  • Feed discovery tools
  • Automating feed / source discovery
  • Mixing feeds
  • Filtering feeds
  • Working with feed URL conventions
  • Generating feeds via Google Sheets
  • Generating feeds using OSINT scripts

Automating OSINT Workflows

Page Monitoring

  • Page monitoring tools
  • Page monitoring extensions

Workflow and Process Automation

  • Mapping OSINT workflows
  • Automating OSINT workflows
  • Working with workflow automation tools
    (IFTTT, Zapier, etc.)

Mastering Change in OSINT

  • The knowledge ecology of OSINT
  • Monitoring the OSINT community
  • Recommended sources
  • Recommended experts
  • Customising your strategy
  • Becoming a master practitioner

Who is this Course For?

This course is designed for OSINT practitioners wishing to improve workflow and process automation. It is also recommended for professionals working in news monitoring, conflict management, crisis response, reputational risks or similar watch keeping roles.

How You Benefit

On completion of this course you will have the ability to:

  • Develop and maintain an extended index of OSINT sources
  • Generate news feeds and alerts en masse, including in foreign languages and from specific locations
  • Use process automation tools to capture and organise data relevant to your work

What You Receive

  • A full set of course slides / user guides in PDF
  • Tip sheets and cheat sheets to enable rapid learning
  • An index of recommended workflows and supporting tools
  • Six months of post-course support

Course Prerequisites

We recommend that participants wishing to take our OSINT: Advanced Web Monitoring and Automation course first complete our OSINT: Foundations course.

Course Requirements

Please bring a Windows or Mac laptop (tablets are not recommended for this course). You should install Google’s Chrome browser and set up Google and Twitter accounts to facilitate the use of different tools. You will be required to install a range of browser extensions, so it is important that you have administrative rights to your laptop.