OSINT: Advanced Web Monitoring (Virtual Course)
To be effective, OSINT should allow as much time as possible for reading, analysis, insight generation and reporting. To this end, practitioners should know how to simplify or automate routine workflows, particularly those that support the rest of the intelligence value chain. They should also know how to leverage an extended range of sources, including those in foreign languages. This course builds on our OSINT: Foundations program to help you accelerate the collection and processing of information. We will also show you how to use standard office productivity tools to automate data processing and support collation, analysis and reporting.
The course will be delivered live over five, 3.5 hour sessions. There will be separate iterations of the course for Asian, European and North American audiences.
Course Outline
Advanced Web Monitoring
Introduction to Web Monitoring
- The role of web monitoring in the OSINT workflow
- Passive vs. active web monitoring
- Selecting the right web monitoring approach
- Documenting the web monitoring process
Advanced Feed Discovery
- Prepping the browser for feed discovery
- Feed discovery strategies and tools
- Working with URL conventions
- Working with feed catalogues and search engines
- Working with multilingual feeds
Feed Generation
Generating Feeds
- Working with content selectors
- Working with HTML code
- Validating feeds
Page Monitoring
- Page monitoring tools
- Page monitoring extensions
- Page monitoring via AI tools
Monitoring News, Issues, Disciplines, and Industries
Advanced News Monitoring
- From basic to advanced news monitoring
- Working with news aggregators
- Automating feed generation
Going Beyond "Traditional" Sources
- Generating feeds from social media
- Generating feeds from blogs
- Generating feeds from newsletters
- Generating feeds from podcasts
- Generating feeds from "niche" content
Advanced Feed Processing and Workflow Automation I
Advanced Feed Processing
- Mixing feeds
- Filtering feeds
- Troubleshooting formatting issues
- Turning feeds into digests
- Feeds-based data analysis
Introduction to Workflow Automation
- Workflow automation as an important capability in OSINT
- Building a workflow automation toolkit
Workflow Automation II
Working with IFTTT
- Working with IFTTT
- Automating data capture and collation
- Generating content / warning alerts
- IFTTT and AI
Working with Zapier
- Introduction to Zapier
- Working with triggers, actions and integrations
- Developing multi-stage research “zaps”
- Zapier and AI
Beyond IFTTT and Zapier
- Working with Make.com
- Working with self-hosted workflow automation tools
Who is this Course For?
This course is designed for OSINT practitioners wishing to improve workflow and process automation. It is also recommended for professionals working in news monitoring, conflict management, crisis response, reputational risks or similar watch keeping roles.
How You Benefit
On completion of this course you will have the ability to:
- Generate news feeds and alerts en masse, including in foreign languages and from specific locations
- Capture insights from niche sources
- Separate signal from noise
- Automatically generate newsletters and e-mail digests on topics of interest
- Process data by use of AI tools
- Use process automation tools to capture, process, and organise data relevant to your work
- Use taught tools and techniques to support tasks and processes other than web monitoring
What You Receive
- A full set of course slides / user guides in PDF
- Tip sheets and cheat sheets to enable rapid learning
- An index of recommended workflows and supporting tools
- Six months of post-course support
- A certificate of completion
Course Fee
EUR 1100
Course Prerequisites
We recommend that participants wishing to take the Advanced Web Monitoring and Automation course first complete our OSINT: Foundations course.
Technical Requirements
Please observe the following requirements:
- You will need a Windows or Mac laptop (tablet computers are not recommended)
- Install Google Chrome. You will be required to install a range of browser extensions, so it is important that you have administrative rights to your laptop
- Install Zoom
- Set up a Google account to facilitate the use of different tools
- A second monitor is recommended but not essential
Additional software requirements will be sent prior to the start of the course.
