Added support for additional crawler variants including Google-Agent (mobile and desktop), Google-Extended, Bing (Search, Chat, and Copilot), Claude-SearchBot, Perplexity-User, DuckDuckGo AI, Applebot-Extended, and Meta-ExternalFetcher.
Improved crawler tracking for non-post frontend URLs such as archives, taxonomy pages, and other site URLs.
Improved site-wide reporting so the latest page visited by each crawler is more accurate.
Improved admin bar reporting for both singular content and non-singular frontend URLs.
Improved robots.txt reporting with clearer diagnostics showing the matched group and rule.
Added informational robots status handling for agents that may ignore or bypass robots.txt, such as Google-Agent and Meta-ExternalFetcher.
Improved handling of the WordPress “Discourage search engines” setting with clearer blocked-status warnings in the admin interface.
Improved storage of recent crawler activity with bounded recent-page history per agent.
0.9.1
Fixed error on any WP archive pages (pages that list posts).
0.9.0
Updated for WordPress 6.9
Now monitoring for Meta and Apple User Agents
More accurate site-wide UA reporting.
Ensured video tutorial appears on all admin screens.
Fixed small code errors.
0.8.0
Google updated its useragents so I updated the matching strings to account for these changes.
0.7.0
The robots.txt checker wasn’t actually working. It does now.
When you look at the report in the admin section, the robots checker is looking for a site-wide rule; when you look at the back-end of a page, the robots checker is looking at that particular page.
If a page is blocked by the robots.txt file, a link appears sending you to the robots.txt file.
