AI Crawlers Visibility, Analytics & Control

1.3.0

• Added WooCommerce AI Search Optimization under Discoverability (optional when WooCommerce is active).
• Enriched product entries in llms.txt with price, stock, ratings, attributes, and variable/sale pricing.
• Added product Markdown endpoints with commerce YAML frontmatter.
• Added Product JSON-LD schema (auto-skipped when Yoast, Rank Math, AIOSEO, or SEOPress already output Product schema).
• Added Product data → AI Visibility tab to exclude products or set an AI short description.
• Added HTTP Link header to llms.txt (rel=”ai-content-index”).
• Added product Visibility Score checks for Product schema, SKU, and price.

1.2.1

• Added site-wide Visibility Score scan from the Visibility page with batch progress and per-URL results.
• Added 5 built-in crawlers: Cotoyogi, ExaBot, VelenPublicWebCrawler, Omgilibot, and Thinkbot (78 total).
• Added a new AI agent category for custom crawlers, filters, and bulk robots templates; reclassified Google-Agent, Devin, FirecrawlAgent, and NovaAct.
• Expanded AI Visibility Score from 26 to 28 checks (semantic HTML5 landmarks and JavaScript-dependent content detection).

1.2.0

• Added a complete Reports page with report downloads, email delivery settings, schedule status, test email support, and REST API information.
• Added scheduled daily or weekly HTML email reports with configurable recipients and alert types.
• Added email alerts for crawler activity, traffic changes, blocked attempts, newly detected crawlers, and robots.txt non-compliance.
• Added professional grayscale email summaries with key metrics, the top crawler, and most-crawled pages.
• Added authenticated moai-av/v1 REST endpoints for analytics summaries, recent activity, CSV exports, visibility scans, and blocked attempts.
• Added compact multi-select crawler, category, HTTP status, and content-type filters to Recent Activity.
• Added downloadable reports with preset periods and custom From/To date ranges.
• Improved report settings with immediate schedule-status updates and clearer admin notices.
• Added a graceful error when the server is missing the PHP DOM/XML extension required by Visibility Score, preventing a fatal error.

1.1.2

• Added Blocked IP Addresses under AI Crawlers → Control — block specific IPs with PHP 403.
• Added taxonomy markdown archives for Markdown for Agents (categories, tags, and other public taxonomies).
• Added 5 built-in crawlers: Timesbot, TavilyBot, Andibot, Brightbot, and NovaAct (73 total).
• Expanded AI Visibility Score from 19 to 26 checks (llms-full.txt, Markdown delivery, noai/noimageai, Twitter cards, HTML lang, heading hierarchy, image alt text).

1.1.1

• Added robots.txt compliance monitor — top non-compliant crawlers with one-click PHP block.
• Added category bulk templates to disallow or allow entire crawler categories at once.
• Added WordPress admin dashboard widget (miniOrange AI Crawlers) with last-7-days activity summary.

1.1.0

• Added customizable PHP 403 block message under AI Crawlers → Control → PHP blocking.
• Blocked AI crawlers receive your saved plain-text response instead of a generic “Access denied” (sanitized, 500-character limit).
• Added Discoverability page with llms.txt generator, Markdown for Agents, and JSON-LD schema output.
• llms.txt supports post-type filters, max URLs, llms-full.txt, auto-regenerate on publish, and scheduled cron.
• llms.txt robots.txt integration — optional LLMs: and LLMs-full: references in robots.txt.
• llms.txt content controls — exclude by URL pattern, manual include/exclude posts, and post search in admin.
• Markdown endpoints serve /{slug}.md plus content negotiation for AI agents.
• JSON-LD includes site identity, AI discovery pointers, and optional Article schema.
• Visibility Score — improved robots.txt detection (physical and virtual files, no HTTP loopback required).
• Visibility Score — improved XML sitemap detection for WordPress core, Yoast SEO, and Rank Math.
• Fixed Visibility recommendation link for robots.txt to open AI Crawlers → Control.

1.0.2

• Redesigned admin UI with modern sidebar navigation, dark mode, and refreshed dashboard layouts.
• Added AI Visibility Score tab with single-URL and site-wide scanning.
• Added 19 readiness checks, recommendations, scan history, diff, and PDF export.
• Added visibility scan database tables.

1.0.1

• Added crawler analytics dashboard with date ranges, filters, period comparison, and charts.
• Added AI crawler monitoring, custom crawlers, robots.txt rules, and PHP blocking (403).
• Added grouped side navigation for Analytics and AI Crawlers admin pages.
• Added miniOrange menu and navbar branding.
• Expanded built-in AI crawler list and crawler info tooltips.

1.0.0

• Initial release with MVC architecture and free/premium codebase structure.
• Added admin dashboard foundation.