Tag wtyczki: robots.txt
-
Sitemapster
Fast XML and image sitemaps for WordPress with independent controls, smart caching, readable XML, and no files written to disk.
-
A3 Robots Warning
Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
-
SEO Auditor Tools
Scan your WordPress site for SEO issues and get actionable fixes. Includes sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analytics, UTM b …
-
Index Harmony
One-click AI readiness plus real AI-crawler analytics: llms.txt, bot rules, schema, and per-page AI crawl insights — free.
-
Kandeshop LLMS.txt Generator
Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.
-
Virtual LLMS.TXT Generator
Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.
-
Forge AI Bot Log – Block AI Bots, Crawler Detection & Verification
Detect, verify and block AI crawlers, bots and scrapers. Vendor IP lists and reverse-DNS checks flag spoofed user agents, not trust them.
-
VDL Search Visibility Scanner – Noindex, Sitemap & SEO Audit
Check whether WordPress pages are technically discoverable with noindex, robots.txt, canonical, sitemap, redirect, and status-code checks.
-
AWP Disallow Root Control
Disallow access to the root directory via robots.txt with an option to enable or disable.
-
Purlbot – SEO, Security & Site Health
SEO, security, performance, sitemap, schema, redirects, and AI SEO/AEO/GEO tools to optimize your site for search engines and AI answer engines.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
AI Rights Protection by SimpleFeed
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
AKSA AI Monitor – AI Crawler Analytics & Bot Control
Measure detected AI crawler activity, see which content is accessed, identify AI referral visits, and manage bot access locally.
-
GoBookMart Robots Editor
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Everlange Connect – llms.txt, AI robots.txt & JSON-LD
Free llms.txt and AI-crawler robots.txt for your site, generated locally — no account needed. Get cited by ChatGPT, Perplexity, Claude and Gemini.
-
Advanced SEO Toolkit
Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
-
Block old browser versions and suspicious browsers
With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
-
FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots
Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.
-
AITooler Bot Analytics – AI Crawler Tracking & Visibility
See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.
-
LLMs.txt – AI Website Content Crawling
Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.