sandywp / plugins / recrawler
ReCrawler
ReCrawler is a small WordPress Plugin for quickly notifying search engines whenever their website content is created, updated, or deleted.
Ready in seconds.
v0.3.3 4,000+ installs WP 6.0+ PHP 8.1+
What you get inside
8 screensAbout this plugin
ReCrawler is a small WordPress Plugin for quickly notifying search engines whenever their website content is created, updated, or deleted.
Improve your rankings by taking control of the crawling and indexing process, so search engines know what to focus on!
Once installed, it detects pages/terms creation/update/deletion in WordPress and automatically submits the URLs in the background via ReCrawler, Google API, Bing API, Yandex API, and WebSub (formerly PubSubHubbub) protocols.
It ensures that search engines invariably have the latest updates about your site.
🤖 What is ReCrawler?
ReCrawler is an easy way for websites owners to instantly inform search engines about latest content changes on their website. In its simplest form, ReCrawler is a simple ping so that search engines know that a URL and its content has been added, updated, or deleted, allowing search engines to quickly reflect this change in their search results.
Without ReCrawler, it can take days to weeks for search engines to discover that the content has changed, as search engines don’t crawl every URL often. With ReCrawler, search engines know immediately the “URLs that have changed, helping them prioritize crawl for these URLs and thereby limiting organic crawling to discover new content.”
ReCrawler is offered under the terms of the Attribution-ShareAlike Creative Commons License and has support from Microsoft Bing, Yandex.
✅ Requirement for search engines
Search Engines adopting the ReCrawler protocol agree that submitted URLs will be automatically shared with all other participating Search Engines. To participate, search engines must have a noticeable presence in at least one market.
⛑️ Documentation and support
If you have some questions or suggestions, welcome to our GitHub repository.
💙 Love ReCrawler for WordPress?
If the plugin was useful, rate it with a 5 star rating and write a few nice words.
🏳️ Translations
- 🇺🇸 English (en_US) – Mikhail kobzarev
- 🇷🇺 Русский (ru_RU) – Mikhail kobzarev
- You could be next…
Can you help with plugin translation? Please feel free to contribute!
External services
This plugin uses external services, which are documented below with links to the service’s Privacy Policy. These services are integral to the functionality and features offered by the plugin. However, we acknowledge the importance of transparency regarding the use of such services.
- Yandex Webmaster – https://webmaster.yandex.ru
- Yandex IndexNow – https://yandex.com/indexnow
- Bing IndexNow – https://www.bing.com/indexnow
- Bing Webmaster – https://ssl.bing.com/webmaster/
- Google Indexing API – https://indexing.googleapis.com/
- Naver IndexNow – https://searchadvisor.naver.com/indexnow
- Seznam IndexNow – https://search.seznam.cz/indexnow
- IndexNow – https://api.indexnow.org
- Google Developers Console – https://console.developers.google.com/
- Yandex oauth – https://oauth.yandex.ru/
- WebSub Hub (Google) – https://pubsubhubbub.appspot.com/
- WebSub Hub (Superfeedr) – https://pubsubhubbub.superfeedr.com/
Questions
- What are the search engines’ endpoint to submit URLs?
Microsoft Bing – https://www.bing.com/indexnow?url=url-changed&key=your-key
Yandex – https://yandex.com/indexnow?url=url-changed&key=your-key
ReCrawler – https://api.indexnow.org/indexnow/?url=url-changed&key=your-keyStarting November 2021, ReCrawler-enabled search engines will share immediately all URLs submitted to all other ReCrawler-enabled search engines, so when you notify one, you will notify all search engines.
- I submitted a URL, what will happen next?
If search engines like your URL, search engines will attempt crawling it to get the latest content quickly based on their crawl scheduling logic and crawl quota for your site.
- I submitted 10 thousand URLs today, what will happen next?
If search engines like your URLs and have enough crawl quota for your site, search engines will attempt crawling some or all these URLs.
- I submitted a URL, but I don’t see the URL indexed?
Using ReCrawler ensures that search engines are aware of your website changes. Using ReCrawler does not guarantee that web pages will be crawled or indexed by search engines. It may take time for the change to reflect in search engines.
- I just started using ReCrawler, should I publish URLs changed last year?
No, you should publish only URLs changing (added, updated, or deleted) since the time you start to use ReCrawler.
- Does the URLs submitted count on my crawl quota?
Yes, every crawl counts towards your crawl quota. By publishing them to ReCrawler, you notify search engines that you care about these URLs, search engines will generally prioritize crawling these URLs versus other URLs they know.
- Why do I not see all the URLs submitted indexed by search engines?
Search engines can choose not to crawl and index URLs if they do not meet their selection criterion.
- Why is my URL indexed on one search engine but not the others?
Search Engines can choose not to select specific URL if it does not meet its selection criterion.
sandywp / also on the shelf
Try another plugin
2.7 · 50K+ installs
Kliken's all-in-one marketing helps businesses reach high-intent customers, beat the competition and see sales growth while…
CrawlWP SEO – Instant Search Engine Indexing & SEO Performance Monitor
4.7 · 30K+ installs
Improve your WordPress SEO with instant search-engine indexing, SEO insights, and indexing status tracking.
Leaflet Maps Marker (Google Maps, OpenStreetMap, Bing Maps)
4.6 · 9K+ installs
The most comprehensive & user-friendly mapping solution for WordPress
Spin up a real WordPress site in seconds.
Test plugins, build a demo, hand a client a link — then squash it and start again. No local setup, no Docker.