User:Gopherbot: Difference between revisions

From Alpine Linux
(Created a userpage for my bot.)
 
(More information.)
 
Line 1: Line 1:
Gopherbot is a MediWiki maintenance bot used on the Alpine Linux wiki by [[User:zcrayfish|zcrayfish]].<br>
Gopherbot is a MediWiki maintenance bot used on the Alpine Linux wiki by [[User:zcrayfish|zcrayfish]].<br>
Please direct any questions or comments to [[User talk:zcrayfish|their talk page]], thanks!
Please direct any questions or comments to [[User talk:zcrayfish|their talk page]], thanks!
=Bot tasks=
* Checks for dead hyperlinks, and certain dead wikilinks as well.
** After seeing a link fail to work for a minimum of a week, a comment will be added on the associated talk page.
* On a semi-automated basis: Removes unwanted categories.
= Dead link blacklist =
Links from the following domains will NOT be checked, usually because the servers either do dumb things (every response is a 200?) or block the bot:
* [https://datatracker.ietf.org/doc/html/rfc2606#page-2 RFC2606 test domains] <small>(e.g. example.com, example.net, example.org, etc)</small>
* berlinonline.de* <small>(incompatible)</small>
* web.archive.org* <small>(rejects bots)</small>
* archive.is* <small>(rejects bots, and is an EXTREMELY slow site in general)</small>
* cloudflare.com* <small>(intermittently rejects bots... and humans too...)</small>
* cyberciti.biz* <small>(rejects bots)</small>
* linuxconfig.org* <small>(rejects bots)</small>
* openvpn.net* <small>(rejects bots)</small>
* gitlab.com/lramage94* <small>(requires login)</small>
* www.voip-info.org* <small>(rejects bots)</small>

Latest revision as of 09:05, 4 September 2023

Gopherbot is a MediWiki maintenance bot used on the Alpine Linux wiki by zcrayfish.
Please direct any questions or comments to their talk page, thanks!

Bot tasks

  • Checks for dead hyperlinks, and certain dead wikilinks as well.
    • After seeing a link fail to work for a minimum of a week, a comment will be added on the associated talk page.
  • On a semi-automated basis: Removes unwanted categories.

Dead link blacklist

Links from the following domains will NOT be checked, usually because the servers either do dumb things (every response is a 200?) or block the bot:

  • RFC2606 test domains (e.g. example.com, example.net, example.org, etc)
  • berlinonline.de* (incompatible)
  • web.archive.org* (rejects bots)
  • archive.is* (rejects bots, and is an EXTREMELY slow site in general)
  • cloudflare.com* (intermittently rejects bots... and humans too...)
  • cyberciti.biz* (rejects bots)
  • linuxconfig.org* (rejects bots)
  • openvpn.net* (rejects bots)
  • gitlab.com/lramage94* (requires login)
  • www.voip-info.org* (rejects bots)