Crawler

About Mintrinbot

Mintrinbot is the link-preview crawler operated by Mintrin (https://mintrin.app). It fetches public web pages on behalf of Mintrin users so the app can display a title, author, cover image, and short description when someone shares an article link.

How to identify it

Mintrinbot identifies itself in two User-Agent strings, depending on which part of Mintrin is making the request:

  • Mintrinbot/1.0 (+https://mintrin.app/bot) — used when fetching article web pages for link previews.
  • Mintrin/1.0 (+https://mintrin.app/bot) — used when calling third-party content APIs (e.g. movie, book, music metadata).

Both User-Agents include this page's URL so you can find us.

What it does

  • Fetches a single HTML page when a Mintrin user pastes its URL.
  • Reads only the document <head> — Open Graph tags, standard meta tags, and JSON-LD — to extract title, description, author, cover image, and publication date.
  • Does not execute JavaScript, follow links, log in, or crawl beyond the page the user explicitly shared.
  • Caps each response at 64 KB and follows at most 3 redirects.
  • Does not bypass paywalls, captchas, or authentication.

Mintrinbot does not perform broad or recursive crawling. It only visits pages a Mintrin user has actively chosen to share.

How to block it

If you'd prefer Mintrinbot not fetch your pages, you can:

Block by User-Agent in robots.txt:

User-agent: Mintrinbot
Disallow: /

Block at your CDN or web server by matching the User-Agent string Mintrinbot/1.0.

Mintrinbot honors robots.txt directives. When blocked, Mintrin users sharing a link to your site will be asked to enter the title and description themselves.

Contact

Questions, abuse reports, or block requests: support@mintrin.app.