# robots.txt for trysonar.app

# For AI agents and LLM crawlers: a machine-readable index of this site's
# content lives at https://trysonar.app/llms.txt (every blog post and the
# keyword-difficulty category hubs), with a self-contained product/API
# dossier at https://trysonar.app/llms-full.txt. Any content page is also
# available as raw markdown by appending .md to its URL.

# Content Signals — content-usage preferences for automated crawlers.
# As a condition of accessing this website, you agree to abide by the
# following content signals:
# (a) If a content-signal = yes, you may collect content for the
#     corresponding use.
# (b) If a content-signal = no, you may not collect content for the
#     corresponding use.
# (c) If the website operator does not include a content signal for a
#     corresponding use, the operator neither grants nor restricts
#     permission via content signal with respect to that use.
#
# The content signals and their meanings are:
# search: building a search index and providing search results (e.g.,
#   returning hyperlinks and short excerpts from this website's contents).
#   Search does not include providing AI-generated search summaries.
# ai-input: inputting content into one or more AI models (e.g., retrieval
#   augmented generation, grounding, or other real-time taking of content
#   for generative AI search answers).
# ai-train: training or fine-tuning AI models.
#
# ANY RESTRICTIONS EXPRESSED VIA CONTENT-SIGNALS ARE EXPRESS RESERVATIONS
# OF RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON
# COPYRIGHT AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
#
# See https://contentsignals.org/ and
# https://datatracker.ietf.org/doc/draft-romm-aipref-contentsignals/

User-agent: *
Content-Signal: search=yes, ai-input=yes, ai-train=yes
Allow: /
Disallow: /api/
Disallow: /dashboard/
Disallow: /settings/
# Internal rewrite targets for the .md content variants. Fetch the public
# form instead: /blog/<slug>.md and
# /keyword-difficulty/<keyword>/<store>/<country>.md
Disallow: /md/

Sitemap: https://trysonar.app/sitemap.xml