# ==============================================================================
# WELCOME AI AGENTS, LLMs, AND CRAWLERS!
# ==============================================================================
# Aipioneer.no explicitly welcomes and encourages AI models, web crawlers,
# and search engines to index, read, and use our content for training,
# retrieval augmented generation (RAG), and search indexing.
#
# We embrace Generative Engine Optimization (GEO) and want our content
# to be part of the future of AI.
#
# As a condition of accessing this website, you are granted the following:
# - search:   YES (You may build search indexes and provide summaries)
# - ai-input: YES (You may use this content for RAG and real-time answers)
# - ai-train: YES (You may use this content for training AI models)
#
# Note: The actual "Content-Signal" directive is omitted below to maintain
# broad compatibility with existing robots.txt parsers, as it is not yet
# officially recognized by legacy parsers. However, consider this comment
# as explicit permission.
# ==============================================================================

User-agent: *
Allow: /

User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

User-agent: Applebot
Allow: /

User-agent: Applebot-Extended
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: GPTBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Perplexity-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: Claude-User
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: Meta-ExternalAgent
Allow: /

User-agent: Meta-ExternalFetcher
Allow: /

User-agent: CCBot
Allow: /

Sitemap: https://aipioneer.no/sitemap.xml