Switch base URL to archive.sparkpost.com and noindex the site#855
Open
PauloJeunonSousa wants to merge 1 commit into
Open
Switch base URL to archive.sparkpost.com and noindex the site#855PauloJeunonSousa wants to merge 1 commit into
PauloJeunonSousa wants to merge 1 commit into
Conversation
Moves the docs site from support.sparkpost.com to archive.sparkpost.com so the content can be archived (and later 301'd to bird.com) without competing with bird.com in search. Adds noindex/nofollow at three layers (robots.txt, <meta name="robots">, X-Robots-Tag header) so search engines drop the archive. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
✅ Deploy Preview for support-docs ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
rafaelmatsumotomb
approved these changes
Jun 25, 2026
viniciusgiles
approved these changes
Jun 25, 2026
balupillai
approved these changes
Jun 25, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
For SEO/GEO, the docs site is moving off
support.sparkpost.comso it stops competing withbird.comand instead funnels link equity to Bird. The broader cutover has three parts; this PR owns only the in-repo piece.next-sitemap.jsdefault switched fromhttps://support.sparkpost.comtohttps://archive.sparkpost.com.process.env.SITE_URLstill wins at build time.robots.txt(generated bynext-sitemap): addeddisallow: ['/']to the*policy.components/site/seo.tsxnow emits<meta name="robots" content="noindex, nofollow" />(wasindex, follow, max-*).netlify.toml[headers.values]addsX-Robots-Tag = "noindex, nofollow"for all paths.netlify.tomlfont-srcupdated fromsupport.sparkpost.comtoarchive.sparkpost.comso the directive doesn't go stale after DNS flips.Markdown content with hardcoded
support.sparkpost.comlinks is intentionally left alone — once the Cloudflare distro (out of scope here) is live, those self-references will 301 to bird.com, which is the desired SEO funnel.Out of scope (handled outside this repo)
support.sparkpost.com/*→bird.com/*(3,414-entry mapping).supporttoarchive.support.sparkpost.comto the new Cloudflare distro; pointarchive.sparkpost.comat Netlify.Test plan
npm run buildsucceeds locallypublic/sitemap.xmllists URLs underhttps://archive.sparkpost.com/...public/robots.txtcontainsDisallow: /andHost: https://archive.sparkpost.comcypress/,components/, orpages/curl -I <preview-url>showsX-Robots-Tag: noindex, nofollow<meta name="robots" content="noindex, nofollow">is present in<head>🤖 Generated with Claude Code
Note
Medium Risk
Changes global crawl/indexing behavior and canonical sitemap host; misconfiguration could hide or mis-attribute the archive in search until DNS/Netlify domain cutover completes.
Overview
Repositions the docs site as an archive at
archive.sparkpost.comand tells search engines not to index it, so it stops competing with bird.com for SEO.Base URL:
next-sitemap.jsdefaultsiteUrlmoves fromsupport.sparkpost.comtoarchive.sparkpost.com(still overridable viaSITE_URLat build).Noindex (three layers): Shared
SEOhead meta switches fromindex, followtonoindex, nofollow. Netlify addsX-Robots-Tag: noindex, nofollowon all paths. Generatedrobots.txtgetsDisallow: /for*.CSP:
font-srcinnetlify.tomlallowsarchive.sparkpost.cominstead ofsupport.sparkpost.com.Hardcoded
support.sparkpost.comlinks in markdown are unchanged; external DNS/Cloudflare cutover is out of scope.Reviewed by Cursor Bugbot for commit a3202d6. Bugbot is set up for automated code reviews on this repo. Configure here.