feat(docs): add robots.txt and enhance SEO configuration

- Add robots.txt to control search engine crawling
- Update markdown files with frontmatter metadata
- Refactor config.mjs with comprehensive SEO enhancements including:
  - Language-specific SEO configurations
  - Structured data (JSON-LD)
  - Sitemap generation
  - Social media meta tags
This commit is contained in:
sanbuphy
2026-01-13 22:51:28 +08:00
parent 93914f54b0
commit 4c25317b86
4 changed files with 158 additions and 22 deletions
+18
View File
@@ -0,0 +1,18 @@
# https://www.robotstxt.org/robotstxt.html
User-agent: *
Allow: /
# 禁止搜索引擎抓取旧版内容(已迁移到新目录结构)
Disallow: /zh-cn/extra/
Disallow: /zh-cn/examples/
Disallow: /zh-cn/project/
Disallow: /en-us/extra/
Disallow: /en-us/examples/
Disallow: /en-us/project/
# 禁止抓取 VitePress 缓存和构建文件
Disallow: /.vitepress/
Disallow: /@fs/
# Sitemap 位置
Sitemap: https://datawhalechina.github.io/easy-vibe/sitemap.xml.gz