docs: update robot.txt to index angular.dev (#55617)

PR Close #55617
This commit is contained in:
twerske
2024-05-01 12:05:38 -07:00
committed by Dylan Hunn
parent bb13174bd1
commit a5512d3c4b
+1 -4
View File
@@ -1,5 +1,2 @@
User-agent: Algolia Crawler
Allow: /
User-agent: *
Disallow: /
Allow: /