skeleton of embedr service, based on bskyweb

2024-04-11 19:38:37 -07:00
parent 4b3ec55732
commit 66db32f520
13 changed files with 440 additions and 0 deletions
@@ -0,0 +1,9 @@
+# Hello Friends!
+# If you are considering bulk or automated crawling, you may want to look in
+# to our protocol (API), including a firehose of updates. See: https://atproto.com/
+
+# By default, may crawl anything on this domain. HTTP 429 ("backoff") status
+# codes are used for rate-limiting. Up to a handful concurrent requests should
+# be ok.
+User-Agent: *
+Allow: /