From 2f99dcb0d7b028f2e1176f28627dabcea7f51d16 Mon Sep 17 00:00:00 2001
From: d47081 <108541346+d47081@users.noreply.github.com>
Date: Tue, 4 Apr 2023 01:43:15 +0300
Subject: [PATCH] Update README.md

---
 README.md | 1 +
 1 file changed, 1 insertion(+)

diff --git a/README.md b/README.md
index 5c4f19e..64e3225 100644
--- a/README.md
+++ b/README.md
@@ -43,6 +43,7 @@ sqlite / fts5
 
 * [x] Web pages full text ranking search
 * [x] Make search results pagination
+* [ ] Add robots.txt support (Issue #2)
 * [ ] Improve yggdrasil links detection, add .ygg domain zone support
 * [ ] Make page description visible - based on the cached content dump, when website description tag not available, add condition highlights
 * [ ] Images search (basically implemented but requires testing and some performance optimization)