Files
cobalt/src/front/robots.txt
dumbmoron d936dd73fe fix robots.txt
currently the robots.txt file is useless because
it's interpreted as one path "/icons/ /fonts/ *.js *.css"
(an example path that would be accepted -- and therefore disallowed
for robots) by this regex would be `https://cobalt.tools/icons/ /fonts/ bla.js .css`,
which is obviously nonsense & useless)
2023-11-10 17:41:51 +00:00

83 B