App & Software, Blogging, Dev & Design, Development, Django, Python, Tech, Tools, Tutorials, Web

Adding robots.txt to your Django Project


In this post we are going to list multiple ways of adding a robots.txt file to your django project. Robots.txt or Robots exclusion protocol is basically a text file that defines the rules for search engine robots (or bots) to inform the robots what part of the website should be