Robots.txt: Like a stoplight, a robots.txt file supplies online search engine spiders or crawlers way. You’ll use this file to permit spiders to crawl your site. You can even utilize it to stop them from viewing URLs like your compensated landing internet pages. Web optimization, or search engine optimization, is https://www.youtube.com/watch?v=hgyQy18ZcIs