As you know, configuring robot.txt is important to any online store that is working on a site’s SEO. You can configure the option by following below path in Magento 2.x admin. Go to Stores -> Configuration -> General (Left side) -> Design (section) -> Search Engine Robots -> Default Robots (Select)-> Select INDEX, FOLLOW Instructs…