Web Level 1 15 points

Web-04. The robots.txt Trap

Mission

Websites often serve a robots.txt file for crawlers. In this challenge, check whether a file that robots.txt tells crawlers not to index can still be accessed directly.

#web#robots-disclosure

Clear it in 3 steps

Not started
  1. Start the environment

  2. Investigate the target

  3. Submit the flag