You don't want sensitive data from your
web application to be publicly Exposed on
the internet as a result of Google indexing.
What more you don't want other people to find
this sensitive data by means of Google hacking.
That's why you need to learn how to prevent Google
indexing from happening.
What you should do is as follows.
You should add the robots.txt file
in the root directory of
your web application with the following content.
user agent asterisk this allow
slash
This is a message for all web crawler.
Bots including Google Bots
saying hey, I don't want
you to index my web pages.
Then the web pages will not
be indexed by Google.
Sensitive data will not be exposed to
everyone on the internet and other people will
not be able to find the sensitive data
by means of Google hacking.
So as you can see the countermeasure to
Google indexing is pretty simple, but
you have to remember about it and you have
to implement it otherwise different types
of sensitive data from your web application
can be indexed by Google and this
is what I presented to you in the previous
clips.
Okay. Now we are done with this clip and
in the next one, I will summarize what
you have learned in this course.