> For the complete documentation index, see [llms.txt](https://docs.golgothus.tech/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.golgothus.tech/other-research/research-and-misc.-write-ups/google-dorking.md).

# Google Dorking

| Keyword    | Function                                                                                                                            |
| ---------- | ----------------------------------------------------------------------------------------------------------------------------------- |
| User-agent | Specify the type of "Crawler" that can index your site (the asterisk being a wildcard, allowing all "User-agents"                   |
| Allow      | Specify the directories or file(s) that the "Crawler" can index                                                                     |
| Disallow   | Specify the directories or file(s) that the "Crawler" cannot index                                                                  |
| Sitemap    | Provide a reference to where the sitemap is located (improves SEO as previously discussed, we'll come to sitemaps in the next task) |

**user-agent:** **\***

**disallow:** /\*.ini$

**sitemap:** [www.mywebsite.com/sitemap.xml](http://www.mywebsite.com/sitemap.xml)

> .ini files useful for Windows configuration\
> .CONF are useful for \*nix configuration

| Term     | Action                                                    |
| -------- | --------------------------------------------------------- |
| filetype | Search for a file by its extension (e.g. PDF)             |
| cache    | View Google's Cached version of a specified URL           |
| intitle  | The specified phrase MUST appear in the title of the page |

> -inurl:htm -inurl:html intitle:”index of” apk

Google Proxy:

> [Google Web Light](https://docs.golgothus.tech/other-research/research-and-misc.-write-ups/https:/googleweblight.com/?lite_url=http:/example.com)\
> [Google Translate](https://docs.golgothus.tech/other-research/research-and-misc.-write-ups/http:/translate.google.com/translate?sl=ja\&tl=en\&u=http:/example.com)