diff options
| author | alecpl <alec@alec.pl> | 2012-02-15 13:24:04 +0000 |
|---|---|---|
| committer | alecpl <alec@alec.pl> | 2012-02-15 13:24:04 +0000 |
| commit | 43c40f043cce8bfd316e0670919513b50b1e98f1 (patch) | |
| tree | af992bd3c0c7ef84b9cee0fe75c18db7c26dc0a3 /robots.txt | |
| parent | 3ed9e80cd60c3d9a72c4d37ebeda7fea4d042f42 (diff) | |
- Don't list mailto: and anchor links
- List only unique URLs
Diffstat (limited to 'robots.txt')
0 files changed, 0 insertions, 0 deletions