|
|
|
|
|
|
 |
|
|
| otarafa: 17.02.2003 | butarafa: memlekete neler oluyor |
|
bu site de nere
|
|
|
|
|
|
How can I remove my site's pages from the Wayback Machine? The Internet Archive is not interested in preserving or offering access to Web sites or other Internet documents of persons who do not want their materials in the collection. By placing a simple robots.txt file on your Web server, you can exclude your site from being crawled as well as exclude any historical pages from the Wayback Machine. Internet Archive uses the exclusion policy intended for use by both academic and non-academic digital repositories and archivists. See our exclusion policy. You can find exclusion directions at exclude.php. If you cannot place the robots.txt file, opt not to, or have further questions, email us at info at archive dot org. ██████████████████████████████████████████████████ The Internet Archive is not interested in offering access to Web sites or other Internet documents whose authors do not want their materials in the collection. To remove your site from the Wayback Machine, place a robots.txt file at the top level of your site (e.g. www.yourdomain.com/robots.txt) and then submit your site below. The robots.txt file will do two things: 1. It will remove all documents from your domain from the Wayback Machine. 2. It will tell us not to crawl your site in the future. To exclude the Internet Archive’s crawler (and remove documents from the Wayback Machine) while allowing all other robots to crawl your site, your robots.txt file should say: User-agent: ia_archiver Disallow: / Robots.txt is the most widely used method for controlling the behavior of automated robots on your site (all major robots, including those of Google, Alta Vista, etc. respect these exclusions). It can be used to block access to the whole domain, or any file or directory within. There are a large number of resources for webmasters and site owners describing this method and how to use it. Here are some: * * Once you have put a robots.txt file up, submit your site (www.yourdomain.com) on the form on The robots.txt file must be placed at the root of your domain (www.yourdomain.com/robots.txt). If you cannot put a robots.txt file up, read our exclusion policy. If you think it applies to you, send a request to us at info@archive.org. |
|
|
|
robot.txt gizli bir kural gibiymis... vay be kesin yahudilerin isi |
|
|
|
herşey yahudilerin işi çünkü herşey allahın işi ve allah yahudi |
|
boşlukları doldurun
bunlara da göz atabilirsiniz:
|
| otarafa: 17.02.2003 | butarafa: memlekete neler oluyor |
| iletişim - şikayet - kullanıcı sözleşmesi - gizlilik şartları |