Robotcop - robots.txt: It's the Law
Description: Robotcop is an open source module for webservers which helps webmasters prevent spiders from accessing parts of their sites they have marked off limits.
Keywords: robotcop spam spiders crawlers apache module webserver webmaster robots robots.txt privacy uce
Tags: robotcop, robots, txt, law, help, download, read, contact, links, spiders, module, apache, webserver, webmaster, webservers, privacy, uce, spam, crawlers, limits, webmasters, marked, parts, helps, open, sites, prevent, source, accessing, file, intercepted, requests, site, project, spider,
Robotcop.org
|
Content Revalency:
Title: 57.14%
Description: 58.33%
Keywords: 66.67% | Document size: 3,762 bytes
More info: Whois - Trace Route - RBL Check |
|
| DMOZ Information |
|
Robotcop Helps webmasters prevent spiders from accessing the parts of sites they have marked off limits using the robots.txt file. Top/Computers/Software/Internet/Servers/WWW/Apache/Modules http://www.robotcop.org/ Robotcop.org has 1 URLs listed in 1 Dmoz categories. Related Sites: Rudedog.org , Modssl.org , Dan.co.jp , Nona.net , Webdav.org , Sourceforge.net , Tripod.com , Chilisoft.com , Rtr.com , Cohprog.com , |
| ROBOTCOP.ORG - Site Location | |
| Country/Flag |  United States |
| City/Region/Zip Code | Secaucus, New Jersey, 07094 |
| Organization | FortressITX |
| Internet Service Provider | FortressITX |
| ROBOTCOP.ORG - Domain Information | |
| Domain | ROBOTCOP.ORG [ Traceroute RBL/DNSBL lookup ] |
| Whois server | whois.pir.org |
| Created | -- |
| Updated | -- |
| Expires | -- |
| Time Left | 0 days 0 hours 0 minutes |
| Status | clientTransferProhibited https://icann.org/epp#clientTransferProhibited |
| DNS servers | DNS1.REGISTRAR-SERVERS.COM 216.180.235.124 DNS2.REGISTRAR-SERVERS.COM 74.86.167.228 |
| ROBOTCOP.ORG - DNS Information | |
| IP Address | 65.98.99.133 ~ Whois - Trace Route - RBL Check |
| Domain Name Servers | dns138.a.register.com 216.21.231.138 dns010.d.register.com 216.21.236.10 dns014.c.register.com 216.21.235.14 dns246.b.register.com 216.21.232.246 |
| Mail Exchange | server.heavytech.com 192.241.236.230 |
| Site Response Header | |
| Response | HTTP/1.1 200 OK |
| Server | Apache/2.2.16 (Unix) PHP/5.2.6 mod_ssl/2.2.16 OpenSSL/0.9.8e |
| Date | Sat, 16 Apr 2011 11:03:36 GMT |
| Content-Type | text/html |