Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Tichy
on July 20, 2007
|
parent
|
context
|
favorite
| on:
What if Facebook loses my data?
Is that kind of thing safe, though? With all probability, their robots.txt and user agreement disallows it. So if they detect your spider, they might shut down your account?
Not a good solution...
steve
on July 21, 2007
[–]
From my work with web web bots, I've seen that it's really so easy to make a spider that they can't positively identify as such.
If you guys
really
wanted this then I guess I could show you how...
clueless
on July 21, 2007
|
parent
[–]
well why not... Also I guess the one way to stay safe is to somehow make it operate slow so for example it wouldn't aggregate 2000 pages in 5 seconds.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Not a good solution...