On Sat, Jul 26, 2014 at 1:34 AM, Hugh Glaser <[email protected]> wrote: > That sort of sums up what I want.
Indeed. So I agree that robots.txt should probably not establish whether something is a linked dataset or not. To me your data is still linked data even though robots.txt is blocking access of specific types of agents, such as crawlers. Aidan, > *) a Linked Dataset behind a robots.txt blacklist is not a Linked Dataset. Isn't that a bit harsh? That would be the case if the only type of agent is a crawler. But as Hugh mentioned, linked datasets can be useful simply by treating URIs as dereferenceable identifiers without following links.
