Ask HN: Why Reddit blocks all automated access but has .json for all URLs?
3 by ksajadi | 3 comments on Hacker News.
Reddit is aggressively blocking all automated access (see their robots.txt) and uses a lot of heuristics to block crawlers that do not honor it. However, at the same time all Reddit URLs can be made machine readable by adding a .json to the end. Can anyone explain what's the point of that?
Don't forget to subscribe our youtube channel Click here:- http://www.youtube.com/c/techgk Product of the day
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment