BTW, it is often (not always) good practice for a Web crawler/scraper to set a `User-Agent` header specific to the particular program.

This convention dates from when the Web was much more cooperative, but a lot of people still do it.

An additional reason to do it with Racket's HTTP libraries is so that one bot someday going crazy doesn't make a devops/sysadmin see that it's Racket, and think unhappy thoughts about Racket. :)

The documentation from a little Web scraper gives a little more trivia: https://www.neilvandyke.org/racket/kitco/#%28def._%28%28lib._kitco%2Fmain..rkt%29._current-kitco-user-agent%29%29

--
You received this message because you are subscribed to the Google Groups "Racket 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to racket-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to