Adding to what others have said, an API will likely give you better (and faster!) results than scraping. Not sure if the Harvard Library Data covers what you need, but their data is available via API (or download), for free, in a legal and rights-respecting manner. Amazing resource.
https://library.harvard.edu/services-tools/harvard-library-apis-datasets
