Re: Problem when scraping the 100 Movie titles.

2022-09-22 Thread Fabian Joseph
#Try using, it's save in json format of the website: import json import requests from bs4 import BeautifulSoup url = "https://www.empireonline.com/movies/features/best-movies-2/"; soup = BeautifulSoup(requests.get(url).content, "html.parser") data = json.loads(soup.select_one("#__NEXT_DATA__").

Re: Problem when scraping the 100 Movie titles.

2021-02-18 Thread Mats Wichmann
On 2/18/21 10:43 AM, Aakash Jana wrote: I have done some webscraping before i think you need to get a slightly more tactical way to get these titles scraped . Try to see what classes identify the cards (in which movie title is given) and then try to pull the heading out of those. Try to get the d

Re: Problem when scraping the 100 Movie titles.

2021-02-18 Thread Aakash Jana
I have done some webscraping before i think you need to get a slightly more tactical way to get these titles scraped . Try to see what classes identify the cards (in which movie title is given) and then try to pull the heading out of those. Try to get the divs in a list , something like this "" in

Problem when scraping the 100 Movie titles.

2021-02-18 Thread Bischoop
I'm learning Scraping actually and would like to scrape the movie titles from https://www.empireonline.com/movies/features/best-movies-2 . In the course I was learning I was supposed to do it with bs4: titles = soup.find_all(name = 'h3', class_ = 'title') but after after a while I guess the sit