After learning the basics of scraping with requests and BeautifulSoup, have you ever felt frustrated when trying to tackle a real website, only to find that you couldn't retrieve the data as expected?

We caught up with two professional python hunters and asked them what are the "essentials" that help them be successful in the field.