Could we get a more difficult webscraping task

[muddyboss]

Hi,
Could we please get a more difficult webscraping task than just a 2 column table… Attempting to scrape a job search website and its not as clear cut as selecting the first class for each text section… several groups of divs, classes, etc…

Do you have any examples that use the method described on modern websites that you can share?
thanks,

[moriturus7]

Hi, @muddyboss

You can read my answers in the community, in which I gave several options for parsing modern websites

https://community.dataquest.io/t/how-to-scrape-dataquest-community-in-3-steps-tag-modeling-part-1/554069/3

Tips. Alternative for Selenium exists - Playwright

Hello, everybody. I propose to create a category of messages that could be called “Tips, Tricks, and Hacks”. Where the community could share useful libraries and ask questions related to them. But since I can’t create a separate category. Let’s dodge it. So let’s get started. Web scraping and Selenium. Data collection is quite an important issue in our community. I know that many people use or just learn Web scraping. Many of you use Selenium and I can understand you. There are several adv…

Web scraping without Selenium

[greyson-joralemon-A1g0oeX29ec-unsplash] You must all have seen the great project created by @otavios.s. After discussing the topic, I thought you might be interested in how to work with sites that have interactive elements without using selenium. I’ll tell you a little bit about me. More than 4 years ago I decided to change my field of activity. I started studying Python and everything related to data processing, from storage and collection to in-depth training and web servers. But it’s muc…