Developing Scraping Script On Docker Image - How To Overcome Lack Of Visual Browser?

I want to scrape info from the web and a previous attempt has taught me that docker would have been useful to run my script on since I develop the script on mac os x and then run i

Solution 1:

Develop the script locally in a python3 venv with headed Chrome first, then you can run it with Docker once the visual scraping is completed to avoid any dependency issues.

Also, for Docker to run headless Chrome, in your chromeOptions also add this argument:

chromeOptions.add_argument("no-sandbox")