In the soon-to-be-release version 12 of the Wolfram Language we are including another option to interact with web pages, namely the function WebExecute. Here is a sneak preview of the documentation:
It is based on a repository of mine on GitHub (https://github.com/arnoudbuzing/webtools) and lets you control a Chrome or Firefox web browser. It can complement the WebSearch function in the sense that you can navigate to a page, take screen captures of a page, click on links, type input fields, submit forms, and execute javascript to return text, data, or images from a web page of interest.
