The web scraping result will then be added inside a new file called ls_t.json in JSON format. pipenv run scrapy crawl LiveScoreT -o ls_t.json By now you know the drill.

My go-to language for web scraping is Python, as it has well-integrated libraries that can generally handle all of the functionality required. And sure enough, a Selenium library exists for Python.