Regex-WebScrapper

A CLI for retrieving info from web pages done on python3.7

python3 regexscraper -u "https://example.com" -r "(t|r)est"
This outputs all regex matches on site -s with pattern -r using selenium JS rendered sites

Important:

Selenium is one of those things that takes up more memory than it needs to. Take that into account in use.

Regex patterns:

IP Addresses Tupple: ((([0-1]{0,1}[0-9]{0,2}|25[0-5]|2[0-4][0-9]).){3}([0-1]{0,1}[0-9]{0,2}|25[0-5]|2[0-4][0-9])) This returns a tupple with the full address at the 0th index
IP Address Sort of: \d{1,3}.\d{1,3}.\d{1,3}.\d{1,3} Returns a string of the IP address that is not nescicarily accurate

Things:

https://stackoverflow.com/questions/39547598/selenium-common-exceptions-webdriverexception-message-connection-refused
https://stackoverflow.com/questions/8220108/how-do-i-check-the-operating-system-in-python
https://selenium-python.readthedocs.io/api.html
https://stackoverflow.com/questions/1285917/how-to-disable-javascript-when-using-selenium/51681608#51681608