Is the data available on a reference site?

**Yes:** Check if `pandas.read_html()` can extract it directly. If not, use `requests` + `BeautifulSoup` while respecting robots.txt and rate limits. - **No:** Continue to step 4.