I hate to crawl web pages whether it be with #python or #javascript.
But things never got as snappy than with *rust-scraper*.
Use it with *reqwest* and literally swallows websites in minutes. 
If you don't need to render #javascript, I recommend.
Else you'll have to combine it with the #deno crate. 
GitHubGitHub - rust-scraper/scraper: HTML parsing and querying with CSS selectorsHTML parsing and querying with CSS selectors. Contribute to rust-scraper/scraper development by creating an account on GitHub.
@jean_dupont I wonder if it would be possible to use other less mature options, such as Nova or Boa. They have the advantage of being "pure" Rust, so this means simplified tooling and compilation pipeline.