@nev Does the site in question have the API enabled? You might be able to vacuum up the entire site without needing credentials.
@nev It's in core now, so you should be able to poke around with it.
@drwho i'm not really a coder and don't know how to even REST or whatever but perhaps this is a good time to start learning!
@nev I have an article on my website about it that might be enough to get you started. Search for "rest API" and it should be in the top five hits.
@nev Give this a read - it's Huginn-specific, but it talks about how to interact with a REST API.
https://drwho.virtadpt.net/archive/2017-01-15/huginn-writing-a-simple-agent-network
@drwho hmm, I don't know. How would I find out/tap into it?