Scrape HTML off AppBuilder page : <p>I found this website with some interesting data I wish to analyze. But the page is really slow and build around .docx files. But it has a preview of each document in HTML</p>

<p><a href="http://www.produktresume.dk/AppBuilder/search?page=0" rel="nofollow noreferrer">http://www.produktresume.dk/AppBuilder/search?page=0</a></p>

<p>My current idea for a strategy is:</p>

<ol>
<li>Wait for the page to load (haven't tried this before)</li>
<li>Dig into the <code>div class="widget_inside"</code></li>
<li>Grab all the <code>href</code> in <code>&lt;a class="preview_link"</code></li>
<li>Iterate over all the collected links and parse the HTML into some <code>.json</code>/<code>.csv</code> for later analysis</li>
</ol>

<p>I'm pretty new when it comes to scraping, and had previously some luck with <code>BeautifulSoup</code> in Python - with a page that don't have a loading. But I have been using nodejs lately, so would prefer to be able to do it in JS with some npm package. </p>

<p>Anybody who can help me out finding the right tools for the job and some pointers/comments on the best strategy?</p>

<hr>

<h1>Bonus info</h1>

<p>By decoding one of the filter links to the left this comes up:</p>

<p><code>http://www.produktresume.dk/AppBuilder/search?expand_all=true&amp;page=0&amp;refinements_token={}&amp;selected_tokens[]={"s":[{"id":"folder-refinement","xPath":"$folders","separator":"\u003e","logic":"OR","s":[{"n":"Human","k":"Human"}]}]}</code></p>

<p>Don't know if that would be of any use?</p>
