get sourcecode after javascript execution with curl

13,366

You can do it, but it's more involved than I think you realize. Neither curl nor wget have Javascript engines, so you'll need something that has one.

I would start by looking at PhantomJS.

Share:
13,366
reox
Author by

reox

Just another PhD Student

Updated on June 25, 2022

Comments

  • reox
    reox almost 2 years

    Is it possible to get the html source code of a webpage with curl and the run a javascript interpreter over it, so i get the generated content?

    The Page i need to get uses some encoded and genereated content in there so i want to first run the javascript to get the escaped and generated content... or do i need to regex the javascript and "compile" the javascript on my own? Like

    curl <myurl> | perl -ne 'm/unescape\((.*)\)/; print "$1"' | <now to something with that>
    

    i known there is no javascript engine in curl but can i just call another script / programm to do the job?