Scraping a website which requires authentication using node.js

10,505

It's using an asp.net session cookie. You possibly need to store all cookies in a jar and then send them back on the next request.

Share:
10,505

Related videos on Youtube

khurrum qureshi
Author by

khurrum qureshi

Broadly experienced Software Engineer. Highly self-motivated. Skilled at problem solving and seeking multiple solutions to issues. Accustomed to serving as a leader in constantly changing, dynamic environments. Dedicated to the highest standards in software engineering.

Updated on June 04, 2022

Comments

  • khurrum qureshi
    khurrum qureshi almost 2 years

    I am trying to scrap this website https://www.erobertparker.com/entrance.aspx it requires authentication I am using request module to get authenticated like this,

     request({
            url:"https://www.erobertparker.com/login.aspx",
            method:"POST",
            form:{UNENTRY:"username",PWENTRY:"password"}
        },
        function(error,response,body){
     })
    

    but i am unable to get authenticated what i am doing wrong can someone please guide me I am new to web scraping world :).

  • khurrum qureshi
    khurrum qureshi almost 11 years
    can you please provide me a sample of how to do that? I will be greatfull