Scraping a website which requires authentication using node.js
10,505
It's using an asp.net session cookie. You possibly need to store all cookies in a jar and then send them back on the next request.
Related videos on Youtube
Author by
khurrum qureshi
Broadly experienced Software Engineer. Highly self-motivated. Skilled at problem solving and seeking multiple solutions to issues. Accustomed to serving as a leader in constantly changing, dynamic environments. Dedicated to the highest standards in software engineering.
Updated on June 04, 2022Comments
-
khurrum qureshi almost 2 years
I am trying to scrap this website https://www.erobertparker.com/entrance.aspx it requires authentication I am using request module to get authenticated like this,
request({ url:"https://www.erobertparker.com/login.aspx", method:"POST", form:{UNENTRY:"username",PWENTRY:"password"} }, function(error,response,body){ })
but i am unable to get authenticated what i am doing wrong can someone please guide me I am new to web scraping world :).
-
khurrum qureshi almost 11 yearscan you please provide me a sample of how to do that? I will be greatfull