R multiple urls into lapply

11,348

As Justin suggested, formatting is the key.

htmlpages = lapply(
  urls,
  function(x) 
  {
    y <- readLines(x)
    Sys.sleep(0.3)
    y
  }
)

Update: functionality for waiting between calls is now built into purrr.

library(purrr)
slow_readLines <- slowly(readLines, rate = rate_delay(0.3))
lapply(urls, slow_readLines)

or for a full purrr solution

library(purrr)
slow_readLines <- slowly(readLines, rate = rate_delay(0.3))
urls %>% map(slow_readLines)
Share:
11,348
user3083330
Author by

user3083330

Updated on August 09, 2022

Comments

  • user3083330
    user3083330 over 1 year

    I have a list of urls in a character vector and I want to pause the process between queries because if not the x queries is rejected.

    urls=c('url1','url2','url3')
    

    here is want I want to do

    htmlpages=lapply(urls,function(x) readLines(x) Sys.sleep(0.3))