I have an R script which is something like this:
id <- "25731"
url_name <- "Cross_Ange:_Tenshi_to_Ryuu_no_Rondo"
library(rvest)
html_content <- html(paste("http://myanimelist.net/anime/", id, "/", url_name, "/stats", sep=""))
test_page <- html_node(html_content, "div")
That test_page variable is just for checking if the page loaded correctly. The problem is that sometimes it doesn't. Sometimes the html_content variable contains some weird html content, like
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
<html style="height:100%">
<head>
<meta name="ROBOTS" content="NOINDEX, NOFOLLOW">
<meta name="format-detection" content="telephone=no">
<meta name="viewport" content="initial-scale=1.0">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
</head>
<body style="margin:0px;height:100%"><iframe src="/_Incapsula_Resource?CWUDNSAI=9&xinfo=6-12427765-0%200NNN%20RT(1427731440619%201)%20q(0%20-1%20-1%20-1)%20r(0%20-1)%20B12(4,315,0)&incident_id=124002150019133827-71376390758075766&edet=12&cinfo=04000000" frameborder="0" width="100%" height="100%" marginheight="0px" marginwidth="0px">Request unsuccessful. Incapsula incident ID: 124002150019133827-71376390758075766</iframe></body>
</html>
That is wrong html content. And it's not even consistent in the wring content. Sometimes it returns another wrong page.
The url itself is correct, because if I try to send a http request with firefox, it returns the correct html on the first try as expected.
The weird thing is that if I try to run the line with html() function several times, eventually it loads the correct html page without me changing anything. It is weirdly incosistent, which is terrible when I try to automate the execution with RScript.
I've set up a while loop that checks if the html has loaded correctly (if it finds any div tag using html_node()), but RScript throws an error, while RStudio executes it just fine:
Error in as.vector(x, "list") :
cannot coerce type 'environment' to vector of type 'list'
Calls: html_node ... <Anonymous> -> lapply -> as.list -> as.list.default
Execution halted
In summary, RStudio ha inconsistent html() function which sometimes returns weird page, but if I can force my way though it by repeatedly trying to execute the line, it works in the end. But RScript straight up throws an error.
R version 3.1.3 (2015-03-09) -- "Smooth Sidewalk"
Aucun commentaire:
Enregistrer un commentaire