Adr*_*son 5 c# html-agility-pack
我想知道HtmlAgilityPack读取包含xsl文件来呈现html的xml文件的最佳方法.HtmlDocument类上是否有任何设置可以帮助解决这个问题,或者在使用HtmlAgiliyPack加载转换之前是否必须找到执行转换的方法?如果对后者是肯定的,那么任何人都知道这种转变的好库或方法吗?下面是一个使用xls文件返回xml的网站示例以及我想要使用的代码.
var uri = new Uri("http://www.skechers.com/");
var request = (HttpWebRequest)WebRequest.Create(url);
var cookieContainer = new CookieContainer();
request.CookieContainer = cookieContainer;
request.UserAgent = @"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5";
request.Method = "GET";
request.AllowAutoRedirect = true;
request.Timeout = 15000;
var response = (HttpWebResponse)request.GetResponse();
var page = new HtmlDocument();
page.OptionReadEncoding = false;
var stream = response.GetResponseStream();
page.Load(stream);
Run Code Online (Sandbox Code Playgroud)
这段代码不会抛出任何错误,但是xml是被解析的而不是转换,这就是我想要的.
Html Agility Pack 可以在两点上为您提供帮助:
1)使用它更容易获得Xml处理指令,因为它将PI数据解析为Html,因此它将其转换为属性
2) HtmlDocument 实现了 IXPathNavigable,因此可以直接由 .NET Xslt 转换引擎进行转换。
这是一段有效的代码。我必须添加一个特定的 XmlResover 才能正确处理 Xslt 转换,但我认为这是特定于这个 skechers 案例的。
public static void DownloadAndProcessXml(string url, string userAgent, string outputFilePath)
{
using (XmlTextWriter writer = new XmlTextWriter(outputFilePath, Encoding.UTF8))
{
DownloadAndProcessXml(url, userAgent, writer);
}
}
public static void DownloadAndProcessXml(string url, string userAgent, XmlWriter output)
{
UserAgentXmlUrlResolver resolver = new UserAgentXmlUrlResolver(url, userAgent);
// WebClient is an easy to use class.
using (WebClient client = new WebClient())
{
// download Xml doc. set User-Agent header or the site won't answer us...
client.Headers[HttpRequestHeader.UserAgent] = resolver.UserAgent;
HtmlDocument xmlDoc = new HtmlDocument();
xmlDoc.Load(client.OpenRead(url));
// determine xslt (note the xpath trick as Html Agility Pack does not support xml processing instructions)
string xsltUrl = xmlDoc.DocumentNode.SelectSingleNode("//*[name()='?xml-stylesheet']").GetAttributeValue("href", null);
// download Xslt doc
client.Headers[HttpRequestHeader.UserAgent] = resolver.UserAgent;
XslCompiledTransform xslt = new XslCompiledTransform();
xslt.Load(new XmlTextReader(client.OpenRead(url + xsltUrl)), new XsltSettings(true, false), null);
// transform Html/Xml doc into new Xml doc, easy as HtmlDocument implements IXPathNavigable
// note the use of a custom resolver to overcome this Xslt resolve requests
xslt.Transform(xmlDoc, null, output, resolver);
}
}
// This class is needed during transformation otherwise there are errors.
// This is probably due to this very specific Xslt file that needs to go back to the root document itself.
public class UserAgentXmlUrlResolver : XmlUrlResolver
{
public UserAgentXmlUrlResolver(string rootUrl, string userAgent)
{
RootUrl = rootUrl;
UserAgent = userAgent;
}
public string RootUrl { get; set; }
public string UserAgent { get; set; }
public override object GetEntity(Uri absoluteUri, string role, Type ofObjectToReturn)
{
WebClient client = new WebClient();
if (!string.IsNullOrEmpty(UserAgent))
{
client.Headers[HttpRequestHeader.UserAgent] = UserAgent;
}
return client.OpenRead(absoluteUri);
}
public override Uri ResolveUri(Uri baseUri, string relativeUri)
{
if ((relativeUri == "/") && (!string.IsNullOrEmpty(RootUrl)))
return new Uri(RootUrl);
return base.ResolveUri(baseUri, relativeUri);
}
}
Run Code Online (Sandbox Code Playgroud)
你这样称呼它:
string url = "http://www.skechers.com/";
string ua = @"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5";
DownloadAndProcessXml(url, ua, "skechers.html");
Run Code Online (Sandbox Code Playgroud)