用美丽的汤解析 JS

use*_*151 4 python beautifulsoup html-parsing web-scraping

我有一些用美丽的汤解析的页面。但我有 js 代码:

<script type="text/javascript">   


var utag_data = {
            customer_id   : "_PHL2883198554", 
            customer_type : "New",
            loyalty_id : "N",
            declined_loyalty_interstitial : "false",
            site_version  : "Desktop Site",
            site_currency: "de_DE_EURO",
            site_region: "uk",
            site_language: "en-GB",


            customer_address_zip : "",
            customer_email_hash :  "",
            referral_source :  "",
            page_type : "product",
            product_category_name : ["Lingerie"],
            product_category_id :[jQuery("meta[name=defaultParent]").attr("content")],
            product_id : ["5741462261401"],
            product_image_url : ["http://images.urbanoutfitters.com/is/image/UrbanOutfitters/5741462261401_001_b?$detailmain$"],
            product_brand : ["Pretty Polly"],
            product_selling_price : ["20.0"],
            promo_id : "6",
            product_referral : ["WOMENS-SHAPEWEAR-LINGERIE-SOLUTIONS-EU"],
            product_name : ["Pretty Polly Shape It Up Tummy Shaping Camisole"],
            is_online_only : true,
            is_back_in_stock : false
}
</script>
Run Code Online (Sandbox Code Playgroud)

如何从此输入中获取一些值?我应该像处理文本一样处理这个例子吗?我的意思是将它写入某个变量并拆分然后获取一些数据?

谢谢

Gra*_*rus 5

一旦您通过以下方式获得脚本文本

js_text = soup.find('script', type="text/javascript").text
Run Code Online (Sandbox Code Playgroud)

例如。然后你可以使用正则表达式来查找数据,我相信有一种更简单的方法可以做到这一点,但正则表达式也不应该很难。

import re
regex =  re.compile('\n^(.*?):(.*?)$|,', re.MULTILINE) #compile regex
js_text = re.findall(regex, js_text) #  find first item @ new line to : and 2nd item @ from : to the end of the line or , 
js_text = [jt.strip() for jt in js_text] #  to strip away all of the extra white space.
Run Code Online (Sandbox Code Playgroud)

这将按 name|value|name2|value2... 顺序返回名称和值的列表,您可以稍后处理或转换为字典。