我正在尝试监控一个网站(www.bidcactus.com)。在网站上,我打开 Firebug,转到网络选项卡,然后单击 XHR 选项卡。
我想获取请求的响应并将其保存到 mySql 数据库(我的计算机上运行着本地数据库(XAMPP)。
有人告诉我主要使用 jQuery 或 JavaScript 来做各种事情,但我也没有经验,所以我想知道是否有人可以帮助我。
有人向我建议了这个链接 Using Greasemonkey and jQuery to截取来自页面的JSON/AJAX数据,并处理它
它也使用 Greasemonkey,我对此也不太了解......
预先感谢您的任何帮助
示例/更多细节:
在监视发送的请求时(通过 firebug)我看到下面
http://www.bidcactus.com/CactusWeb/ItemUpdates?rnd=1310684278585
The response of this link is the following:
{"s":"uk5c","a":[{"w":"MATADORA","t":944,"p":5,"a":413173,"x":10},
{"w":"1000BidsAintEnough","t":6,"p":863,"a":413198,"x":0},
{"w":"YourBidzWillBeWastedHere","t":4725,"p":21,"a":413200,"x":8},
{"w":"iwillpay2much","t":344,"p":9,"a":413201,"x":9},
{"w":"apcyclops84","t":884,"p":3,"a":413213,"x":14},
{"w":"goin_postal","t":165,"p":5,"a":413215,"x":12},
{"w":"487951","t":825,"p":10,"a":413218,"x":6},
{"w":"mishmash","t":3225,"p":3,"a":413222,"x":7},
{"w":"CrazyKatLady2","t":6464,"p":1,"a":413224,"x":2},
{"w":"BOSS1","t":224,"p":102,"a":413230,"x":4},
{"w":"serbian48","t":62,"p":2,"a":413232,"x":11},
{"w":"Tuffenough","t":1785,"p":1,"a":413234,"x":1},
{"w":"apcyclops84","t":1970,"p":1,"a":413240,"x":13},
{"w":"Tuffenough","t":3524,"p":1,"a":413244,"x":5},
{"w":"Cdm17517","t":1424,"p":1,"a":413252,"x":3}],"tau":"0"}
Run Code Online (Sandbox Code Playgroud)
我了解这些信息的含义,并且我认为我可以自己对其进行格式化,但是该网站会随机创建新的请求。
示例http://www.bidcactus.com/CactusWeb/ItemUpdates?rnd=XXXXXXXXXXXX
,我不确定它是如何创建它们的。
因此,我需要获取所有项目更新请求的响应,并将信息发送到 mysql 数据库。
我有一个程序,不断从网站获取信息,并不断更新.截至目前,我将所有信息存储在一个arraylist
,然后当我完成后,我将其写入文本文件.
我需要操纵这些信息; 但是,它创建了一个庞大的文本文件,我不能经常读取和写入文本文件的信息,因为它需要太长时间.所以有人告诉我要研究使用数据库.我曾经使用过的唯一一个数据库是一个网站的MySQL数据库,而不是java.
有没有办法让数据库本地化?就像在我的电脑上一样(当我是唯一一个在我的电脑上访问这些信息的人时,不想支付网络托管费用)?我看了一点SQLite,但我看到的一件事是它不允许并发.我正在考虑对我的程序进行多线程处理,并让它同时读写不同的部分.这可能吗?
基本上我在这里要求的是: