python requests.text到pandas dataframe

Question

我有以下代码,我试图从https://www.quandl.com/data/TSE/documentation/metadata获取数据.(试图获取下载详细数据)

for page_number in range(1, 5):
    link = r'https://www.quandl.com/api/v3/datasets.csv?database_code=TSE&per_page=100&sort_by=id&page=' + str(page_number)
    r = requests.get(link, stream=True).text
    print(r)
    # How to put the results in a dataframe?

但是,我无法将结果放在数据框中/将其保存在SQLite数据库中.我该怎么做？

Answer 1

您可以使用Pandas直接读取此数据:

import pandas as pd

url = ("https://www.quandl.com/api/v3/datasets.csv?"
       "database_code=TSE&per_page=100&sort_by=id&page={0}")
[pd.read_csv(url.format(page_number)) for page_number in range(1, 5)]

要阅读回复,您可以使用StringIO:

from io import StringIO

pd.read_csv(StringIO(r.text))