eur*_*i10 1 python sqlite excel sqlalchemy pandas
我有一段代码,它在目录中循环 excel 文件,将文件添加到 sqlite db 中。如果表存在,我设法克服了引发的异常,但我发现这既不优雅又低效,因为循环读取 excel 文件,将其添加到数据框等中......理想情况下我想要的是我测试存在从 excel 创建 df 之前的表。
response = {}
for f in glob('T:\GESTION\toto\titi\tata\file_201*.xlsx'):
print f
datereg = re.search('T:\\\\GESTION\\\\toto\\\\titi\\\\tata\\\\file_(\d{4})(\d{2})(\d{2}).xlsx', f)
if datereg is not None:
dated = datetime.datetime(int(datereg.group(1)), int(datereg.group(2)), int(datereg.group(3)))
print dated
# ideally test if table in db exists here
xl = pd.ExcelFile(f)
df = xl.parse(sheetname="Sheet1")
df = df[extractFields].drop_duplicates(subset='ISIN')
df = df.set_index('ISIN', verify_integrity=True)
response[dated] = df
# print response
engine = sqlalchemy.create_engine('sqlite:///my_db.sqlite')
try:
df.to_sql(dated.__str__(), engine, if_exists='fail')
except ValueError as err:
print(err)
pass
Run Code Online (Sandbox Code Playgroud)
这是我的代码:
engine = create_engine("mysql+mysqlconnector://{user}:{pw}@localhost/{db}".format(user="root",pw="password",db="worker"))
check=engine.has_table(table_name)
print(check) #boolean
if check == False:
df.to_sql(con=engine, name=table_name, if_exists='replace',index=False)
Run Code Online (Sandbox Code Playgroud)
| 归档时间: |
|
| 查看次数: |
3265 次 |
| 最近记录: |