使用Python无法将数据加载到MySQL中

Question

我无法将符号列加载到mysql中。 文件名为BAJFINANCE.NS.csv

Date,Open,High,Low,Close,Adj Close,Volume   
2002-07-01,5.239740,5.540930,5.239740,5.412680,0.063393,21923  
2002-07-02,5.523440,5.537040,5.421420,5.443770,0.063757,61045  
2002-07-03,5.505950,5.545790,5.328150,5.466120,0.064019,34161  

在MySQL中，我得到了以下信息：

timestamp,open,high,low,close,adj_close,volume,symbol  
2002-07-01,5.23974,5.54093,5.23974,5.41268,0.063393,21923,NULL  
2002-07-02,5.52344,5.53704,5.42142,5.44377,0.063757,61045,NULL  
2002-07-03,5.50595,5.54579,5.32815,5.46612,0.064019,34161,NULL

如何在mysql中包含符号

import mysql.connector
config = {
'user':'root',
'password':'root',
'host':'127.0.0.1',
'database':'masterfiles'
 }
 conn= mysql.connector.connect(**config)
 c=conn.cursor()

def insertRows(fileName,c):
    delimiter=r','
    file=fileName.split("/")[-1]
    symbol = file[:-7]
    if file.startswith("BAJ"):
        c.execute("""Load data local infile %s into table adjprice fields terminated by %s ignore 1 lines 
                 (timestamp,open,high,low,close,adj_close,volume,@symbol)""",(fileName,delimiter))

localExtractFilePath="/Users/dalal"

import os

for file in os.listdir(localExtractFilePath):
    if file.endswith("csv"):
        insertRows(localExtractFilePath+"/"+file,c)
        print "Loaded file "+file+" into database"
        conn.commit()
c.close()
conn.close()

- Gower

Answer 1

我认为这将实现你想要的功能：

       c.execute("""
Load data local infile %s
    into table adjprice
    fields terminated by %s
    ignore 1 lines 
    (timestamp, open, high, low, close, adj_close, volume)
    set symbol = %s
""", (fileName, delimiter, symbol))

我建议使用查询参数而不是篡改字符串。然而，我不确定文件名和字段组件是否可以作为参数传递。

- Gordon Linoff

Answer 2

我不确定你对使用你在问题中导入的模块有多少承诺，但我会使用 Pandas 和 SQLalchemy 来解决这个问题，因为它们非常容易上手。

以下是我解决你的问题的方式：

import os
import pandas as pd
from sqlalchemy import create_engine

localExtractFilePath="/Users/dalal"

config = {
'user':'root',
'password':'root',
'host':'127.0.0.1',
'database':'masterfiles'
 }


def main():
    engine = create_engine('mysql://{}:{}r@{}/{}'.format(config['user'],config['password'],config['host'],config['database']))

    for file in os.listdir(localExtractFilePath):
        if file.endswith("csv"):
            print('{} file has been found. Loading to Pandas DF'.format(file))
            #Load to a Pandas DataFrame Object (Documentation: https://pandas.pydata.org/pandas-docs/stable/generated/pandas.read_csv.html)
            df = pd.read_csv(os.path.abspath(file))
            df['symbol'] = os.path.splitext(file)[0][:-7]
            print('Loading to DB....')
            #Upload DF object to SQL (Documentation: https://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.to_sql.html)
            df.to_sql(con=engine, index=False, if_exists='append')
            print('Done, on to the next file!')

if __name__ == '__main__':
    main()

希望你觉得这个有帮助！

- Anton Petrosyuk