在迭代翻译成千上万的文本数据时，我遇到了这个错误：
Expecting value: line 1 column 1 (char 0)
我用来翻译大量文本的代码：
translatedList = []
for index, row in df.iterrows():
newrow = copy.deepcopy(row)
try:
# translate the 'text' column
translated = translator.translate(row['text'], dest='en')
newrow['translated'] = translated.text
except Exception as e:
print(str(e))
continue
translatedList.append(newrow)
在翻译约2-3k行后，我收到了这个错误。
我大概弄明白了问题所在。我认为这与Google API的请求限制有关。
我通过在每次迭代时重新初始化翻译器API来解决了这个问题：
import copy
from googletrans import Translator
translatedList = []
for index, row in df.iterrows():
# REINITIALIZE THE API
translator = Translator()
newrow = copy.deepcopy(row)
try:
# translate the 'text' column
translated = translator.translate(row['text'], dest='en')
newrow['translated'] = translated.text
except Exception as e:
print(str(e))
continue
translatedList.append(newrow)
这是我绕过他们的API调用限制所必须做的事情... 我使用VPN，具体来说是Nord-Vpn，因此要以我这种方式进行操作，您需要能够通过终端连接/断开连接到/从VPN...
def translate_text(text, dest_language="en"):
# Used to translate using the googletrans library
import json
translator = googletrans.Translator()
try:
translation = translator.translate(text=text, dest=dest_language)
except json.decoder.JSONDecodeError:
# api call restriction
process = subprocess.Popen(["nordvpn", "d"], stdout=subprocess.PIPE)
process.wait()
process = subprocess.Popen(["nordvpn", "c", "canada"], stdout=subprocess.PIPE)
process.wait()
return Process_Data.translate_text(text=text, dest_language=dest_language)
return translation
["nordvpn", "d"]和["nordvpn", "c", "canada"]替换为你在终端中执行断开连接和连接到特定VPN的正确命令即可。我使用NordVPN，因此使用了“nordvpn”命令。 - Austin Marino谷歌可能会阻止您的IP地址，使用VPN即可解决。
有两个可能的原因：
1. IP地址被暂时阻止了。
2. 您已达到字符限制。
我曾经遇到同样的问题，最终使用了另一个名为translate的软件包，它可以完美地解决这个问题。语法也非常相似。您可以在这里找到它，或者使用pip install translate
在我的情况下，这是由于字符串中的表情符号导致的。 我删除了它们，一切都运行正常。
在我的情况下，错误是由于短时间内过多的请求导致我的IP地址被暂时阻止。我第二天再试，一切都正常了。
目标是允许您通过CMD连接/断开连接和选择服务器(您也可以在Linux中执行相同的操作)，以便您可以通过Python代码控制这些NordVPN CMD命令。
以下是函数(请导入所需的库):
import random
listofservers = ["South Africa", "Egypt" , "Australia", "New Zealand", "South Korea", "Singapore", "Taiwan", "Vietnam", "Hong Kong", "Indonesia", "Thailand", "Japan", "Malaysia", "United Kingdom", "Netherlands", "Germany", "France", "Belgium", "Switzerland", "Sweden","Spain","Denmark", "Italy", "Norway", "Austria", "Romania", "Czech Republic", "Luxembourg", "Poland", "Finland", "Hungary", "Latvia", "Russia", "Iceland", "Bulgaria", "Croatia", "Moldova", "Portugal", "Albania", "Ireland", "Slovakia","Ukraine", "Cyprus", "Estonia", "Georgia", "Greece", "Serbia", "Slovenia", "Azerbaijan", "Bosnia and Herzegovina", "Macedonia","India", 'Turkey', 'Israel', 'United Arab Emirates', 'United States', 'Canada','Mexico'
,"Brazil", "Costa Rica", "Argentina", "Chile"]
def SelectServer(l):
return random.choice(l)
def translate_text(text, dest_language="en"):
# Used to translate using the googletrans library
translator = googletrans.Translator()
try:
translation = translator.translate(text=text, dest=dest_language)
except json.decoder.JSONDecodeError:
# api call restriction
print("exception !! déconection du VPN ")
process = subprocess.Popen(["nordvpn", "-d"], shell = True ,stdout=subprocess.PIPE, stderr=subprocess.PIPE)
process.wait()
time.sleep(5)
srv = SelectServer(listofservers)
print("sélection du serveur : "+ srv + " et connexion")
process = subprocess.Popen(["nordvpn", "-c", "-g", srv ], shell = True ,stdout=subprocess.PIPE, stderr=subprocess.PIPE)
process.wait()
time.sleep(60)
return translate_text(text=text, dest_language=dest_language)
return translation.text
#translate to EN and remove EN stopwords
ListCapTranslated = []
for row in ListCaptionsCleanFiltred:
# REINITIALIZE THE API
newrow = translate_text(row, dest_language="en")
ListCapTranslated.append(newrow)
ListCapTranslated
from langdetect import detect
lang = detect(title)
if lang == 'en':
temp_dict['title'] = title
else:
temp_dict['title'] = translator.translate(title, dest='en').text
from translingual import translate
# example
trans = translate.translate(data=['hello world', 'the world is yours', 'whatever you do, whatever I do', '2b or not 2b'],tolang='es',fromlang='en',thread=3)
print(trans.translate())
这是由于API限制造成的。每次初始化的翻译限制。 因此，通过拆分代码，在限制后重新初始化翻译器。
from googletrans import Translator
translator = Translator()