我想要从url
下载一个tar文件到内存中,然后将它的所有内容提取到dst
文件夹中。我该怎么做?以下是我的尝试,但没有成功实现。
#!/usr/bin/python3.6
# -*- coding: utf-8 -*-
from pathlib import Path
from io import BytesIO
from urllib.request import Request, urlopen
from urllib.error import URLError
from tarfile import TarFile
def get_url_response( url ):
req = Request( url )
try:
response = urlopen( req )
except URLError as e:
if hasattr( e, 'reason' ):
print( 'We failed to reach a server.' )
print( 'Reason: ', e.reason )
elif hasattr( e, 'code'):
print( 'The server couldn\'t fulfill the request.' )
print( 'Error code: ', e.code )
else:
# everything is fine
return response
url = 'https://dl.opendesktop.org/api/files/download/id/1566630595/s/6cf6f74c4016e9b83f062dbb89092a0dfee862472300cebd0125c7a99463b78f4b912b3aaeb23adde33ea796ca9232decdde45bb65a8605bfd8abd05eaee37af/t/1567158438/c/6cf6f74c4016e9b83f062dbb89092a0dfee862472300cebd0125c7a99463b78f4b912b3aaeb23adde33ea796ca9232decdde45bb65a8605bfd8abd05eaee37af/lt/download/Blue-Maia.tar.xz'
dst = Path().cwd() / 'Tar'
response = get_url_response( url )
with TarFile( BytesIO( response.read() ) ) as tfile:
tfile.extractall( path=dst )
然而,我遇到了这个错误:
Traceback (most recent call last):
File "~/test_tar.py", line 31, in <module>
with TarFile( BytesIO( response.read() ) ) as tfile:
File "/usr/lib/python3.6/tarfile.py", line 1434, in __init__
fileobj = bltn_open(name, self._mode)
TypeError: expected str, bytes or os.PathLike object, not _io.BytesIO
我尝试将
BytesIO
对象作为 fileobj
传递给 TarFile
:with TarFile( fileobj=BytesIO( response.read() ) ) as tfile:
tfile.extractall( path=dst )
然而,它仍无法正常工作:
Traceback (most recent call last):
File "/usr/lib/python3.6/tarfile.py", line 188, in nti
s = nts(s, "ascii", "strict")
File "/usr/lib/python3.6/tarfile.py", line 172, in nts
return s.decode(encoding, errors)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd2 in position 0: ordinal not in range(128)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.6/tarfile.py", line 2297, in next
tarinfo = self.tarinfo.fromtarfile(self)
File "/usr/lib/python3.6/tarfile.py", line 1093, in fromtarfile
obj = cls.frombuf(buf, tarfile.encoding, tarfile.errors)
File "/usr/lib/python3.6/tarfile.py", line 1035, in frombuf
chksum = nti(buf[148:156])
File "/usr/lib/python3.6/tarfile.py", line 191, in nti
raise InvalidHeaderError("invalid header")
tarfile.InvalidHeaderError: invalid header
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "~/test_tar.py", line 31, in <module>
with TarFile( fileobj=BytesIO( response.read() ) ) as tfile:
File "/usr/lib/python3.6/tarfile.py", line 1482, in __init__
self.firstmember = self.next()
File "/usr/lib/python3.6/tarfile.py", line 2309, in next
raise ReadError(str(e))
tarfile.ReadError: invalid header
.tar.xz
类型的URL进行下载。是的,使用tarfile.open()
函数可以工作。谢谢您提供的参考,我之前忽略了它。有没有什么机会或方法来规避热链接? - Sun Bear