OpenCL Theano - 如何强制禁用CUDA?

4

经过一系列的努力,我在一台搭载AMD显卡 - Radeon HD 5450 (Cedar)的机器上成功安装了Theano。

现在,考虑下面的代码。

import numpy
import theano
import theano.tensor as T
rng = numpy.random

N = 400         #number of samples
feats = 784     #dimensionality of features
D = (rng.randn(N, feats), rng.randint(size=N, low=0, high=2))
training_steps = 10000

# theano symbolic variables
x = T.matrix("x")
y = T.vector("y")
w = theano.shared(rng.randn(784), name="w")
b = theano.shared(0., name="b")

print("Initial Model:")
print(str(w.get_value()) + " " + str(b.get_value()) )

p_1 = 1/(1 + T.exp(-T.dot(x, w) - b))       # probability of target being 1
prediction = p_1 > 0.5                      # prediction threshold
xent = -y * T.log(p_1) - (1-y)*T.log(1-p_1) # cross-entropy loss function
cost = xent.mean() + 0.01 * (w**2).sum()    # cost - to be minimized
gw, gb = T.grad(cost, [w, b])

#compile it
train = theano.function(
                        inputs = [x, y],
                        outputs = [prediction, xent],
                        updates = {w: w - 0.1*gw, b: b - 0.1*gb}    )

predict = theano.function(inputs = [x], outputs = prediction)

#train it
for i in range (training_steps):
    pred, err = train(D[0], D[1])

print("Final Model: ")
print(str(w.get_value()) + " " + str(b.get_value()) )
print("Target values for D: " + str(D[1]))
print("Predictions on D: " + str(D[0]))

我认为这段代码应该能正常工作。但是我收到了一系列的错误信息:

ERROR (theano.gof.opt): Optimization failure due to: local_gpua_hgemm
ERROR (theano.gof.opt): node: dot(x.T, Elemwise{sub,no_inplace}.0)
ERROR (theano.gof.opt): TRACEBACK:
ERROR (theano.gof.opt): Traceback (most recent call last):
  File "/home/user/anaconda3/lib/python3.5/site-packages/theano/gof/opt.py", line 1772, in process_node
    replacements = lopt.transform(node)
  File "/home/user/anaconda3/lib/python3.5/site-packages/theano/sandbox/gpuarray/opt.py", line 140, in local_opt
    new_op = maker(node, context_name)
  File "/home/user/anaconda3/lib/python3.5/site-packages/theano/sandbox/gpuarray/opt.py", line 732, in local_gpua_hgemm
    if nvcc_compiler.nvcc_version < '7.5':
TypeError: unorderable types: NoneType() < str()

我收到了多次相同的信息。最后,我的处理结果是:
  File "/home/user/anaconda3/lib/python3.5/site-packages/pygpu-0.2.1-py3.5-linux-x86_64.egg/pygpu/elemwise.py", line 286, in __init__
    **self.flags)
  File "pygpu/gpuarray.pyx", line 1950, in pygpu.gpuarray.GpuKernel.__cinit__ (pygpu/gpuarray.c:24214)
  File "pygpu/gpuarray.pyx", line 467, in pygpu.gpuarray.kernel_init (pygpu/gpuarray.c:7174)
pygpu.gpuarray.UnsupportedException: ('The following error happened while compiling the node', GpuElemwise{Composite{((-i0) - i1)}}[(0, 0)]<gpuarray>(GpuFromHost<None>.0, InplaceGpuDimShuffle{x}.0), '\n', b'Device does not support operation')

这是否意味着我不能使用这个GPU,或者是我的代码出了问题。此外,从错误信息来看,似乎一直在寻找 nvcc。但我没有CUDA,我有OpenCL。

>>> import theano
Mapped name None to device opencl0:0: Cedar

另外:

>>> from theano import config
>>> config.device
'opencl0:0'
>>> config.cuda
<theano.configparser.AddConfigVar.<locals>.SubObj object at 0x7fba9dee7d30>
>>> config.nvcc
<theano.configparser.AddConfigVar.<locals>.SubObj object at 0x7fba9e5967f0>
>>> config.gpu
<theano.configparser.AddConfigVar.<locals>.SubObj object at 0x7fbaa9f61828>

那么我该怎么办?是否有方法可以确保搜索clcc而不是nvcc

PS_1:hello world 可以工作。 PS_2:系统 = 14.04 64位。

1个回答

6

Theano目前还不支持OpenCL,因此只支持NVIDIA GPU。

OpenCL的状态记录在GitHub上。

您需要通过在Theano配置中设置device=cpu来禁用GPU操作。有多种方法可以做到这一点(例如通过THEANO_FLAGS环境变量或通过.theanorc文件;请参阅文档)。

在运行脚本之前,请尝试设置

export THEANO_FLAGS=device=cpu,floatX=float64

您的情况可能需要更多的配置选项。请查看文档以获取更多信息。


是的,谢谢。我已经阅读了这个问题。但是我在聊天记录中发现了一些提到它可能有效的参考资料。我已经打开了另一个问题 - https://github.com/Theano/Theano/issues/4112,并且我可能会为解决它做出贡献。但是应该避免在CPU上运行,因为它在解决任何中等规模的问题时都变得不切实际。我正在探索的另一个选项是OpenCL Caffe。 - Adorn

网页内容由stack overflow 提供, 点击上面的
可以查看英文原文,
原文链接