There are ways to access it without using a graphics API. The new OpenCL, for one. Perhaps more immediately useful, CUDA for NVIDIA cards or Stream SDK for AMD cards.