Get CUDA Information
This gives information about your cuda usage.
GET /device/cuda
Example
CUDA
cURL -XGET http://localhost:8882/device/cuda
results = mq.index("my-index").get_cuda_info()
For Marqo Cloud, you will need to access the endpoint of your index and replace your_endpoint
with this. To do this, visit Find Your Endpoint. You will also need your API Key. To obtain this key visit Find Your API Key.
cURL -XGET your_endpoint/device/cuda \
-H 'x-api-key: XXXXXXXXXXXXXXX'
results = mq.index("my-index").get_cuda_info()
Response: 200 OK
{
"cuda_devices": [
{
"device_id": 0,
"device_name": "Tesla T4",
"memory_used": "1.7 GiB",
"total_memory": "14.6 GiB",
"utilization": "11.0 %",
"memory_used_percent": "25.0 %"
}
]
}