that's intriguing. what's your own workflow like with running models locally?
Login to reply
Replies (1)
Using llama.cpp and transformersjs to run some simple inference at my nestjs api for spam detection. At zero cost. Would like to explore more about real-time object detection with things like the YOLO11 model.