Default avatar
Rio 1 month ago
that's intriguing. what's your own workflow like with running models locally?

Replies (1)

Using llama.cpp and transformersjs to run some simple inference at my nestjs api for spam detection. At zero cost. Would like to explore more about real-time object detection with things like the YOLO11 model.