waxwing's avatar
waxwing 3 days ago
Oh! That's a great point, didn't realize, but makes sense now you mention it.

Replies (1)

Yeah, on "round trip tests" it worked fine on encode/decode since it would use MPS on both, but stumbled across the issue when doing some other test and the LLM used CPU to decode and caught it in the default/test case.