Confused by Streaming Responses in SK? Let's talk about it using 🍕as a metaphor 🥸 👇
Imagine you're at a pizza party, waiting for pizzas to be delivered by the pizza delivery person. There are two ways the pizzas can be brought to you:
Login to reply
Replies (1)
Non-streaming: The pizza delivery person brings you all the pizzas at once in a big stack of pizza boxes. You have to wait for them to finish making all the pizzas and put them in the boxes. You can't eat any pizza until they arrive with the entire stack.