{"type":"video","version":"1.0","html":"<iframe src=\"https://www.loom.com/embed/8da67e4845ce431a98c901d4e45db0e5\" frameborder=\"0\" width=\"1670\" height=\"1252\" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>","height":1252,"width":1670,"provider_name":"Loom","provider_url":"https://www.loom.com","thumbnail_height":1252,"thumbnail_width":1670,"thumbnail_url":"https://cdn.loom.com/sessions/thumbnails/8da67e4845ce431a98c901d4e45db0e5-d50983c980f3799c.gif","duration":42.5284,"title":"x-litellm-stream-timeout demo","description":"In this video, I demonstrate how to use the X-Lite LM Stream timeout header, specifically setting it to 0.04 seconds for a streaming request. This low timeout is intended to illustrate how quickly the system can timeout under these conditions. I also discuss the implications of increasing the timeout to 4 seconds. I encourage you to experiment with these settings in your own streaming requests to see how they affect performance. Please let me know if you have any questions or need further clarification!"}