To get the latest version of the Azure Functions runtime, update the
Core Tools version as described here Develop Azure Functions locally
using Core Tools | Microsoft Learn
Hi all, there is a bug where HTTP streaming is not working as expected
on Dedicated plans. Here is the issue where you can track this - [Bug]
HTTP Streaming doesn't work on Premium plans · Issue #1504 ·
Azure/azure-functions-python-worker (github.com) and we will update this
as we make progress. Tha...
Yep, we're getting true streaming responses - we're streaming an OpenAI
LLM response and can see the results coming back a word or two at a time
- make sure your client is handling the streaming response, not
everything does! Still struggling to get this deployed to always-on
premium though!
Hibernation for general purpose sizes is now generally available :
https://azure.microsoft.com/en-us/updates/general-availability-vm-hibernation-general-purpose/Additionally,
you can now enable hibernation on existing VMs. More details are
available here - Linux Hibernation Windows VMs
One more question. Have you checked if it is truly streaming? I have
looked at flask using wsgiFunctionApp and while the flask streaming code
is standard. The middleware seems to be waiting for the full results
before releasing downstream. Given you are using fastapi, i assume it
has some middleware...
Latest Comments