Developer OneNote

Tag: Azure OpenAI

  • Comparing OpenAI and Azure OpenAI Features

    Update: This document has been updated as of December 2023

    In the rapidly evolving landscape of artificial intelligence, OpenAI has positioned itself as a leader in advanced AI models. Microsoft, through Azure OpenAI, has partnered with OpenAI to bring these innovations to a wider audience, integrating them into their cloud platform. Both entities offer a range of AI tools, but with differing availability and features. In this blog, we’ll delve into the latest offerings as of OpenAI DevDay and compare them with what’s available on Azure OpenAI as of December 2023.

    Feature / AspectOpenAI Release DateAzure OpenAI Status
    OpenAI Model GPT 3.5Launched November 2023Available
    OpenAI Model GPT 4Launched February 2023Available
    ChatGPT EnterpriseAugust 28, 2023 Introducing ChatGPT Enterprise Microsoft provides similar services, such as Microsoft 365 Copilot and Bing Chat Enterprise
    OpenAI Model GPT-4 TurboNovember 6, 2023 New models and developer products announced at DevDayUse model gpt-4 and version 1106-Preview, model only available in certain regions.
    OpenAI Model GPT-4 Turbo with Vision(aka gpt-4v)November 6, 2023 New models and developer products announced at DevDayUse model gpt-4 and version vision-preview, model only available in certain regions
    OpenAI Model DALL-E 3November 6, 2023 New models and developer products announced at DevDayAvailable
    GPTsNovember 6, 2023 Introducing GPTsNot available
    Assistants APINovember 6, 2023 New models and developer products announced at DevDayNot available
    ChatGPT Plugins and Advanced Data AnalysisNot available

  • Resolving Knowledge Cut-off Discrepancies in Azure OpenAI’s GPT-4 Turbo Model

    If you are an AI enthusiast and have been using Azure OpenAI, you might be contemplating upgrading your deployment from gpt4 to the more advanced gpt-4-1106 preview, also referred to as gpt-4 turbo. This comes in the wake of Microsoft’s official announcement about this more advanced model. However, as you embark on this upgrade, you might encounter a few discrepancies that could potentially confuse you.

    One such discrepancy revolves around the cut-off knowledge of the Azure OpenAI deployment compared to the same version in OpenAI’s playground. The cut-off knowledge refers to the date at which the model stops learning new information from the internet. For instance, when you query GPT4-turbo on Azure OpenAI about its cut-off knowledge, it responds that its learning cut-off is April 2023. This implies that the model should be aware of all the information and events up to that date.

    However, when you pose the same question to the model deployed on Azure, you get a different response. The Azure-deployed model states that its cut-off knowledge is 2021, not April 2023 as indicated in the documentation. This discrepancy might seem confusing and might even make you question the effectiveness of the upgrade.

    Solution: Prompt Engineering

    But, fret not. There’s a simple workaround to this issue that involves a bit of prompt engineering. By tweaking the system message to say, “You are a helpful assistant with knowledge cutoff of April 2023“, you can effectively guide the model to provide the most recent information. This change in the system message ‘instructs’ the model to recognize and utilize data up to April 2023, thereby aligning it with the cut-off knowledge indicated in the documentation.