Developer OneNote

Category: Azure

  • Comparing OpenAI and Azure OpenAI Features

    Update: This document has been updated as of December 2023

    In the rapidly evolving landscape of artificial intelligence, OpenAI has positioned itself as a leader in advanced AI models. Microsoft, through Azure OpenAI, has partnered with OpenAI to bring these innovations to a wider audience, integrating them into their cloud platform. Both entities offer a range of AI tools, but with differing availability and features. In this blog, we’ll delve into the latest offerings as of OpenAI DevDay and compare them with what’s available on Azure OpenAI as of December 2023.

    Feature / AspectOpenAI Release DateAzure OpenAI Status
    OpenAI Model GPT 3.5Launched November 2023Available
    OpenAI Model GPT 4Launched February 2023Available
    ChatGPT EnterpriseAugust 28, 2023 Introducing ChatGPT Enterprise Microsoft provides similar services, such as Microsoft 365 Copilot and Bing Chat Enterprise
    OpenAI Model GPT-4 TurboNovember 6, 2023 New models and developer products announced at DevDayUse model gpt-4 and version 1106-Preview, model only available in certain regions.
    OpenAI Model GPT-4 Turbo with Vision(aka gpt-4v)November 6, 2023 New models and developer products announced at DevDayUse model gpt-4 and version vision-preview, model only available in certain regions
    OpenAI Model DALL-E 3November 6, 2023 New models and developer products announced at DevDayAvailable
    GPTsNovember 6, 2023 Introducing GPTsNot available
    Assistants APINovember 6, 2023 New models and developer products announced at DevDayNot available
    ChatGPT Plugins and Advanced Data AnalysisNot available

  • Resolving Knowledge Cut-off Discrepancies in Azure OpenAI’s GPT-4 Turbo Model

    If you are an AI enthusiast and have been using Azure OpenAI, you might be contemplating upgrading your deployment from gpt4 to the more advanced gpt-4-1106 preview, also referred to as gpt-4 turbo. This comes in the wake of Microsoft’s official announcement about this more advanced model. However, as you embark on this upgrade, you might encounter a few discrepancies that could potentially confuse you.

    One such discrepancy revolves around the cut-off knowledge of the Azure OpenAI deployment compared to the same version in OpenAI’s playground. The cut-off knowledge refers to the date at which the model stops learning new information from the internet. For instance, when you query GPT4-turbo on Azure OpenAI about its cut-off knowledge, it responds that its learning cut-off is April 2023. This implies that the model should be aware of all the information and events up to that date.

    However, when you pose the same question to the model deployed on Azure, you get a different response. The Azure-deployed model states that its cut-off knowledge is 2021, not April 2023 as indicated in the documentation. This discrepancy might seem confusing and might even make you question the effectiveness of the upgrade.

    Solution: Prompt Engineering

    But, fret not. There’s a simple workaround to this issue that involves a bit of prompt engineering. By tweaking the system message to say, “You are a helpful assistant with knowledge cutoff of April 2023“, you can effectively guide the model to provide the most recent information. This change in the system message ‘instructs’ the model to recognize and utilize data up to April 2023, thereby aligning it with the cut-off knowledge indicated in the documentation.

  • Exploring OpenAI Offerings: ChatGPT Enterprise, ChatGPT Application, and OpenAI Models

    OpenAI, a leading player in the artificial intelligence industry, has introduced a range of AI-based solutions including the ChatGPT Enterprise, ChatGPT Application (Free/Plus), and OpenAI Models (GPT 3.5, GPT-4). Each of these offerings has unique features and uses, catering to different user needs.

    • ChatGPT Enterprise: Launched in August 2023, ChatGPT Enterprise is a premium version of OpenAI’s generative AI chatbot app designed for businesses. It offers enhanced enterprise-grade security and privacy, unlimited higher-speed access to GPT-4, longer context windows for processing longer inputs, advanced data analysis capabilities, and customization options.
    • ChatGPT Free/Plus: The ChatGPT Free and ChatGPT Plus applications are user-friendly AI chatbot applications that provide interactive experiences with OpenAI models. ChatGPT Free provides access to the GPT-3.5 model and is ideal for general use. ChatGPT Plus offers capped usage access to the more powerful GPT-4 model, additional features, and faster response times for a monthly fee.
    • OpenAI Models (GPT 3.5, GPT-4): These large language models developed by OpenAI are trained to understand and generate human-like text. They are capable of generating text outputs in response to prompts, performing a wide range of natural language processing tasks, including translation, summarization, question answering, and more. Typically accessed via API, these models allow integration into a wide range of applications and platforms.

    This table provides a quick reference guide to the different offerings by OpenAI:

    ChatGPT EnterpriseChatGPT Free/Plus OpenAI Models (GPT 3.5, GPT-4)
    DescriptionPremium version of OpenAI’s generative AI chatbot app tailored for businesses, offering enhanced capabilities and features.User-friendly AI chatbot applications that provide interactive experiences with OpenAI models.Cutting-edge language models developed by OpenAI, trained to understand and generate human-like text.
    Launch DateAugust 2023ChatGPT Free: November 2022
    ChatGPT Plus: February 2023    		GPT-3.5-turbo and GPT-4: Dates vary, please refer to OpenAI’s official announcements.
    Key FeaturesEnterprise-level security and privacy, unlimited high-speed access to GPT-4, extended context windows for processing longer inputs, advanced data analysis capabilities, and customization options to cater to specific business needs.ChatGPT Free: Provides access to GPT-3.5 model, ideal for general use.
    ChatGPT Plus: Offers capped usage access to the more powerful GPT-4 model, additional features, and faster response times for a monthly fee.    		Capable of generating text outputs in response to prompts, performing a wide range of natural language processing tasks, including translation, summarization, question answering, and more.
    Platform AvailabilityTypically available across multiple platforms to cater to diverse business needs.Available across multiple platforms, including web, iOS, and Android, for easy and convenient access.Typically accessed via API, allowing integration into a wide range of applications and platforms.
    UsageIdeal for businesses requiring high-level AI capabilities, including data analysis, customer service automation, content generation, and more.Suitable for general users seeking interactive AI experiences, including learning, entertainment, and personal productivity.Used in a variety of applications, including AI chatbots, content generation tools, language translation services, and more.
    PricingTypically offered on a subscription basis, with pricing details available from OpenAI.ChatGPT Free: Free of charge.
    ChatGPT Plus: Available for a monthly fee.    		Pricing varies depending on usage and the specific model accessed. Details available from OpenAI.

    For more detailed and up-to-date information, please visit OpenAI’s official website.

  • Fix [Errno 8] Exec format error: ‘/Users//.azure/bin/bicep’

    When you run az bicep command on Mac M1, you might experience error 

    [Errno 8] Exec format error: '/Users/<username>/.azure/bin/bicep'

    This error is because for some reason, bicep in azure cli was installed with a non-ARM version, to resolve this, do following steps

    1. Remove /Users/<username>/.azure/bin/bicep
    2. Run az bicep version, this will force Azure CLI to download bicep and refresh.
    3. If you see a message output with Successfully installed Bicep CLI to, then the bicep is repaired successfully.

  • Difference between Azure Basic Tier VM and Standard Tier VM

    Start from 2014 April, Microsoft Azure introduces a new instance tier of Virtual Machine – Basic tier. These instances are well-suited for production applications that do not require the Azure load-balancer (bring-your-own LB or single instance) , development workloads, test servers and memory-focused  batch processing applications. image

    There are few documents on what is the difference between basic tier VM and standard tier VM so here is a summary note based on my research

    Azure price page makes it clear: General purpose compute: Basic tier – An economical option for development workloads, test servers, and other applications that don’t require load balancing, auto-scaling, or memory-intensive virtual machines.

    Below are some detail context:

    • Availability: Basic tier VM is only available on A0-A4 instances, standard tier VM is available on all size instances
    • Disk IOPS: Data disk IOPS for basic tier VM is 300, lower than standard tier VM which has 500 IOPS data disk.
    • Price: Single tier VM can have up to 27% less in price than standard tier VM.
    • Feature cut: Basic tier VM does not include load balancing or auto-scaling. For basic tier VMs, you can add those to availability set for high availability, and implement your own load-balance mechanisms.
    • CPU: Standard tier have better CPU performance than basic tier

  • Hyper-V VHD TO VHDX Conversion Step By Step Guide

    Here are the steps to use the built in wizard in the Windows Server 2012 Hyper-V Manager to convert from VHD to VHDX.

    1. Go to the Hyper-V Manager. Under the Actions pane, click on Edit Disk… (more…)

  • Turning on and off GUI in Windows Server 2012

    When you install Windows Server 2012, you can choose between Server Core Installation and Server with a GUI. The Server with a GUI option is the Windows Server 2012 equivalent of the Full installation option available in Windows Server 2008 R2. The Server Core Installation option reduces the space required on disk, the potential attack surface, and especially the servicing requirements. In Windows Server 2012, you can freely switch between these options at any time, one approach might be to initially install the Server with a GUI option, use the graphical tools to configure the server, and then later switch to the Server Core Installation option.

    To use PowerShell to switch between Server Core and Full Server with GUI

    Full Server with GUI to Server Core

    Uninstall-WindowsFeature Server-Gui-Mgmt-Infra -Restart

    Server Core to Full Server with GUI

    Install-WindowsFeature Server-Gui-Mgmt-Infra,Server-Gui-Shell -Restart

  • Deploy Windows 8 to a virtual hard disk

    Windows 7 introduced Native VHD boot which allows user to install Windows 7/Windows server 2008 R2 on a physical box to a virtual hard disk (VHD). You can do same process in Windows 8

    1. Boot from the Windows 8 media (USB, CD, etc.).
    2. At the Install screen, press Shift+F10 to open a command prompt.
    3. Start diskpart and create the VHD file you want to install to:

      create vdisk file=c:win8.vhd maximum=80000 type=expandable
      select vdisk file=c:win8.vhd
      attach vdisk
      create partition primary
      format fs=ntfs label=”Win8″ quick

    4. Exit diskpart, and when you install Windows 8 you’ll be able to select your VHD volume (ignore the warning that you won’t be able to install).

    If this is an existing machine, and you want to dual boot rather than wipe the disk, then don’t perform the first three blocks of commands.

  • Difference between Windows Client Hyper-V and Server Hyper-V

    Windows 8 supports virtualization on the client OS to allow IT professionals and developers to use Hyper-V as a desktop operating system. If you are an IT Professional or developer that uses Windows Server as development operating environments, you should be excited about new client Hyper-V feature in Windows 8 and wonder what are some of the key differences and similarities between Windows 8 Hyper-V and Windows Server 2012 Hyper-V?

    Here are the some of the key differences in Windows 8 Client Hyper-V from Windows Server 2012 Hyper-V:

    • No Hyper-V Replica
    • No Hyper-V Network Virtualization
    • No Virtual Machine Live Migration (Requires Failover Clustering only in Windows Server)
    • No Shared Nothing Live Migration
    • No SR-IOV (You need server class hardware; appropriate firmware, etc; you won’t find this on desktops)
    • No Failover Clustering (Client doesn’t include Failover Clustering)
    • No Virtual Fiber Channel
    • No RemoteFX GPU Hardware Acceleration ( which requires RDV only in Windows Server)
    • Second Level Address Translation (SLAT) HW required

    And the commonalities between Windows 8 Hyper-V & Windows Server 2012 Hyper-V

    • Virtual Machines created with Client Hyper-V are 100% compatible with Server Hyper-V
    • Client Hyper-V offers the same VM scale as Server
      • Up to 64 virtual processes per VM
      • Up to 64TB per virtual disk ( vhdx format )
      • Up to 1 TB of memory per VM.
    • Live Storage Migration is included
    • Support VHD Storage on SMB3 file shares
    • 100% PowerShell/WMI compatibility in management from Client to Server.
    • Client Hyper-V offers the full rich, open and extensible Hyper-V virtual switch.
    • QoS, bandwidth management and other advanced virtual switch capabilities are in there

  • Install Hyper-V Manager on Windows 10

    To remotely manage your Windows Server 2008 Hyper-V server from a windows 7 desktop, you need install RSAT (Remote Server Administrator Tool). This has been simplified in Windows 10. In Windows 10, Hyper-V management tool is built in, Hyper-V manager can be turned on via “Turn Windows features on or off” dialog directly without downloading RSAT.

    image

    However, Hyper-V manager in Windows 10 can’t manage can’t manage Hyper-V running on downlevel operation systems. If you connect using Hyper-V manager it would fail with following error:

    This version of Hyper-V Manager cannot be used to manage server running Hyper-V in Windows Server 2008 or Windows Server 2008 R2

    The only workaround so far is remote into a Windows 7/Windows Server 2008 R2 machine and run Hyper-V manager there.