{"id":3982,"date":"2023-11-04T23:13:58","date_gmt":"2023-11-04T23:13:58","guid":{"rendered":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/"},"modified":"2023-11-05T05:48:25","modified_gmt":"2023-11-05T05:48:25","slug":"deploying-a-machine-learning-model-to-azure-machine-learning-service","status":"publish","type":"post","link":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/","title":{"rendered":"Deploying a machine learning model to Azure Machine Learning Service"},"content":{"rendered":"

Introduction<\/h2>\n

In today’s data-intensive world, machine learning models can be employed to create value for businesses and individuals alike. With the advent of cloud computing and services such as Azure Machine Learning Service, building and deploying machine learning models has become easier than ever. In this tutorial, we will walk through the steps for deploying a machine learning model to Azure Machine Learning Service.<\/p>\n

Prerequisites<\/h2>\n

Before we begin, ensure you have access to an Azure subscription and have installed the Azure Machine Learning Python SDK.<\/p>\n

Step 1: Set up Azure Machine Learning workspace<\/h2>\n

An Azure Machine Learning workspace provides a centralized location to manage data, compute resources, and experiments. To create a workspace, follow these steps:<\/p>\n

    \n
  1. Sign in to Azure portal and click “Create a resource”.<\/li>\n
  2. Search for “Machine Learning” and select “Machine Learning” (preview) under the “AI + Machine Learning” category.<\/li>\n
  3. Click “Create” and fill in the required fields. You can create a new resource group or select an existing one.<\/li>\n
  4. Under “Workspace configuration”, select your subscription and a region to create the workspace in. Ensure “Azure Machine Learning” is selected under “Edition” and set “Workspace name” to a unique name.<\/li>\n
  5. Click “Review + create” and then “Create” to create the workspace.<\/li>\n<\/ol>\n

    Step 2: Prepare the machine learning model<\/h2>\n

    Before we can deploy a machine learning model, we must first prepare it for deployment. In this example, we will use a pre-trained model for image classification. Specifically, we will use the ResNet50 model pre-trained on the ImageNet dataset.<\/p>\n

      \n
    1. Install the necessary Python libraries: tensorflow, keras, and numpy.<\/li>\n
    2. Load the pre-trained ResNet50 model using the Keras library.<\/li>\n
    3. Convert the Keras model to an ONNX format using the onnx-keras library.<\/li>\n<\/ol>\n

      Step 3: Create a scoring script<\/h2>\n

      A scoring script is used to output the predictions made by the machine learning model. In this example, we will output the predicted class label and the probability for each prediction.<\/p>\n

        \n
      1. Create a file called “score.py”.<\/li>\n
      2. Define a function called “init()” that will load the ONNX model and its associated metadata.<\/li>\n
      3. Define a function called “run(input_data)” that will accept input data, preprocess it, and use the loaded ONNX model to make a prediction.<\/li>\n
      4. Define a variable called “output” that will contain the predicted class label and probability for each prediction.<\/li>\n
      5. Return “output” in the “run()” function.<\/li>\n<\/ol>\n

        Step 4: Create an environment file<\/h2>\n

        An environment file specifies the dependencies required by the scoring script and the compute environment on which the script will run. In this example, we will use a Python 3.6 environment.<\/p>\n

          \n
        1. Create a file called “myenv.yml”.<\/li>\n
        2. Specify <\/li>\n<\/ol>\n

          the Python version and the necessary dependencies. In this example, we will require tensorflow, onnxruntime, and numpy.<\/p>\n

          name: myenv\ndependencies:\n- python=3.6\n- pip\n- tensorflow\n- onnxruntime\n- numpy\n<\/code><\/pre>\n
          Step 5: Define the deployment configuration<\/h2>\n
          The deployment configuration specifies the compute target, entry script, environment file, and other necessary settings for deploying the machine learning model. In this example, we will use the Azure Kubernetes Service (AKS) as the compute target.<\/p>\n
            \n
          1. Define the deployment configuration using the Azure Machine Learning SDK.<\/li>\n<\/ol>\n
            from azureml.core.model import InferenceConfig, Model\nfrom azureml.core.webservice import AksWebservice\nfrom azureml.core.compute import AksCompute\nfrom azureml.core.compute_target import ComputeTargetException\n\naks_name = \"myaks\"\naks_resource_group = \"myresourcegroup\"\naks_location = \"westus2\"\nmodel_name = \"myonnxmodel\"\ndeployment_config = AksWebservice.deploy_configuration(cpu_cores=1, memory_gb=1)\n<\/code><\/pre>\n
              \n
            1. Define the AKS compute target.<\/li>\n<\/ol>\n
              try:\n    aks_target = AksCompute(workspace=ws, name=aks_name)\n    print(\"Found existing AKS service:\", aks_name)\nexcept ComputeTargetException:\n    print(\"Creating a new AKS service...\")\n    prov_config = AksCompute.provisioning_configuration(location=aks_location, resource_group=aks_resource_group)\n    aks_target = ComputeTarget.create(workspace=ws, name=aks_name, provisioning_configuration=prov_config)\n    aks_target.wait_for_completion(show_output=True)\n<\/code><\/pre>\n
                \n
              1. Define the input and output data types for the scoring script.<\/li>\n<\/ol>\n
                input_data = {\n    'image': 'numpy.ndarray'\n}\n\noutput_data = {\n    'output': 'numpy.ndarray'\n}\n<\/code><\/pre>\n
                  \n
                1. Define the inference configuration using the scoring script, environment file, and input and output data types.<\/li>\n<\/ol>\n
                  inference_config = InferenceConfig(\n    source_directory='.',\n    entry_script='score.py',\n    environment_file='myenv.yml',\n    input_data=input_data,\n    output_data=output_data\n)\n<\/code><\/pre>\n
                    \n
                  1. Retrieve the ONNX model from the Azure Machine Learning workspace.<\/li>\n<\/ol>\n
                    model = Model(ws, name=model_name, version=1)\n<\/code><\/pre>\n
                    Step 6: Deploy the machine learning model<\/h2>\n
                    Now that we have prepared the machine learning model, scoring script, environment file, and deployment configuration, we can deploy the model to Azure Machine Learning Service using the following command:<\/p>\n
                    aks_service = Model.deploy(ws, models=[model], inference_config=inference_config, deployment_config=deployment_config, deployment_target=aks_target)\naks_service.wait_for_deployment(show_output=True)\nprint(aks_service.state)\n<\/code><\/pre>\n
                    The above command will deploy the machine learning model to the AKS compute target and output its deployment state.<\/p>\n
                    Conclusion<\/h2>\n
                    In this tutorial, we have walked through the steps for deploying a machine learning model to Azure Machine Learning Service. By following these steps, you can easily deploy a machine learning model to Azure and make it available for consumption by other applications and services.<\/p>\n","protected":false},"excerpt":{"rendered":"
                    Introduction In today’s data-intensive world, machine learning models can be employed to create value for businesses and individuals alike. With the advent of cloud computing and services such as Azure Machine Learning Service, building and deploying machine learning models has become easier than ever. In this tutorial, we will walk Continue Reading<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_import_markdown_pro_load_document_selector":0,"_import_markdown_pro_submit_text_textarea":"","footnotes":""},"categories":[1],"tags":[692,689,691,690,212,688],"yoast_head":"\nDeploying a machine learning model to Azure Machine Learning Service - Pantherax Blogs<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deploying a machine learning model to Azure Machine Learning Service\" \/>\n<meta property=\"og:description\" content=\"Introduction In today’s data-intensive world, machine learning models can be employed to create value for businesses and individuals alike. With the advent of cloud computing and services such as Azure Machine Learning Service, building and deploying machine learning models has become easier than ever. In this tutorial, we will walk Continue Reading\" \/>\n<meta property=\"og:url\" content=\"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\" \/>\n<meta property=\"og:site_name\" content=\"Pantherax Blogs\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-04T23:13:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-05T05:48:25+00:00\" \/>\n<meta name=\"author\" content=\"Panther\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Panther\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\n\t    \"@context\": \"https:\/\/schema.org\",\n\t    \"@graph\": [\n\t        {\n\t            \"@type\": \"Article\",\n\t            \"@id\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/#article\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\"\n\t            },\n\t            \"author\": {\n\t                \"name\": \"Panther\",\n\t                \"@id\": \"http:\/\/localhost:10003\/#\/schema\/person\/b63d816f4964b163e53cbbcffaa0f3d7\"\n\t            },\n\t            \"headline\": \"Deploying a machine learning model to Azure Machine Learning Service\",\n\t            \"datePublished\": \"2023-11-04T23:13:58+00:00\",\n\t            \"dateModified\": \"2023-11-05T05:48:25+00:00\",\n\t            \"mainEntityOfPage\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\"\n\t            },\n\t            \"wordCount\": 643,\n\t            \"publisher\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/#organization\"\n\t            },\n\t            \"keywords\": [\n\t                \"\\\"AI deployment\\\"]\",\n\t                \"\\\"Azure Machine Learning Service\\\"\",\n\t                \"\\\"cloud machine learning\\\"\",\n\t                \"\\\"machine learning deployment\\\"\",\n\t                \"\\\"Microsoft Azure\\\"\",\n\t                \"[\\\"Deploying a machine learning model\\\"\"\n\t            ],\n\t            \"inLanguage\": \"en-US\"\n\t        },\n\t        {\n\t            \"@type\": \"WebPage\",\n\t            \"@id\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\",\n\t            \"url\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\",\n\t            \"name\": \"Deploying a machine learning model to Azure Machine Learning Service - Pantherax Blogs\",\n\t            \"isPartOf\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/#website\"\n\t            },\n\t            \"datePublished\": \"2023-11-04T23:13:58+00:00\",\n\t            \"dateModified\": \"2023-11-05T05:48:25+00:00\",\n\t            \"breadcrumb\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/#breadcrumb\"\n\t            },\n\t            \"inLanguage\": \"en-US\",\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"ReadAction\",\n\t                    \"target\": [\n\t                        \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/\"\n\t                    ]\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"BreadcrumbList\",\n\t            \"@id\": \"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/#breadcrumb\",\n\t            \"itemListElement\": [\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 1,\n\t                    \"name\": \"Home\",\n\t                    \"item\": \"http:\/\/localhost:10003\/\"\n\t                },\n\t                {\n\t                    \"@type\": \"ListItem\",\n\t                    \"position\": 2,\n\t                    \"name\": \"Deploying a machine learning model to Azure Machine Learning Service\"\n\t                }\n\t            ]\n\t        },\n\t        {\n\t            \"@type\": \"WebSite\",\n\t            \"@id\": \"http:\/\/localhost:10003\/#website\",\n\t            \"url\": \"http:\/\/localhost:10003\/\",\n\t            \"name\": \"Pantherax Blogs\",\n\t            \"description\": \"\",\n\t            \"publisher\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/#organization\"\n\t            },\n\t            \"potentialAction\": [\n\t                {\n\t                    \"@type\": \"SearchAction\",\n\t                    \"target\": {\n\t                        \"@type\": \"EntryPoint\",\n\t                        \"urlTemplate\": \"http:\/\/localhost:10003\/?s={search_term_string}\"\n\t                    },\n\t                    \"query-input\": \"required name=search_term_string\"\n\t                }\n\t            ],\n\t            \"inLanguage\": \"en-US\"\n\t        },\n\t        {\n\t            \"@type\": \"Organization\",\n\t            \"@id\": \"http:\/\/localhost:10003\/#organization\",\n\t            \"name\": \"Pantherax Blogs\",\n\t            \"url\": \"http:\/\/localhost:10003\/\",\n\t            \"logo\": {\n\t                \"@type\": \"ImageObject\",\n\t                \"inLanguage\": \"en-US\",\n\t                \"@id\": \"http:\/\/localhost:10003\/#\/schema\/logo\/image\/\",\n\t                \"url\": \"http:\/\/localhost:10003\/wp-content\/uploads\/2023\/11\/cropped-9e7721cb-2d62-4f72-ab7f-7d1d8db89226.jpeg\",\n\t                \"contentUrl\": \"http:\/\/localhost:10003\/wp-content\/uploads\/2023\/11\/cropped-9e7721cb-2d62-4f72-ab7f-7d1d8db89226.jpeg\",\n\t                \"width\": 1024,\n\t                \"height\": 1024,\n\t                \"caption\": \"Pantherax Blogs\"\n\t            },\n\t            \"image\": {\n\t                \"@id\": \"http:\/\/localhost:10003\/#\/schema\/logo\/image\/\"\n\t            }\n\t        },\n\t        {\n\t            \"@type\": \"Person\",\n\t            \"@id\": \"http:\/\/localhost:10003\/#\/schema\/person\/b63d816f4964b163e53cbbcffaa0f3d7\",\n\t            \"name\": \"Panther\",\n\t            \"image\": {\n\t                \"@type\": \"ImageObject\",\n\t                \"inLanguage\": \"en-US\",\n\t                \"@id\": \"http:\/\/localhost:10003\/#\/schema\/person\/image\/\",\n\t                \"url\": \"http:\/\/2.gravatar.com\/avatar\/b8c0eda5a49f8f31ec32d0a0f9d6f838?s=96&d=mm&r=g\",\n\t                \"contentUrl\": \"http:\/\/2.gravatar.com\/avatar\/b8c0eda5a49f8f31ec32d0a0f9d6f838?s=96&d=mm&r=g\",\n\t                \"caption\": \"Panther\"\n\t            },\n\t            \"sameAs\": [\n\t                \"http:\/\/localhost:10003\"\n\t            ],\n\t            \"url\": \"http:\/\/localhost:10003\/author\/pepethefrog\/\"\n\t        }\n\t    ]\n\t}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Deploying a machine learning model to Azure Machine Learning Service - Pantherax Blogs","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/","og_locale":"en_US","og_type":"article","og_title":"Deploying a machine learning model to Azure Machine Learning Service","og_description":"Introduction In today’s data-intensive world, machine learning models can be employed to create value for businesses and individuals alike. With the advent of cloud computing and services such as Azure Machine Learning Service, building and deploying machine learning models has become easier than ever. In this tutorial, we will walk Continue Reading","og_url":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/","og_site_name":"Pantherax Blogs","article_published_time":"2023-11-04T23:13:58+00:00","article_modified_time":"2023-11-05T05:48:25+00:00","author":"Panther","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Panther","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/#article","isPartOf":{"@id":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/"},"author":{"name":"Panther","@id":"http:\/\/localhost:10003\/#\/schema\/person\/b63d816f4964b163e53cbbcffaa0f3d7"},"headline":"Deploying a machine learning model to Azure Machine Learning Service","datePublished":"2023-11-04T23:13:58+00:00","dateModified":"2023-11-05T05:48:25+00:00","mainEntityOfPage":{"@id":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/"},"wordCount":643,"publisher":{"@id":"http:\/\/localhost:10003\/#organization"},"keywords":["\"AI deployment\"]","\"Azure Machine Learning Service\"","\"cloud machine learning\"","\"machine learning deployment\"","\"Microsoft Azure\"","[\"Deploying a machine learning model\""],"inLanguage":"en-US"},{"@type":"WebPage","@id":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/","url":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/","name":"Deploying a machine learning model to Azure Machine Learning Service - Pantherax Blogs","isPartOf":{"@id":"http:\/\/localhost:10003\/#website"},"datePublished":"2023-11-04T23:13:58+00:00","dateModified":"2023-11-05T05:48:25+00:00","breadcrumb":{"@id":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/"]}]},{"@type":"BreadcrumbList","@id":"http:\/\/localhost:10003\/deploying-a-machine-learning-model-to-azure-machine-learning-service\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http:\/\/localhost:10003\/"},{"@type":"ListItem","position":2,"name":"Deploying a machine learning model to Azure Machine Learning Service"}]},{"@type":"WebSite","@id":"http:\/\/localhost:10003\/#website","url":"http:\/\/localhost:10003\/","name":"Pantherax Blogs","description":"","publisher":{"@id":"http:\/\/localhost:10003\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/localhost:10003\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"http:\/\/localhost:10003\/#organization","name":"Pantherax Blogs","url":"http:\/\/localhost:10003\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/localhost:10003\/#\/schema\/logo\/image\/","url":"http:\/\/localhost:10003\/wp-content\/uploads\/2023\/11\/cropped-9e7721cb-2d62-4f72-ab7f-7d1d8db89226.jpeg","contentUrl":"http:\/\/localhost:10003\/wp-content\/uploads\/2023\/11\/cropped-9e7721cb-2d62-4f72-ab7f-7d1d8db89226.jpeg","width":1024,"height":1024,"caption":"Pantherax Blogs"},"image":{"@id":"http:\/\/localhost:10003\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"http:\/\/localhost:10003\/#\/schema\/person\/b63d816f4964b163e53cbbcffaa0f3d7","name":"Panther","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/localhost:10003\/#\/schema\/person\/image\/","url":"http:\/\/2.gravatar.com\/avatar\/b8c0eda5a49f8f31ec32d0a0f9d6f838?s=96&d=mm&r=g","contentUrl":"http:\/\/2.gravatar.com\/avatar\/b8c0eda5a49f8f31ec32d0a0f9d6f838?s=96&d=mm&r=g","caption":"Panther"},"sameAs":["http:\/\/localhost:10003"],"url":"http:\/\/localhost:10003\/author\/pepethefrog\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/posts\/3982"}],"collection":[{"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/comments?post=3982"}],"version-history":[{"count":1,"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/posts\/3982\/revisions"}],"predecessor-version":[{"id":4558,"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/posts\/3982\/revisions\/4558"}],"wp:attachment":[{"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/media?parent=3982"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/categories?post=3982"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/localhost:10003\/wp-json\/wp\/v2\/tags?post=3982"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}