Azure Worker Role Changes in SDK 2.4

It’s been quite a while since we’ve seen any significant (ok, really any) changes in the boilerplate template code Visual Studio generates for Azure Cloud Services (web or worker roles). For as long as I can remember, the code has looked like this:

public override void Run()
{
    // This is a sample worker implementation. Replace with your logic.
    Trace.TraceInformation("WorkerRole.23 entry point called");

    while (true)
    {
       Thread.Sleep(10000);
       Trace.TraceInformation("Working");
    }
}

Pretty basic, right?  Just do some work forever.  If there is a failure (i.e. an unhandled exception), it’ll bubble up and out of the Run method, effectively crashing the role and Azure will restart it. The problem with this is that it didn’t effectively handle the case when the role stops – when OnStop is called. If your code was doing something at the that time, too bad, so sad.  You’re done. Microsoft released some guidance way back in January 2013 on The Right Way to Handle Azure OnStop Events. Unless you knew of this blog post, or were really good at your Bing-fu, it was too easy to just use the Visual Studio generated code. And then something happens, your code doesn’t do what you think it should (even though it does exactly what it is told to do), and bad words are uttered silently, and feelings get hurt.

Staring with Azure SDK 2.4, there is new boilerplate code generated by Visual Studio.  Check this out:

public class WorkerRole : RoleEntryPoint
{
    private readonly CancellationTokenSource cancellationTokenSource = new CancellationTokenSource();
    private readonly ManualResetEvent runCompleteEvent = new ManualResetEvent(false);

    public override void Run()
    {
        Trace.TraceInformation("WorkerRole.24 is running");

        try
        {
            this.RunAsync(this.cancellationTokenSource.Token).Wait();
        }
        finally
        {
            this.runCompleteEvent.Set();
        }
    }

    public override void OnStop()
    {
        Trace.TraceInformation("WorkerRole.24 is stopping");

        this.cancellationTokenSource.Cancel();
        this.runCompleteEvent.WaitOne();

        base.OnStop();

        Trace.TraceInformation("WorkerRole.24 has stopped");
    }

    private async Task RunAsync(CancellationToken cancellationToken)
    {
       // TODO: Replace the following with your own logic.
       while (!cancellationToken.IsCancellationRequested)
       {
           Trace.TraceInformation("Working");
           await Task.Delay(7000);
       }
    }
}

At first blush, this looks more complicated. But it really isn’t that bad. In a way, it’s doing what that Microsoft blog post from 2013 was indicating, just using cancellation tokens.

The OnStop method is actually overridden in the template now. There, the cancellation token is triggered to indicate the running thread should be cancelled, and then wait for that to happen. In the RunAsync method, we’re just waiting for that cancellation request, otherwise continue doing some business. Easy.

Keep in mind that there is still the 5 minute limit to finish, or else Azure will terminate the process.

Tagged with:
Posted in Microsoft Azure, Windows Azure

Azure MVP Award

It is no secret that I do a lot of work with Microsoft Azure, both professionally and personally. I’ve been involved in the platform in some manner since I first saw it at PDC08. I truly enjoy sharing my experiences with Azure with the community. I love the interaction with people. I love learning how others use Azure as well.

I’ve been honored the past 4 years to be recognized by Microsoft as an MVP for my work in the Microsoft Azure community. October 1st is my renewal date (based on when I was first awarded). Each October 1st I get a little nervous to see if I’ll be renewed.

Early today I received the email that I had been waiting for:

mvp 2014 email

I am again very honored and grateful to receive this award from Microsoft. Over the past several years, I’ve been fortunate to get to know many of the other Azure MVPs from all over the world – many of which I consider personal friends. It truly is a top-notch group!

Thank you!

Tagged with: ,
Posted in MVP

CloudDevelop 2014 – Loaded with Cloud Experts

It’s hard to believe that as I write this, CloudDevelop is only 16 days away! Myself and the other organizers have been working on the 2014 edition of CloudDevelop for the last year – pretty much right after CloudDevelop 2013 ended last August.

WP_20130830_022

Coming out of last year we set a goal to improve the attendee and sponsor experience for CloudDevelop. I’m really proud of and excited about some of the changes made for CloudDevelop this year. I think attendees this year will find a more diverse set of talks, with a wide range of topics related to various cloud platforms, technologies, and development and architecture patterns. Additionally, CloudDevelop has a new home in 2014 – the Gateway Film Center.  The Gateway Film Center should provide a fun new experience for attendees and sponsors alike.

I’m personally very excited to have David Aiken provide the opening keynote address for CloudDevelop.  I’ve known David for several years, starting back when he was working with Microsoft customers in the early days of Windows Azure. David has since held roles at Aditi leading a cloud architecture team, and now switching clouds entirely and working with the HP Helion platform.  David’s deep technical background and experience will undoubtedly provide for an insightful opening to CloudDevelop.

If you would like to learn more about CloudDevelop, including viewing a list of the speakers and their sessions, please visit http://www.CloudDevelop.org.

Tickets are just $20 and you can get yours now at http://cd2014tix.eventbrite.com/.

Posted in CloudDevelop

DevLink 2014 Presentations

Last week I had the privilege to speak at DevLink in Chattanooga, TN.  I had a great time!  It was fun to present.  I was also was able to attend some great sessions.  DevLink is always a top notch event to attend.

I had a full load of presentations – four in three days!  Overall I think the sessions came together very well.  If you attended any of my sessions, I would greatly appreciate any feedback. You can find a copy of all my presentations below and on SlideShare.net

  1. Programming Azure Active Directory
  2. Inside Azure Diagnostics
  3. Automating Your Azure Environment
  4. More Cache for Less Cash
Tagged with: , , , , , ,
Posted in PowerShell, Speaking, Windows Azure

Azure Website & Managed Cache Service

If you’re working with an Azure Website and trying to use the Azure Managed Cache Service, you really need to be on either the Basic or Standard tier for the Azure Website.  Apparently the Azure Managed Cache Service is not supported when on the Azure Websites Free or Shared tiers.

If using the Free or Shared tier of Azure Websites, and trying to access the Azure Managed Cache Service, you’ll get an error similar to this one:

Failure in About. Microsoft.ApplicationServer.Caching.DataCacheException: ErrorCode<ERRCA0017>:SubStatus<ES0016>:There is a temporary failure. Please retry later. (CRL Server for SSL Certificate is offline) —> Microsoft.ApplicationServer.Caching.ChannelAuthenticationException: CRL Server is offline —> System.Security.Authentication.AuthenticationException: The remote certificate is invalid according to the validation procedure.

No amount of retry logic will fix this error.  Gnarly, huh?

The fix is easy enough though. Scale your Azure Website to either the Basic or Standard tier.  You can make the Azure Website change easily via the Azure management portal.

Tagged with: , ,
Posted in Windows Azure

Creating a Custom SQL Server VM Image in Azure

Recently I had the opportunity to work on a project were I needed to create a custom SQL Server image for use with Azure VMs.  The process was a little more challenging than I initially anticipated.  I think this is mostly because I was not familiar with the process of preparing a SQL Server image.  Perhaps this isn’t much of a challenge for an experienced SQL Server DBA or IT Pro.  For me, it was a great learning experience.

Why a Custom SQL Server Image?

The Azure VM image gallery already contains a SQL Server image.  It’s very easy to create a new SQL Server VM using this image.  However, doing so has a few important trade-offs to consider:

  • Unable to fully customize the base install of SQL Server.  This is a template/image after all – you get a VM configured the way the image was configured.
  • Unable to use your own SQL Server license.  If your company has an Enterprise Agreement (EA) with Microsoft, it’s likely there is already some SQL Server licenses built into that agreement.  Depending on the details, it may be significantly cheaper to use the licenses from the EA instead of paying the SQL Server VM image upcharge from Azure.

The Basic Steps

There are 6 basic steps to creating a custom SQL Server VM image for use in Azure.

  1. Provision a new base Windows Server VM
  2. Download the SQL Server installation media
  3. Run SQL Server setup to prepare an image
  4. Configure Windows to complete the installation of SQL Server
  5. Capture the image and add it to the Azure VM image gallery
  6. Create a new VM instance using the custom SQL Server image

The basic idea here is to create a base VM, customize it with a SQL Server image, capture the VM to create an image, and then provision new VMs using that captured VM image.

Create_SQL_VM_Image_Azure 2

Let’s dive into each of these in a little more detail.

Note: the terminology here can be a little confusing. When referring to the VM used to create the template/image, I’ll use the term “base VM”. When referring to the VM created from the base VM, I’ll use the term “VM instance”.

1. Provision a new base Windows Server VM

There are multiple ways to create a Windows Server VM in Azure.  Creating a VM via the Azure management portal and PowerShell are probably the two most popular options.  Be sure to check out this tutorial to learn how to do so via the portal. For the purposes of this post, I’ll do so via PowerShell.

$img = Get-AzureVMImage `
	| where { ( $_.PublisherName -ilike "Microsoft*" -and $_.ImageFamily -ilike "Windows Server 2012 Datacenter" ) } `
	| Sort-Object -Unique -Descending -Property ImageFamily `
	| sort -Descending -Property PublishDate `
	| select -First(1)

$vmConfig = New-AzureVMConfig -Name "sql-1" -InstanceSize Small -ImageName $img.ImageName |
    Add-AzureProvisioningConfig -Windows -AdminUsername "[admin-username-here]" -Password "[admin-password-here]" 

New-AzureVM -ServiceName "SQLServerVMTemplate" -VMs $vmConfig -Location "East US" -WaitForBoot

 2. Download the SQL Server installation media

With the base Windows Server 2012 VM created, we can now get ready to prepare (sysprep) the SQL Server installation.  To do that, we need to get the SQL Server installation media onto the machine.  The easiest way I found to do this was to leverage Azure blob storage.

  1. Upload the SQL Server ISO file to Azure blob storage
  2. Remote Desktop (RDP) into the base VM
  3. From the VM, download the SQL Server ISO file to the local disk
  4. Mount the SQL Server ISO file to the VM
  5. Copy the ISO contents (not the ISO file itself) to the VM’s C:\ drive.  For example, use C:\sql

The SQL Server installation media files need to be copied to the local C: drive so it can be used later to complete the SQL Server installation (when provisioning the actual SQL Server VM instance).

3. Run SQL Server setup to prepare an image

In order to prepare the (sysprep’d) SQL Server VM image (which we can use as a template for future VMs), we need to run the SQL Server installation and instruct it to prepare an image – not run the full installation.  An easy way to do this is with a SQL Server configuration file, an example of which I’ve included below.

ConfigurationFile.ini

;SQL Server 2012 Configuration File
[OPTIONS]
; Specifies a Setup workflow, like INSTALL, UNINSTALL, or UPGRADE. This is a required parameter.
ACTION="PrepareImage"
; Detailed help for command line argument ENU has not been defined yet.
ENU="True"
; Parameter that controls the user interface behavior. Valid values are Normal for the full UI, AutoAdvance for a simplified UI, and EnableUIOnServerCore for bypassing Server Core setup GUI block.
;UIMODE="Normal"
; Specifies setup not display any user interface.
;QUIET="False"
; Specifies setup to display progress only, without any user interaction.
QUIETSIMPLE="True"
; Specifies whether SQL Server Setup should discover and include product updates. The valid values are True and False or 1 and 0. By default SQL Server Setup will include updates that are found.
UpdateEnabled="True"
; Specifies features to install, uninstall, or upgrade. The list of top-level features include SQL, AS, RS, IS, MDS, and Tools. The SQL feature will install the Database Engine, Replication, Full-Text, and Data Quality Services (DQS) server. The Tools feature will install Management Tools, Books online components, SQL Server Data Tools, and other shared components.
FEATURES=SQLENGINE
; Specifies the location where SQL Server Setup will obtain product updates. The valid values are "MU" to search Microsoft Update, a valid folder path, a relative path such as .\MyUpdates or a UNC share. By default SQL Server Setup will search Microsoft Update or a Windows Update service through the Window Server Update Services.
UpdateSource="MU"
; Displays the command line parameters usage
HELP="False"
; Specifies that the detailed Setup log should be piped to the console.
INDICATEPROGRESS="False"
; Specifies that Setup should install into WOW64. This command line argument is not supported on an IA64 or a 32-bit system.
X86="False"
; Specifies the root installation directory for shared components.  This directory remains unchanged after shared components are already installed.
INSTALLSHAREDDIR="C:\Program Files\Microsoft SQL Server"
; Specifies the root installation directory for the WOW64 shared components.  This directory remains unchanged after WOW64 shared components are already installed.
INSTALLSHAREDWOWDIR="C:\Program Files (x86)\Microsoft SQL Server"
; Specifies the Instance ID for the SQL Server features you have specified. SQL Server directory structure, registry structure, and service names will incorporate the instance ID of the SQL Server instance.
INSTANCEID="MSSQLSERVER"
; Specifies the installation directory.
INSTANCEDIR="C:\Program Files\Microsoft SQL Server"

There are two steps in this process:

  1. Copy the ConfigurationFile.ini file (from your local PC) to the same location as the SQL Server installation media (i.e. c:\sql) on the base VM.
  2. Run SQL Server setup to prepare an image.  From a command prompt (on the base VM), navigate to the C:\sql folder and then execute the following command:
Setup.exe /ConfigurationFile=ConfigurationFile.ini /IAcceptSQLServerLicenseTerms=true

 4. Configure Windows to complete the installation of SQL Server

At this point the base VM should have an “installation” of SQL Server that is not fully completed. The SQL Server bits are in place, but they’re not configured for a full server install . . . at least not yet. The final configuration of SQL Server will take place when the VM instance (of which this template/image is the base) is provisioned and boots up for the first time. This is accomplished by using a CMD file with the following content:

@ECHO OFF && SETLOCAL && SETLOCAL ENABLEDELAYEDEXPANSION && SETLOCAL ENABLEEXTENSIONS
REM All commands will be executed during first Virtual Machine boot
"C:\Program Files\Microsoft SQL Server\110\Setup Bootstrap\SQLServer2012\setup.exe" /QS /ACTION=CompleteImage /INSTANCEID=MSSQLSERVER /INSTANCENAME=MSSQLSERVER /IACCEPTSQLSERVERLICENSETERMS=1 /SQLSYSADMINACCOUNTS=%COMPUTERNAME%\Administrators /BROWSERSVCSTARTUPTYPE=AUTOMATIC /INDICATEPROGRESS /TCPENABLED=1 /PID="[YOUR-SQL-SERVER-PRODUCT-ID-HERE]"
  1. On your local PC, save the file as SetupComplete2.cmd
  2. RDP / log into the base VM
  3. Copy the SetupComplete2.cmd from your local PC file to the c:\Windows\OEM folder on the base VM
  4. Change the value for the SQLSYSADMINACCOUNTS value to be that of the administrative account created on the VM (or better yet – the local Administrators group account)
  5. If needed, supply the SQL Server product ID (PID) value.

When Windows starts on the new VM instance for the first time, the SetupComplete2.cmd file should automatically run.  It is invoked by the SetupComplete.cmd file already on the machine.

vm-image-setupcomplete

5. Capture the image and add it to the Azure VM image gallery

At this point a base SQL Server VM has been created and the groundwork laid to complete the install. Now it is time to create the VM image from the base VM, and do to that you sysprep and capture the base VM.  Please follow the guide on How to Capture a Windows Virtual Machine to Use as a Template.

6. Create a new VM using the custom SQL Server image

With a new custom VM image template available in the VM image gallery, you can provision a new VM instance using that custom template.  Upon first boot, the newly provisioned VM should complete the full SQL Server installation as laid out in your SetupComplete2.cmd file.  Please follow the guide on How to Create a Custom Virtual Machine for more information on creating the VM from the template.

 

Closing Thoughts

One of the quirks I noticed when preparing the base SQL Server image is that it was not possible to prepare the image with SQL Server Management Studio (SSMS).  I would have to do the install after the newly provisioned VM instance is created. Not hard, but time consuming (an annoying if doing this on multiple VM instances).  I later learned that SQL Server 2012 Cumulative Update 1 does allow for preparing a SQL Server image with SSMS installed.  I’ve included a link below that describes the process for creating a SQL Server image with CU1.

In the end, this process really is not all that hard.  Time consuming?  Yes!  The worst part (at least for me) was really just understanding how the SQL Server installation and sysprep process works.  Once I wrapped my head around that, the process was a lot smoother.

 

Helpful Resources

While I was learning how to create a custom SQL Server VM image, the following resources were very helpful:

 

I would like to thank Scott Klein for his assistance in verifying these steps.  His help was extremely valuable to ensure I was doing this the right way.

Tagged with: , ,
Posted in Windows Azure

CloudDevelop Call for Speakers

I’m one of the founders/organizers for a cloud computing conference called CloudDevelop. This year (on October 17th) will mark the third year for CloudDevelop. The goal for CloudDevelop is to bring together the best cloud computing minds in the Midwest to share experiences and learn from each other.

CloudDevelop is not about Amazon AWS, Microsoft Azure, Google Cloud, Heroku, Salesforce, AppHarbor, VMWare or any other cloud platform/provider.  It is about all of them!  CloudDevelop is about bringing together experts from all the cloud platforms.  Innovation in the cloud happens at a rapid pace.  There’s so much to share and learn from each other!

If sharing your experiences with others is something that excites you, then I would encourage you to submit a session (or a few) to be a speaker at CloudDevelop.  We’re looking for topics in the following areas:

  • Architecture
  • Business
  • DevOps
  • General Development
  • Infrastructure
  • Legal
  • Strategy
  • Testing
  • Have another idea . . . that’s cool too

The call for speakers closes on Friday, June 27th.  To submit, go to www.CloudDevelop.org and click on the “Submit Your Talks” button (or go to the submission form directly).

Oh, and be sure to follow CloudDevelop on Twitter, Facebook, or subscribe to the CloudDevelop newsletter to keep current on the latest CloudDevelop news.

Tagged with:
Posted in Speaking
Follow Michael S. Collier's Blog on WordPress.com
Follow

Get every new post delivered to your Inbox.

Join 1,950 other followers