Testing - Colin's ALM Corner

Executing JMeter Tests in an Azure Pipeline

Microsoft have deprecated Load Testing in Visual Studio. Along with this, they have also deprecated the cloud load testing capability in Azure/Azure DevOps. On the official alternatives document, several alternative load testing tools and platforms are mentioned, including JMeter. What is not clear

Testing

Serverless Parallel Selenium Grid Testing with VSTS and Azure Container Instances

I've written before about Selenium testing (Parallel Testing in a Selenium Grid with VSTS and Running Selenium Tests in Docker using VSTS and Release Management). The problem with these solutions, however, is that you need a VM! However, I was setting up a demo

Testing

Using VSTS to Test Python Code (with Code Coverage)

I recently worked with a customer that had some containers running Python code. The code was written by data scientists and recently a dev had been hired to help the team get some real process in place. As I was helping them with their

Docker

A/B Testing with Azure Linux Web Apps for Containers

I love containers. I've said before that I think they're the future. Just as hardly anyone installs on tin any more since we're so comfortable with Virtualization, I think that in a few years time hardly anyone will deploy VMs - we'll all be

Testing

Parallel Testing in a Selenium Grid with VSTS

There are several different types of test – unit tests, functional test, load tests and so on. Generally, unit tests are the easiest to implement and have a high return on investment. Conversely, UI automation tests tend to be incredibly fragile, hard to maintain and

Development

Aurelia, Karma and More VS Debugging Goodness

In my previous post I walked through how to change Aurelia to load modules via Require.js so that you can set breakpoints and debug from VS when you run your Aurelia project. In this post I want to share some tips about unit

Testing

Test Result Traceability Matrix Tool

I am often asked if there is a way to see a “traceability matrix” in TFS. Different people define a “traceability matrix” in different ways. If you want to see how many tests there are for a set of requirements, then you can use

Testing

CrossBrowser Testing: ChromeDriver Window Hangs after Test

I have been doing some coded UI testing and running tests using Chrome (via the Selenium components). However, I noticed that when my test completed successfully, the Selenium (ChromeDriver) window stayed open and never terminated. Here’s a code snippet of my original code:

Build

Why You Absolutely Need to Unit Test

I’ve written about why builds are absolutely essential in modern application development (Part 1) and what why Team Build is a great build engine (Part 2). However, if you don’t include unit tests in your builds, it’s like brushing your teeth

Testing

Testing Windows 8 Applications

Windows Store applications are slowly becoming more popular. If you’re going to do any Windows Store development, you’ll need to shift a few paradigms in how you code – and how you test. There are hundreds of webcasts and blogs detailing Windows Store

Testing

Test Case Manager: Customize Failure and Resolution Type

In Test Case Manager, you can open a test run that has failed and set the Failure and Resolution types for the failure. I’ve had a lot of customers ask me if it’s possible to customize the lists. Up until now, the

Build

Hybrid Lab Workflow: Standard Lab Environment with Snapshots

Arguably one of the best features of TFS is Lab Management. I loved Lab Management in TFS 2010, even though it was a real pain to set up. There were a lot of moving parts and setup was tricky, but once you got SCVMM

Testing

Microsoft Fakes – Customizing the System Whitelist (or, enabling Fakes for classes you’ve always wanted to fake, like WebClient)

So you’re sitting down planning some tests for your shiny new code, only to find that your code uses WebClient to download a file. No problem – you’ve been reading about Microsoft’s new Fakes framework, so you just right-click the System reference

Testing

More on Fakes – the beta has issues

Thanks to Peter Provost for helping answer a couple of questions I had about Fakes – you can look at some of my code in my previous posts about using Fakes with the TFS API. There were two scenarios that I hit snags with. The

TFS API

Using the Fakes Framework to Test TFS API Code (Part 2 of 2)

In Part 1, we started faking some TFS objects. We got as far as faking the TeamProjectCollection and WorkItemStore. In this post, we’ll complete the test for copying work items by providing a fake QueryHierarchy and a fake list of WorkItems. Binding IEnumerablesSince

TFS API

Using the Fakes Framework to Test TFS API Code (Part 1 of 2)

(Here’s the link to Part 2) If you’ve ever written a utility to do TFS “stuff” using the TFS API, you probably tested by hitting F5 and stepping through a bit before letting any large loops do their thing. So what happened

Testing

WpfCell – The Key to Coded UI Automation of DataGrids

As a follow on from my post yesterday about some of the intricacies of using Coded UI testing on WPF applications, I wanted to give some details about using the WpfCell class to automate validation and updates into DataGrids. The Problem: When you bind

Testing

GenericAutomationPeer – Helping the Coded UI Framework Find Your Custom Controls

Sometimes you’ll write an WPF application that has some sort of “dynamic” way of loading portions of the UI (think: Prism). Sometimes entire frameworks are too much, so you’d prefer something a bit simpler – like, say, a TabControl with a data template.