c# - How do you unit test an ASP.NET Core controller or model object?

Question

I am trying to get some controller, model, and repository (data access) C# classes under unit test, in Visual Studio 2015, with ASP.NET Core MVC (ASP.NET 5 during the preview, now called ASP.NET Core) applications.

I have the following structure:

   Solution
       |
      src
       |
       |-- ITConsole       <- main app (ASP.NET MVC, DNX 4.5.1)
       |
       `-- ITConsoleTests  <- What kind of project should this be?

The MainApp is using DNX 4.5.1, but it seems that if I create a standard NUnit Unit test application, it's only available as a classic .NET Framework class library, targetting .NET Framework 4.5.2, not as a Web Class Library that can work with my main application.

So, just in case it might work as a classic .NET framework Microsoft Unit Test framework project (.NET assembly), I tried to manually find and add references (by add reference, and browse) to get the .NET dependencies to resolve. I am aware that .NET assembly references are sadly non-transitive. So if UnitTest.dll has a reference to MainApp.dll, and MainApp.dll depends on ASP.NET MVC, and everything else that it depends on, I have to do that myself. That is what I'm trying to do.

I added a reference to C:devDemoITConsoleartifactsinITConsoleDebugdnx451ITConsole.dll into my unit test project so I could begin to get the code to compile. The unit test classes compile, but they don't run, probably because of the mess of trying to add a reference to ASP.NET.

Right now, even though I have added a reference to Common.Logging.Core, and Common.Logging, when I click "Run All" on the Test explorer I get this error:

Test Name:    TestStudyLogReadDocument
Test FullName:    ITConsoleTests.ITConsoleTestStudyLog.TestStudyLogReadDocument
Test Source:    C:devDemoITConsoleITConsoleTestsITConsoleTestStudyLog.cs : line 52
Test Outcome:    Failed
Test Duration:    0:00:00.0712058

Result StackTrace:
at Couchbase.Configuration.Client.ClientConfiguration..ctor()
   at ITConsole.Repository.StudyLogRepository..ctor() in C:devDemoITConsolesrcITConsoleRepositoryStudyLogRepository.cs:line 39
   at ITConsoleTests.ITConsoleTestStudyLog.SetupDb() in C:devDemoITConsoleITConsoleTestsITConsoleTestStudyLog.cs:line 30
   at ITConsoleTests.ITConsoleTestStudyLog.TestStudyLogReadDocument() in C:devDemoITConsoleITConsoleTestsITConsoleTestStudyLog.cs:line 53
Result Message:
Test method ITConsoleTests.ITConsoleTestStudyLog.TestStudyLogReadDocument threw exception:
System.IO.FileLoadException: Could not load file or assembly 'Common.Logging.Core, Version=3.1.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)

(At the time this question was asked...) None of the ASP.NET 5 MVC preview templates can generate unit tests for you. Can you even unit test a shiny new ASP.NET Core application? See screenshot below, for example of how the normal way you get started unit testing is not available in Visual Studio 2015 using MSTEST.

Answer 1

Update: xUnit is still a great idea, but this answer is outdated now because you can also use the "standard" MSTEST if you want with ASP.NET core. (June 1, 2016) I find I still prefer xUnit, but it's your call.

Most recent xUnit instructions link: Excellent instructions that may be updated more often than this answer are found at the xUnit wiki.

IDE workaround: manually find and delete %TEMP%VisualStudioTestExplorerExtensions when Visual Studio goes stupid and won't "detect" and show you your tests.

As of May 2016, with ASP.NET Core 1.0 RC1 recently superseded by RC2, it still does not appear possible to use the standard Microsoft Unit Test framework with ASP.NET Core (formerly ASP.NET 5), and xUnit appears to be a good choice for RC1 and RC2.

You can get XUnit.net unit testing to work with ASP.NET Core 1.0.0-RC1, using the official instructions]2 at the xUnit GitHub project which has a specific ".NET Core getting started" case.

You can also install the xUnit new project template that provides a templated unit test project for regular full .NET and .NET Core. Click menu Tools and then Extensions and Updates type in xUnit, and find the xUnit Test Project template and install the template. Do not install any xUnit test runner; you do not need it..

I have created a working sample and uploaded it to Bitbucket:

https://bitbucket.org/wpostma/aspnet5mvc6xunitdemo

If you don't have Mercurial, you can download a ZIP file from Bitbucket.

The demo includes one test that passes, and one test that fails.

The Quick Summary:

1. You have Visual Studio 2015 including Update 2 and the "1.0.0 preview" tools (latest as of May 2016).

2. Create a Web Class Library, not a Unit Test Project.

3. Add xUnit references to it, and fix your project.json (an example is below).

4. Write your class (example below).

5. Run tests with Test Explorer inside the IDE, or outside IDE, type in dnx . tests, and examine the output (example below).

File project.json for 1.0.0-rc2 with reference to a demo assembly and xUnit:

 {
  "version": "1.0.0-*",

  "testRunner": "xunit",

  "dependencies": {
    "Microsoft.NETCore.App": {
      "version": "1.0.0-rc2-3002702",
      "type": "platform"
    },

    "dotnet-test-xunit": "1.0.0-rc2-*",

    "xunit": "2.1.0",


    "YetAnotherWebbyDemo": "1.0.0-*"
  },

  "frameworks": {
    "netcoreapp1.0": {
      "imports": [
        "dotnet5.6",
        "dnxcore50",
        "portable-net45+win8"
      ]
    }
  }
}

Unit test class (whatever.cs):

using System;
using System.Collections.Generic;
using System.Linq;
using System.Threading.Tasks;

using Xunit;

using YetAnotherWebbyDemo.Models;

namespace YetAnotherWebbyDemoTests
{
    // This project can output the Class library as a NuGet Package.
    // To enable this option, right-click on the project and select the Properties menu item. In the Build tab select "Produce outputs on build".
    public class TestBasics
    {
        [Fact]
        public void TestAdd()
        {

            TestableModelClass TestMe = new TestableModelClass();


            Assert.True(TestMe.Add(3, 2) == 5, "Basic Math Failure");

            Assert.True(TestMe.Add(-3, -2) == -5, "Basic Math Failure");
        }

    }
}

Example output from commandline in RC1 when we used dnx:

C:devDemoYetAnotherWebbyDemosrcYetAnotherWebbyDemoTests>dnx . test

xUnit.net DNX Runner (32-bit DNX 4.5.1)
  Discovering: YetAnotherWebbyDemoTests
  Discovered:  YetAnotherWebbyDemoTests
  Starting:    YetAnotherWebbyDemoTests
    YetAnotherWebbyDemoTests.TestBasics.TestAdd [FAIL]
      Basic Math Failure
      Expected: True
      Actual:   False
      Stack Trace:
        YetAnotherWebbyDemoTestBasics.cs(25,0): at YetAnotherWebbyDemoTests.Test
Basics.TestAdd()
  Finished:    YetAnotherWebbyDemoTests
=== TEST EXECUTION SUMMARY ===
   YetAnotherWebbyDemoTests  Total: 1, Errors: 0, Failed: 1, Skipped: 0, Time: 0.263s

Example output in RC2 where we're using dotnet:

D:devaspnet5mvc6xunitdemosrcYetAnotherWebbyDemoTests>dotnet test
Project YetAnotherWebbyDemo (.NETCoreApp,Version=v1.0) was previously compiled. Skipping compilation.
Project YetAnotherWebbyDemoTests (.NETCoreApp,Version=v1.0) was previously compiled. Skipping compilation.
xUnit.net .NET CLI test runner (64-bit win10-x64)
  Discovering: YetAnotherWebbyDemoTests
  Discovered:  YetAnotherWebbyDemoTests
  Starting:    YetAnotherWebbyDemoTests
    YetAnotherWebbyDemoTests.TestBasics.TestAdd [FAIL]
      Basic Math Failure
      Expected: True
      Actual:   False
      Stack Trace:
        D:devaspnet5mvc6xunitdemosrcYetAnotherWebbyDemoTestsYetAnotherWebbyDemoTestBasics.cs(26,0): at YetAnotherWebbyDemoTests.TestBasics.TestAdd()
  Finished:    YetAnotherWebbyDemoTests
=== TEST EXECUTION SUMMARY ===
   YetAnotherWebbyDemoTests  Total: 1, Errors: 0, Failed: 1, Skipped: 0, Time: 0.205s
SUMMARY: Total: 1 targets, Passed: 0, Failed: 1.