Visual Studio For Mac Unit Test

Test

  1. Visual Studio For Mac Tutorial
  2. Visual Studio For Mac Community
  3. Visual Studio C++ For Mac
  4. Visual Studio For Mac Unit Test Answers
-->

With the power of Roslyn, Visual Studio for Mac brings IntelliSense to your fingertips. IntelliSense describes APIs as you type and uses auto-completion to increase the speed and accuracy of how you write code. Quick Info tool tips let you inspect API definitions. Squiggly lines in the editor highlight issues in real time as you type. My GearCamera -http://amzn.t. Jul 14, 2020 Visual Studio includes the Microsoft unit testing frameworks for both managed and native code. However, Test Explorer can also run any unit test framework that has implemented a Test Explorer adapter. For more information about installing third-party unit test frameworks, see Install third-party unit test frameworks Run tests in Test Explorer.

Use Test Explorer to run unit tests from Visual Studio or third-party unit test projects. You can also use Test Explorer to group tests into categories, filter the test list, and create, save, and run playlists of tests. You can also analyze code coverage and debug unit tests.

Test Explorer can run tests from multiple test projects in a solution and from test classes that are part of the production code projects. Test projects can use different unit test frameworks. When the code under test is written for .NET, the test project can be written in any language that also targets .NET, regardless of the language of the target code. Native C/C++ code projects must be tested by using a C++ unit test framework.

Build your test project

If you do not already have a test project set up in your Visual Studio solution, you must first create and build a test project.

Visual Studio includes the Microsoft unit testing frameworks for both managed and native code. However, Test Explorer can also run any unit test framework that has implemented a Test Explorer adapter. For more information about installing third-party unit test frameworks, see Install third-party unit test frameworks

Run tests in Test Explorer

When you build the test project, the tests appear in Test Explorer. If Test Explorer is not visible, choose Test on the Visual Studio menu, choose Windows, and then choose Test Explorer (or press Ctrl + E, T).

As you run, write, and rerun your tests, Test Explorer displays the results in default groups of Failed Tests, Passed Tests, Skipped Tests and Not Run Tests. You can change the way Test Explorer groups your tests.

As you run, write, and rerun your tests, the Test Explorer displays the results in a default grouping of Project, Namespace, and Class. You can change the way the Test Explorer groups your tests.

You can perform much of the work of finding, organizing and running tests from the Test Explorer toolbar.

Run tests

Visual Studio For Mac Tutorial

You can run all the tests in the solution, all the tests in a group, or a set of tests that you select. Do one of the following:

  • To run all the tests in a solution, choose Run All (or press Ctrl + R, V).

  • To run all the tests in a default group, choose Run and then choose the group on the menu.

  • Select the individual tests that you want to run, open the right-click menu for a selected test and then choose Run Selected Tests (or press Ctrl + R, T).

  • If individual tests have no dependencies that prevent them from being run in any order, turn on parallel test execution with the toggle button on the toolbar. This can noticeably reduce the time taken to run all the tests.

The pass/fail bar at the top of the Test Explorer window is animated as the tests run. At the conclusion of the test run, the pass/fail bar turns green if all tests passed or turns red if any test failed.

You can run all the tests in the solution, all the tests in a group, or a set of tests that you select. Do one of the following:

  • To run all the tests in a solution, choose the Run All icon (or press Ctrl + R, V).

  • To run all the tests in a default group, choose the Run icon and then choose the group on the menu.

  • Select the individual tests that you want to run, open the right-click menu for a selected test and then choose Run Selected Tests (or press Ctrl + R, T).

  • If individual tests have no dependencies that prevent them from being run in any order, turn on parallel test execution in the settings menu of the toolbar. This can noticeably reduce the time taken to run all the tests.

Run tests after every build

ButtonDescription
To run your unit tests after each local build, choose Test on the standard menu, and then choose Run Tests After Build on the Test Explorer toolbar.
Studio

Note

Running unit tests after each build requires Visual Studio 2017 Enterprise or Visual Studio 2019. In Visual Studio 2019 it is included in Community and Professional as well as Enterprise.

To run your unit tests after each local build, open the settings icon in the Test Explorer toolbar and select Run Tests After Build.

View test results

As you run, write, and rerun your tests, Test Explorer displays the results in groups of Failed Tests, Passed Tests, Skipped Tests and Not Run Tests. The details pane at the bottom or side of the Test Explorer displays a summary of the test run.

View test details

To view the details of an individual test, select the test.

The test details pane displays the following information:

  • The source file name and the line number of the test method.

  • The status of the test.

  • The elapsed time that the test method took to run.

If the test fails, the details pane also displays:

  • The message returned by the unit test framework for the test.

  • The stack trace at the time the test failed.

View the source code of a test method

Visual Studio For Mac Community

To display the source code for a test method in the Visual Studio editor, select the test and then choose Open Test on the right-click menu (or press F12).

Visual

Group and filter the test list

Test Explorer lets you group your tests into predefined categories. Most unit test frameworks that run in Test Explorer let you define your own categories and category/value pairs to group your tests. You can also filter the list of tests by matching strings against test properties.

Group tests in the test list

To change the way that tests are organized, choose the down arrow next to the Group By button and select a new grouping criteria.

Test Explorer lets you group your tests into a hierarchy. The default hierarchy grouping is Project, Namespace, and then Class. To change the way that tests are organized, choose the Group By button and select a new grouping criteria.

You can define your own levels of the hierarchy and group by State and then Class for example by selecting Group By options in your preferred order.

Test Explorer groups

GroupDescription
DurationGroups test by execution time: Fast, Medium, and Slow.
OutcomeGroups tests by execution results: Failed Tests, Skipped Tests, Passed Tests.
TraitsGroups test by category/value pairs that you define. The syntax to specify trait categories and values is defined by the unit test framework.
ProjectGroups test by the name of the projects.
GroupDescription
DurationGroups tests by execution time: Fast, Medium, and Slow.
StateGroups tests by execution results: Failed Tests, Skipped Tests, Passed Tests, Not Run
Target FrameworkGroups tests by the framework their projects target
NamespaceGroups tests by the containing namespace.
ProjectGroups tests by the containing project.
ClassGroups tests by the containing class.
Mac

Traits

A trait is usually a category name/value pair, but it can also be a single category. Traits can be assigned to methods that are identified as a test method by the unit test framework. A unit test framework can define trait categories. You can add values to the trait categories to define your own category name/value pairs. The syntax to specify trait categories and values is defined by the unit test framework.

Traits in the Microsoft Unit Testing Framework for Managed Code

In the Microsoft unit test framework for managed apps, you define a trait name/ value pair in a TestPropertyAttribute attribute. The test framework also contains these predefined traits:

TraitDescription
OwnerAttributeThe Owner category is defined by the unit test framework and requires you to provide a string value of the owner.
PriorityAttributeThe Priority category is defined by the unit test framework and requires you to provide an integer value of the priority.
TestCategoryAttributeThe TestCategory attribute enables you to specify the category of a unit test.
TestPropertyAttributeThe TestProperty attribute enables you to define trait category/value pair.

Traits in the Microsoft Unit Testing Framework for C++

Visual Studio C++ For Mac

See How to use the Microsoft Unit Testing Framework for C++.

Create custom playlists

You can create and save a list of tests that you want to run or view as a group. When you select a playlist, the tests in the list are displayed in Test Explorer. You can add a test to more than one playlist, and all tests in your project are available when you choose the default All Tests playlist.

To create a playlist, choose one or more tests in Test Explorer. On the right-click menu, choose Add to Playlist > NewPlaylist. Save the file with the name and location that you specify in the Create New Playlist dialog box.

To add tests to a playlist, choose one or more tests in Test Explorer. On the right-click menu, choose Add to Playlist, and then choose the playlist that you want to add the tests to.

To open a playlist, choose Test > Playlist from the Visual Studio menu, and either choose from the list of recently used playlists, or choose Open Playlist to specify the name and location of the playlist.

If individual tests have no dependencies that prevent them from being run in any order, turn on parallel test execution with the toggle button on the toolbar. This can noticeably reduce the time taken to run all the tests.

You can create and save a list of tests that you want to run or view as a group. When you select a playlist, the tests in the list are displayed in a new Test Explorer tab. You can add a test to more than one playlist.

To create a playlist, choose one or more tests in Test Explorer. On the right-click menu, choose Add to Playlist > New Playlist.

The playlist opens in a new Test Explorer tab. You can use this playlist once and then discard it, or you can click the Save button in the playlist window's toolbar, and then select a name and location to save the playlist.

To create a playlist, choose one or more tests in Test Explorer. Right-click and choose Add to Playlist > New playlist.

To open a playlist, choose the playlist icon in the Visual Studio toolbar and select a previously saved playlist file from the menu.

To edit a playlist, you can right-click on any test and use the menu options to add or remove it from a playlist.

Starting in Visual Studio 2019 version 16.7, you can choose the Edit button in the toolbar. Check boxes will appear next to your tests showing what tests are included and excluded in the playlist. Edit groups as desired.

You can also check or uncheck the boxes of the parent groups in the hierarchy. This action creates a dynamic playlist that always updates the playlist based on the tests that are in that group. For example, if you place a check mark next to a class, any test added from that class becomes part of this playlist. If you delete a test from that class, it is removed from the playlist. You can learn more about the rules by saving the playlist with the Save button in the toolbar and opening the .playlist file that is created on your disk. This file lists all the rules and individual tests that make up a playlist.

If you would like to make a playlist for traits, use the following format for MSTest.

Use the following format for xUnit. Make sure there is a space between your TestCategory name and the [Value].

Test Explorer columns

The groups are also available as columns in Test Explorer, along with Trait, Stack Trace, Error Message, and Fully Qualified Name. Most columns are not visible by default, and you can customize which columns you see and the order in which they appear.

Filter, sort, and rearrange test columns

Columns can be filtered, sorted, and rearranged.

  • To filter to specific traits, click the filter icon at the top of the Traits column.

  • To change the order of the columns, click on a column header and drag it left or right.

  • To sort a column, click on the column header. Not all columns can be sorted. You can also sort by a secondary column by holding the Shift key and clicking on an additional column header.

Search and filter the test list

You can also use Test Explorer search filters to limit the test methods in your projects that you view and run.

When you type a string in the Test Explorer search box and choose Enter, the test list is filtered to display only those tests whose fully qualified names contain the string.

To filter by a different criteria:

  1. Open the drop-down list to the right of the search box.

  2. Choose a new criteria.

  3. Enter the filter value between the quotation marks. If you want to search for an exact match on the string instead of a containing match use an equals sign (=) instead of the colon (:).

Note

Searches are case insensitive and match the specified string to any part of the criteria value.

QualifierDescription
TraitSearches both trait category and value for matches. The syntax to specify trait categories and values are defined by the unit test framework.
ProjectSearches the test project names for matches.
Error MessageSearches the user-defined error messages returned by failed asserts for matches.
File PathSearches the fully qualified file name of test source files for matches.
Fully Qualified NameSearches the fully qualified name of test namespaces, classes, and methods for matches.
OutputSearches the user-defined error messages that are written to standard output (stdout) or standard error (stderr). The syntax to specify output messages are defined by the unit test framework.
OutcomeSearches the Test Explorer category names for matches: Failed Tests, Skipped Tests, Passed Tests.
QualifierDescription
StateSearches the Test Explorer category names for matches: Failed Tests, Skipped Tests, Passed Tests.
TraitsSearches both trait category and value for matches. The syntax to specify trait categories and values are defined by the unit test framework.
Fully Qualified NameSearches the fully qualified name of test namespaces, classes, and methods for matches.
ProjectSearches the test project names for matches.
Target FrameworkSearches the Test Explorer category names for matches: Failed Tests, Skipped Tests, Passed Tests.
NamespaceSearches the test namespaces for matches.
ClassSearches the test classes names for matches.

To exclude a subset of the results of a filter, use the following syntax:

For example, FullName:'MyClass' - FullName:'PerfTest' returns all tests that include 'MyClass' in their name, except tests that also include 'PerfTest' in their name.

Analyze unit test code coverage

You can determine the amount of product code that is actually being tested by your unit tests by using the Visual Studio code coverage tool that's available in Visual Studio Enterprise edition. You can run code coverage on selected tests or on all tests in a solution.

To run code coverage for test methods in a solution:

  1. Choose Test on the top menu bar and then choose Analyze code coverage.

  2. Choose one of the following commands from the sub-menu:

    • Selected tests runs the test methods that you have selected in Test Explorer.

    • All tests runs all the test methods in the solution.

  • Right-click in Test Explorer and select Analyze Code Coverage for Selected tests

Visual Studio For Mac Unit Test Answers

The Code Coverage Results window displays the percentage of the blocks of product code that were exercised by line, function, class, namespace and module.

For more information, see Use code coverage to determine how much code is being tested.

Test shortcuts

Tests can be run from Test Explorer by right-clicking in the code editor on a test and selecting Run test or by using the default Test Explorer shortcuts in Visual Studio. Some of the shortcuts are context-based. This means that they run or debug tests based on where your cursor is in the code editor. If your cursor is inside a test method, then that test method runs. If your cursor is at the class level, then all the tests in that class run. This is the same for the namespace level as well.

Frequent CommandsKeyboard Shortcuts
TestExplorer.DebugAllTestsInContextCtrl+R, Ctrl+T
TestExplorer.RunAllTestsInContextCtrl+R, T
TestExplorer.RunAllTestsCtrl+R, A
TestExplorer.RepeatLastRunCtrl+R, L

Note

You can't run a test in an abstract class, because tests are only defined in abstract classes and not instantiated. To run tests in abstract classes, create a class that derives from the abstract class.

Test audio cue

Visual Studio For Mac Unit Test

Test Explorer can play a sound when a test run completes. There are two sounds: one sound to indicate the test run succeeded with all passing tests, and a second sound to indicate the test run completed with at least one failing test. You can set up these sounds in the default Windows 10 sound dialog. This feature is available starting in Visual Studio 2019 Update 16.9 Preview 3.

  1. Open the default Windows 10 sound dialog.
  2. Navigate to the Sounds tab.
  3. Find the Microsoft Visual Studio category. Choose the Test Run Succeeded or Test Run Failed sounds to select the preset sounds or browse to your own audio file.

See also