Skip to main content

Unit Testing - What to Test

This I wrote to answer a question that came up when we were discussing our software process and I was training developers on how to unit test.

It seems a simple enough question, but I kept pondering it and delving deeper until I realized I needed to write this monograph.

What unit tests should we write? How do we know what to test?


Ideally, unit tests should cover every path through the code. It should be your chance to see every path through your code works as expected and as needed. If you are practicing Test Driven Development then it's implied everything gets a test.

In the real world, you might not be allowed to test everything - for instance, if the testing suite ends up taking a week to run, then the world will have changed by the time it finishes and the test results will be obsolete.

Unit testing at it's basic is testing an object, a method - the smallest unit of your code that it can test independently.

It should test the inputs "goes into" and corresponding outputs "goes out of".  It should test every variant of input that will exercise every code path and even try to get to exit it's code paths entirely - throw an exception, SIGINT, stack overflow, whatever. It's no time to be nice to your code.  Test boundaries - test what happens when you are outside the boundaries - inputs outside what you expect, exceptions from called objects, unexpected types - strings instead of numbers, floats instead of ints.

It should be automated and fast so that whenever that "thing" (your small unit of software)  changes, you can run the test and make sure it still works as expected - as it did prior to the change.

A good and complete suite of unit tests should:
·       Free you to do exploratory testing at a higher level, manually or however
·       Give you confidence to change, refactor fearlessly - if all the same gazinta's produce the same gazouta's for a unit, you're good!

Test code should be treated as well as all the rest of your application code - it's not hack code, junk code, throwaway code because if it is, it doesn't belong in the source tree.

Designing for testability:
  • Adhering to separation of concerns help make code testable - focused functions that do only one thing are easier to test
  • When accessing other objects, try to segregate or wrap the calls so that mocking them becomes easier
  • Segregate validation code so that it can be easily tested
  • Think of patterns that foster testability like the Facade pattern

In our Javascript ecosystem, here are some further specific hints:
  • Look at anonymous functions - very often these can be turned to named functions and makes them testable units. If you have a 10+ line anonymous function, it's probably doing something non-trivial - so it could probably use a test.
  • As you are writing functions, look for ways to make them composable (See https://codewords.recurse.com/issues/four/lazy-composable-and-modular-javascript for more details on concept and techniques).
  • Know what your functions return - or in other words, be explicit about what your functions return. Don't surprise the caller.
  • Try to create functions without side effects - otherwise try to make the side effects singular in purpose and scope for each function.  Test the side effects.
  • Test Failure - make sure a .catch on a .then gets tested.
  •  Perhaps  the use of flogs, such as '__DEV__' will help you segregate test code you want to disappear in production.

References:
xUnit Test Patterns - Website of book by same name. Published by Addison-Wesley - well worth purchasing. Accessed Jan 19, 2018 - an excellent resource on xUnit test patterns - goes over mocks, test doubles, lots of helpful patterns.
Robert Martin of First Class Tests - Accessed Jan 19, 2018 - This article in particular makes a very good case on why you should treat your test code as a 'First Class Citizen' - an equal to the application code it supports. It's a mind shift - an important one.
Collected Wisdom of Martin Fowler - Accessed Jan 19, 2018 - lot's viewpoints on how to get value out of testing - not a one time read, more of an on-going resource.
 

Comments

Popular posts from this blog

Risk Mitigations for Custom Applications

  In many healthcare applications, often due to the cloistered nature of the use cases – e.g. it will only be accessed by users authorized in a particular facility, such as an operating room suite – the needs for Authentication and Authorization are minimized when the system is designed and implemented. This presents a risk as soon as you allow for the possibility of users with ill-intent or that otherwise want to operate outside their given roles. Custom applications need to consider these possibilities and implement the following measure to ensure the integrity of the system. 1.   Authentication and Authorization Controls: Multi-Factor Authentication (MFA): Implement MFA for all user logins. This adds an extra layer of security beyond just a username and password. Role-Based Access Control (RBAC): Grant users access only to the data and functionalities they need for their specific role. This minimizes the potential for unauthorized access. Strong Password Policies: ...

JavaScript and JQuery Palettes...

I have been immersing myself in the world of d3js and more, specifically Plotly.js . This has required me to look at palettes, and to create some palettes - which I did with Paletton . I find it tedious, so I am creating some helpers, like the code below which displays a given list of palettes (each of which is simply an array of colors in your favorite format). <table id="Palette"> <tbody></tbody> </table> <script> var defaultColorsPalette = ["#ffd99a", "#225ea8", "#ffc09a", "#9dc4f4", "#ffbf58", "#ffdb58", "#257294", "#ff9658", "#61a1f3", "#ffa719", "#ffce19", "#ff6e19","#ffe99a", "#2a82f2", "#ff9e00", "#ffc900", "#ff5f00", "#036bf0" ]; //via colorweb2 var sequentialMultihueBlueYellowPalette = ["#ffffd9", "#edf8b1", "#c7e9b4",...