How Much Should You Test a netForum Upgrade?

We just had Abila support install the latest Service Pack in a customer environment and the client asked us a question that we get asked quite frequently – “What should we test?” “How long should we take to test it?” “We just finished a whole bunch of testing for the last major release and now we have to go back to our end-users and ask them to test some more?” (OK, they didn’t ask ALL those questions, but those are all questions we have heard repeatedly in the past when it comes to testing upgrades, service packs and hot fixes for netForum as they are released by Abila)

Like most things in IT, while there unfortunately isn’t a “right” answer for every customer and every situation, there are certainly some best practices and rules of thumb to help you understand what level of testing effort is right for your Association. Let’s start on the small end of the spectrum…

Hot Fixes

Abila will release a “hot fix” more frequently than Service Packs or major releases when they determine that a “bug” is critical enough for a short-term fix. In other words, hot fixes usually contain solutions to very unfortunate and troublesome bugs. Traditionally these have been fairly straight-forward to test. You would first view the release notes for the hot fix that explains all the updates and changes included ([0]=field_kb_product_line%3A16951) and answer the following questions:

  1. Does the hot fix apply to your environment or business processes?  Do you need any of the fixes that were outlined in the release notes for the hot fix? Note that you do NOT HAVE TO install a hot fix!       Abila might recommend that you stay on the latest version – and generally that is a good idea – but hot fixes are released frequently and could result in quite a bit of testing for you and your team. Note that hot fixes are cumulative; so if you decide to skip one now, the next one will include all the hot fixes from your current version to the version you are having installed. You can always “catch up”.
  2. If you are going to apply the hot fix, what specific business processes or test cases do you need to test based on the release notes?  And keep in mind here that you might need to do a level of “regression testing” (which is defined as “the process of testing changes to computer programs to make sure that the older programming still works with the new changes”*). For example, if the hot fix contains a fix for how payments are applied to invoices with discounts, you may not only want to test apply a payment to an invoice with a discount line item, but also test things like: percentage-based discounts as well as flat discount amounts; discounts on events, products and memberships (depending on what your business sells and discounts); test a mock month-end close to verify the impact of the discounts all the way to your general ledger, etc.

You can generally get a hot fix tested in a few days to a week depending on how thorough you want to be. Hot fixes will be applied to your TEST or DEVELOPMENT environments by Abila support (so it’s always a good idea to have a recent copy of your LIVE database applied to your testing environment BEFORE having Abila apply/install the hot fix), and after your team has tested everything required for the hot fix, Abila will install the hot fix in your LIVE environment.

*From <>

Service Packs

In the 10 years that we’ve been working with netForum, only once did a netForum Service Pack contain primarily new features. Service Packs are typically a larger number of bug fixes that have all been packaged, tested and QA’d together. Whereas hot fixes might come out once per quarter (or more frequently), there might only be 2 service packs in a given calendar year for each major release. As a result, service packs should be tested much more thoroughly and detailed by your team…

In the past, we’d be comfortable with having Abila apply a service pack to a test environment and then just having power-users bang away on the new version for anywhere from 3-6 weeks. We would ask them to test “critical” business processes in addition to any fixes specifically identified in the release notes that we were looking for. This approach has worked well for our clients (and is still a better approach than not doing any testing at all on a service pack) up until the 2013 release. Unfortunately, over the past few years Abila has been experiencing quite a few “QA-related” issues (e.g. something that was fixed in a previous release being broke with the latest service pack), and these QA issues mean that, until Abila can give us a comfort level that they have resolved their QA issues, service packs should be tested almost like a major release (outlined below). This is a lot to ask for our clients and can result in frustration and burnout of power-users and/or testers – so, a compromise or happy-medium is usually reached and understood by all involved. Obviously, having your test cases documented and having testing tools in place will help manage these testing efforts and make it easier on all involved (and The Square Pegs can certainly help with developing, documenting and/or making your testing efforts more efficient and effective – just drop us a line!).

Major Releases

Major releases of netForum come out almost every year – e.g. 2013.01 and 2014.01 were “major” releases. Major releases may contain fundamental changes to the software (e.g. the 2016 version will introduce a new iWeb User Interface and a new backend database server, SQL Server 2016, among many other large changes to the system). As a result of the scope of changes involved with a major release, clients should basically test these releases until their fingers fall off and their heads explode! Ok, not really…but, you get the point. Major releases need test cases defined, meta-data reviewed prior to the installation of the release in your test environment, testers defined and their calendars cleared (as much as can be) for the testing effort, executive leadership on board with the level of effort from the team, integrated systems lined up and ready to regression test, etc. Expect to take 2 to as much as 6 months (maybe even more depending on if “show-stopping issues” are identified in testing that need to be addressed by Abila before you can install the major release in your live environment) testing a major release. You can almost think of this as a “mini” implementation, and if you need help, reach out to the Square Pegs as we help customers with major release upgrades all the time (even if you just need to re-compile some customizations that you, Abila or an partner built for you)!

Things to keep in mind for all upgrades – whether hot fix or service pack or major release:

  • Always try and update your TEST or DEVELOPMENT environment from your LIVE environment PRIOR TO installing and upgrade (both your back-end database and web server file system – this will help make sure you won’t be surprised when the upgrade is applied from your test system to your live system.
  • If you have the time, it’s always a good idea to document your test results – using a tool such as Microsoft Test Manager, or even just Microsoft Excel can help manage your testing efforts both large and small.
  • Don’t forget to regression test! While Abila makes every effort to not break something that was previously working, this does happen…so, don’t just test the single scenario outlined in the release notes – think about your specific business processes and test the critical RELATED processes at a minimum.
  • Keep your metadata and customizations in mind. netForum does a fantastic job of keeping your customizations intact with baseline upgrades and new features – but if something is more likely to break during an upgrade, it’s usually something you have customized.

As a side-note – Abila has been working on AUTOMATED TESTS for netForum to help with their QA-related processes. While these automated tests would be a valuable resource for Abila customers to help with these testing efforts, Abila has decided to NOT make these automated tests available to their customers due to the level of investment required to build these tests as well as the variety of each clients’ netForum environment and customizations. Square Peg Services has launched an informal effort for the netForum community to try and build our own Automated Tests based on the forth-coming 2016 release (with the new iWeb user interface). If you are interested in this effort, or if you would like for one of the Square Pegs to help provide some specific automated tests for your environment, please reach out to us at for more information. Happy Testing!

Jeff M. – SPS Owner/Consultant

4,425 Replies to “How Much Should You Test a netForum Upgrade?”

  1. Pingback: Generic viagra
  2. Pingback: Cialis online
  3. Pingback: Generic for viagra
  4. Pingback: Generic cialis
  5. Pingback: Cialis generika
  6. Pingback: Viagra 5mg
  7. Pingback: Buy cialis
  8. Pingback: Buy cialis
  9. Pingback: Cialis generic
  10. Pingback: writeaessay
  11. Pingback: Cialis generic
  12. Pingback: Cialis 5 mg
  13. Pingback: Cialis 5mg prix
  14. Pingback: Cialis generic
  15. Pingback: 2019
  16. Pingback:
  17. Pingback: buy viagra usa
  18. Pingback: Generic for viagra
  19. Pingback: Viagra daily
  20. Pingback: generic levitra
  21. Pingback: generic viagra
  22. Pingback: cheap viagra
  23. Pingback: viagra tablets
  24. Pingback: online pharmacy
  25. Pingback: canada pharmacy
  26. Pingback: generic cialis
  27. Pingback: cialis 20mg
  28. Pingback: tadalafil 5mg
  29. Pingback: drugstore online
  30. Pingback: online pharmacy
  31. Робот пылесос прекрасный инструмент для уборки и чистки квартиры. В этом топике давайте поговорим о качественных пылесосах. Я, к примеру, обращаю внимание на модели с сайта китайских поставщиков Алиэкспресс. Там достаточно дешево, но выбор занимает много времени.. Вот обнаружила группу вк, где сделан рейтинг моделей пылесосов:

    Роботы пылесосы ilife v50 алиэкспресс

    Хочу подобрать хорошую. Кто использует пылесос подскажите какой лучше брать.

    Надеюсь на помощь от пользователей форума. Заранее благодарю.
    p.s. Это не спам. Уберите ссылку, если это запрещено правилами форума

  32. Пожалуй самая адекватная Биржа Трафика: [url=][/url] – цена соответствует качеству, а пф поднимает позиции [img][/img] Покупайте посетителей тут!!

  33. бизнес отель в центре москвы [url=]бронирование отелей в центре москвы[/url] гостиница новокузнецкая

  34. Online sports betting & gambling news at Jackpot Bet Online. All Word favorite Sportsbook, Racebook, and Casino game. Jackpot Bet Online – We’ve got your game. Bonuses, fast.
    Play [url=][b]online casino[/b][/url] at

  35. cialis online [url=]cialis canadian pharmacy online[/url] discount cialis
    [url=] bruno vardenafil generic[/url]

  36. cialis for bph [url=]sildenafil[/url] buy cialis
    [url=] generic vardenafil pills[/url]
    [url=]generic levitra[/url]

  37. cialis daily [url=]generic cialis online[/url] cialis 10mg
    [url=]how to buy levitra online[/url]
    [url=] vardenafil generic 5mg[/url]

  38. buy generic cialis [url=]zoloft medicine[/url] cialis online
    [url=] order vardenafil 30 pills[/url]

  39. cialis without prescription [url=]lipitor medication[/url] cialis usa
    [url=]where to buy levitra[/url]
    [url=] generic vardenafil online uk[/url]

  40. cialis dosage [url=]canadian pharmacies online[/url] acheter cialis
    [url=] how to take vardenafil[/url]

  41. cialis without a prescription [url=]generic for levitra[/url] cialis 20 mg
    [url=] generic vardenafil mexico[/url]
    [url=]buy levitra on line[/url]

  42. cialis without prescription [url=]reliable canadian pharmacy[/url] cialis for bph
    [url=] vardenafil ohne rezept[/url]
    [url=] buy vardenafil overnight[/url]

  43. cialis prices [url=]cialis generic tadalafil[/url] buy cialis
    [url=] canadian vardenafil online[/url]

  44. cialis price [url=]when will cialis be generic[/url] cialis dosage
    [url=]levitra side effects[/url]
    [url=] generic vardenafil sale[/url]

  45. order cialis online [url=]levitra 10 mg[/url] cialis coupons

  46. cialis online [url=]lyrica generic availability 2019[/url] cialis without a prescription
    [url=]buy cheap generic levitra[/url]
    [url=]buy levitra from canada[/url]

  47. cialis without a prescription [url=]cialis from canada online pharmacy[/url] buy cialis online
    [url=] buy vardenafil canada[/url]
    [url=] buy cheap generic vardenafil online[/url]

  48. cialis prices [url=]side effects of nexium[/url] cialis for bph
    [url=] generic vardenafil safety[/url]
    [url=] buying generic vardenafil online[/url]

  49. cialis 5mg [url=]zoloft online[/url] cialis super active
    [url=] viagra cialis vardenafil online[/url]
    [url=] ordering vardenafil online[/url]

  50. order cialis [url=]lyrica vs gabapentin|generic lyrica[/url] buy generic cialis online
    [url=]buy levitra with no prescription[/url]
    [url=]mail order levitra online[/url]

  51. cialis 10 mg [url=]how to order generic viagra online[/url] cialis coupon
    [url=] buy real vardenafil[/url]
    [url=] vardenafil side effects[/url]

  52. cialis for bph [url=]order sertraline[/url] cialis coupon
    [url=] buy viagra cialis or vardenafil[/url]
    [url=] vardenafil coupons[/url]

  53. cialis usa [url=]dangers of buying viagra online[/url] generic for cialis
    [url=] generic vardenafil usa[/url]
    [url=]buy levitra online india[/url]

  54. cialis coupon [url=]canadian pharmacy cialis 20mg[/url] cialis
    [url=] what does vardenafil do[/url]
    [url=] buy vardenafil online without prescription[/url]

  55. cheap cialis [url=]nexion[/url] cialis for men
    [url=] generic vardenafil india[/url]
    [url=] order vardenafil 10mg[/url]

  56. cialis for men [url=]generic tadalafil 40 mg[/url] cialis professional
    [url=]buy online levitra in usa[/url]
    [url=] buy vardenafil online no prescription[/url]

  57. cialis 20mg [url=]cialis canada pharmacy[/url] cialis from canada
    [url=]order levitra online uk[/url]

  58. cialis 5 mg [url=]vardenafil medication[/url] cialis 5mg
    [url=] generic vardenafil cost[/url]
    [url=]buy brand levitra online[/url]

  59. cialis vs viagra [url=]nexius[/url] cialis 10 mg
    [url=] generic vardenafil reviews[/url]
    [url=] buy vardenafil overnight[/url]

  60. canadian cialis [url=]generic viagra effectiveness[/url] cialis without prescription
    [url=]buy cheap generic levitra online[/url]
    [url=] vardenafil dose[/url]

  61. cialis 20mg [url=]generic cialis tadalafil 20mg[/url] cialis vs viagra
    [url=] buy vardenafil online australia[/url]

  62. cialis for women [url=]cipla tadalafil[/url] cialis without prescription
    [url=] vardenafil dose[/url]

  63. cheap cialis online [url=]interactions for lyrica[/url] cialis pills
    [url=] buy viagra vardenafil alternative lavitra[/url]
    [url=] cheapest vardenafil online uk[/url]

  64. order cialis [url=]canadian pharmacy ltd[/url] cialis 20 mg
    [url=]buy levitra online overnight delivery[/url]
    [url=] vardenafil generic 5mg[/url]

  65. [url=]ковш челюстной на трактор[/url] и [url=]самопогрузчик[/url]

  66. buy cialis [url=]pfizer viagra mail order[/url] buy cialis online
    [url=] vardenafil online canada[/url]

  67. cialis professional [url=]trusted canadian pharmacy[/url] buy cialis
    [url=]buy cialis online overnight shipping[/url]
    [url=]perscription drugs from canada[/url]

  68. cialis for bph [url=]generic vardenafil without prescription[/url] acheter cialis
    [url=]buy cialis online[/url]
    [url=]when does cialis go generic[/url]

  69. generic cialis online [url=]buy levitra germany[/url] cialis for bph
    [url=]online pharmacy canada[/url]

  70. cheap cialis online [url=]nexium weight gain[/url] buy cialis pills
    [url=]cialis discount[/url]

  71. cialis coupon [url=]certified canadian pharmacy[/url] cialis usa

  72. cheap cialis [url=]is there a generic cialis[/url] cialis dosage
    [url=]generic cialis online[/url]
    [url=]cialis brand[/url]

  73. cialis 10 mg [url=]best ed medication[/url] cialis prices
    [url=]buying cialis online[/url]
    [url=]generic cialis online[/url]

  74. cialis prices [url=]ed drug comparison[/url] cialis 5mg
    [url=]tadalafil 20 mg[/url]
    [url=]when will cialis be generic[/url]

  75. buy generic cialis online [url=]sildenafil over the counter [/url] buy generic cialis online
    [url=]buy cialis 5mg[/url]
    [url=]where to get cialis cheap[/url]

  76. buy cialis [url=]vardenafil online[/url] cialis dosage
    [url=]generic viagra online[/url]

  77. cialis pills [url=]sildenafil tablets[/url] cialis 10 mg
    [url=]buy tadalafil[/url]
    [url=]generic tadalafil[/url]

  78. cialis for sale [url=]online prescription[/url] cialis coupons
    [url=]р с—cialis online no prescription[/url]
    [url=]canadian pharmacy king[/url]

  79. buy cialis pills [url=]zoloft 100mg[/url] generic cialis 20mg
    [url=]cialis online sales[/url]
    [url=]buy cialis canada[/url]

  80. cialis 5 mg [url=]lyrica side effects[/url] cialis for women
    [url=]buy cialis[/url]
    [url=]cheap cialis online no prescription[/url]

  81. generic for cialis [url=]lipitor muscle pain[/url] cialis 5 mg
    [url=]cialis usa[/url]
    [url=]cialis soft tabs[/url]

  82. cheap cialis [url=]new ed drugs[/url] order cialis online
    [url=]tadalafil best price[/url]
    [url=]cialis for sale online[/url]

  83. cialis vs viagra [url=]what are the side effects of atorvastatin[/url] buy cialis online
    [url=]tadalafil best price[/url]
    [url=]perscription drugs from canada[/url]

  84. Online sports betting & gambling news at Jackpot Bet Online. All Word favorite Sportsbook, Racebook, and Casino game. Jackpot Bet Online – We’ve got your game. Bonuses, fast.
    Play online [url=][b]casino[/b][/url] at

  85. order cialis online [url=]lyrica 25[/url] cialis 5 mg
    [url=]canadian pharmacy world coupon[/url]
    [url=]canadian pharmacy checker[/url]

  86. cialis 20mg [url=]erectile dysfunction treatment[/url] cialis price
    [url=]adderall canadian pharmacy[/url]
    [url=]canadian pharmacy no scripts[/url]

  87. buy cialis pills [url=]astrovastatin medication for lipitor[/url] buy generic cialis online
    [url=]canadian drug stores[/url]
    [url=]perscription drugs from canada[/url]