Ranking / Test type
Test automation vendors for security products
Automated regression suites for security products. The facet counts verified security-product cases that describe test automation.
Short answer
DeviQA leads this facet with a facet score of 4.9 of 10, computed from security-product evidence depth, product-class coverage and engagement longevity on this facet's evidence only. Transition Technologies PSC is second with 4.4. Eight of the 12 ranked vendors qualify.
Facet table
Only the dimensions that drive this facet are shown. Dimensions 1, 2 and 4 recomputed on evidence that includes this test type. A vendor qualifies with one verified item; the page is published when at least 3 vendors qualify. Overall scores are on the ranking.
| Rank | Vendor | Facet score | 1. Security-product evidence depth | 2. Product-class coverage | 4. Engagement longevity | Facet evidence |
|---|---|---|---|---|---|---|
| 1 | DeviQALeader | 4.9 | 4.0 | 2.0 | 10.0 | 3 |
| 2 | Transition Technologies PSC | 4.4 | 4.0 | 2.0 | 8.0 | 2 |
| 3 | QA Mentor | 3.4 | 2.0 | 2.0 | 8.0 | 1 |
| 4 | ImpactQA | 2.5 | 4.0 | 2.0 | 0.0 | 1 |
| 5 | QASource | 1.5 | 2.0 | 2.0 | 0.0 | 1 |
| 6 | Codoid | 1.5 | 2.0 | 2.0 | 0.0 | 1 |
| 7 | AgileEngine | 1.5 | 2.0 | 2.0 | 0.0 | 1 |
| 8 | Indium Software | 1.0 | 2.0 | 0.0 | 0.0 | 1 |
Evidence per vendor
QA Mentor
- Verified review for an unnamed client: identity and access management; automation testing; 48 months. [e-0071]
QASource
- Case study for an unnamed client: endpoint protection and EDR; functional, OS, browser or agent compatibility, API and automation testing. [e-0010]
Codoid
- Case study for an unnamed client: identity and access management; automation and functional testing. [e-0046]
AgileEngine
- Case study for an unnamed client: SOAR and incident response; functional, automation and API testing. [e-0038]
Indium Software
- Case study for an unnamed client: automation and API testing. [e-0025]
What to ask vendors for this facet
- Ask what share of the regression suite ran on every build in the vendor's last security engagement, and how flaky tests were handled.
- Ask who owns the automation code at the end of the contract and in which repository it lives.
- Ask how the suite covered agent or platform behaviour that a UI test cannot reach.