An examination of advertised accuracy rates, independent research, and the importance of transparency in investigative technology.
In the investigative technology industry, accuracy is frequently presented as one of the most important considerations when evaluating polygraph and voice stress analysis systems.
Manufacturers and technology advocates sometimes reference accuracy rates of 90%, 95%, 98%, or higher. Such figures can sound impressive, particularly to law enforcement agencies, military organizations, intelligence professionals, and private investigators seeking reliable investigative resources.
But an important question deserves considerably more attention: Where is the independent, scientifically validated evidence supporting these accuracy claims?
More specifically, what does an advertised accuracy percentage actually measure? Was the figure established through independent research? Were the findings published and subjected to scientific scrutiny? And can the results reasonably be applied to the operational environments in which these technologies are used?
These are not questions intended to discredit polygraph examinations, voice stress analysis, or any particular manufacturer. They are questions that every responsible investigative technology provider, including VIPRE Technology Group, should be prepared to address.
The objective is straightforward: distinguish scientifically documented performance from marketing claims and encourage greater transparency throughout the investigative technology industry. This article examines selected published sources. It is not an exhaustive systematic review or a new validation study.
1. Understanding the difference between a claim and scientific validation
When a company advertises that its technology is 95% accurate, the statement may create the impression that the system correctly identifies deception in 95 out of every 100 examinations. However, the underlying research may measure something considerably different.
For example, a published accuracy figure might reflect:
- Performance under controlled laboratory conditions.
- Results from a particular examination technique rather than an entire product line.
- Examinations involving subjects whose truthful or deceptive status is independently known.
- Decisions made only after inconclusive examinations have been excluded.
- Performance by specially trained or highly experienced examiners.
- Results from a limited sample that may not represent real investigative populations.
These distinctions are critical. A technology that performs well in a controlled experiment has not necessarily demonstrated the same performance in criminal investigations, personnel screening, intelligence interviews, or other operational environments.
Similarly, a study involving one examination technique cannot automatically establish the accuracy of every technique employed by a particular manufacturer. Scientific validation requires more than an impressive percentage. It requires an understandable methodology, reliable reference standards, reproducible findings, and appropriate limitations on the conclusions being drawn.
2. What did the National Academies conclude about polygraph accuracy?
One of the most significant scientific examinations of polygraph technology was published in 2003 by the National Research Council of the National Academies. The Polygraph and Lie Detection examined evidence concerning polygraph validity and accuracy, with particular attention to national security screening. The committee used 57 studies in its quantitative assessment of accuracy.
Its conclusions were nuanced. The researchers found that specific-incident polygraph examinations involving subjects untrained in countermeasures could distinguish deceptive from truthful individuals at rates greater than chance. However, they also identified substantial limitations in the underlying research.
Among the concerns were the artificial nature of laboratory experiments, difficulties establishing independent ground truth in field investigations, differences in examiner procedures, and the possibility that published performance estimates overstated real-world accuracy.
The report emphasized that findings from specific-incident investigations should not automatically be extended to broad personnel or security screening programs. An examination concerning a specific, documented criminal incident presents a fundamentally different investigative situation from screening hundreds or thousands of employees for undisclosed misconduct.
The National Academies did not establish a universal accuracy percentage applicable to all polygraph systems, examiners, examination formats, and operational circumstances. The central lesson is that accuracy depends on how a technology is used, how performance is measured, and whether the research represents the intended conditions.
3. What does the polygraph industry's own research report?
The American Polygraph Association, a professional organization representing polygraph practitioners, describes its 2011 meta-analytic survey of validated examination techniques. Its published summary reports the following aggregated results:
| Technique group | Decision accuracy | Confidence interval | Inconclusive rate |
|---|---|---|---|
| Event-specific, single-issue | 89% | 83% to 95% | 11% |
| Multiple-issue | 85% | 77% to 93% | 13% |
| Combined validated techniques, excluding outliers | 87% | 80% to 94% | 13% |
These are historical research estimates, not present-day guarantees for every product or examination. Confidence intervals communicate uncertainty around the estimates; they are not a promise that every examiner's performance falls within those bounds.
The findings are significant because they come from an organization dedicated to the professional use and development of polygraph testing. Their industry origin should be disclosed, just as the sponsorship and affiliations of other research should be disclosed.
The results relate to specified validated techniques and research conditions. They should not be interpreted as universal performance guarantees for every examination conducted in the field.
Furthermore, the reported inconclusive rates deserve attention. An inconclusive examination is not the same as a correct determination, and excluding such results can materially affect how an accuracy percentage is understood. Readers should ask which cases are included in the denominator and how inconclusive outcomes are handled.
The association's published aggregate findings provide a useful reference point when evaluating broad advertising claims approaching 98% or 99%. If substantially higher performance is advertised, it is reasonable to request the specific scientific evidence supporting that claim and determine whether the study measures the same outcome.
4. Scientific debate continues, and that matters
The scientific discussion surrounding polygraph validity did not end with the National Academies report.
In a 2019 publication in Law and Human Behavior, William G. Iacono and Gershon Ben-Shakhar revisited the scientific status of the comparison-question polygraph technique. Their review concluded that significant concerns about its scientific foundations, research quality, and unknown real-world error rates remained unresolved.
Other researchers have reached more favorable conclusions. A comprehensive meta-analysis by Charles R. Honts, Steven Thurber, and Mark Handler, published in the 2021 volume of Applied Cognitive Psychology, examined 138 datasets involving the comparison-question technique.
The authors concluded that this form of polygraph testing can provide useful diagnostic information, while also discussing limitations in the field research literature and operational practices that may reduce accuracy.
The two perspectives do not establish identical conclusions, and their statistical measures should not be treated as interchangeable. An effect size, an accuracy index, and a percentage of correct decisions are not automatically the same measurement.
The continuing debate illustrates an important point: interpretation of accuracy findings remains a subject of serious scientific discussion. That is precisely why sweeping claims of near-perfect performance deserve careful examination.
5. What does independent research say about voice stress analysis?
Voice stress analysis also deserves rigorous scientific examination. Unlike conventional polygraph systems, which measure multiple physiological signals through attached sensors, voice stress analysis systems evaluate characteristics of recorded speech.
Different voice analysis technologies may employ different signal-processing methods, examination procedures, and analytical approaches. Consequently, findings involving one product cannot automatically establish the performance of every other system. Readers seeking background on the interview process can also consult VIPRE's voice stress analysis overview.
A National Institute of Justice field study
In research reported by the National Institute of Justice in 2008, investigators evaluated Computer Voice Stress Analyzer (CVSA) and Layered Voice Analysis (LVA). The study involved 319 recent male arrestees at the Oklahoma County jail, questioned about recent drug use. Their statements were compared with subsequent urine test results.
The NIJ account of the study reports that the programs identified an average of approximately 15% of deceptive responses and incorrectly classified approximately 8.5% of nondeceptive responses as deceptive. It describes approximately 50% overall performance using an analysis that considered sensitivity and specificity together. That figure should not be relabeled as a simple count of correct answers out of all interviews.
Those results did not support high deception-detection accuracy claims for the tested products under those conditions. NIJ also notes that the CVSA version evaluated was introduced in 1997, an important limit when discussing later products or versions.
The study did not evaluate AISIS or VASIS. Its findings neither validate nor establish the failure of VIPRE's systems. Equally, a different design or newer version is not, by itself, evidence of superior accuracy. Each claim requires appropriate supporting research.
The researchers also found less false reporting of drug use among participants interviewed with the systems present than in a historical comparison group. This was not a randomized, simultaneous comparison, so the difference should not be treated as definitive proof that the instruments caused greater honesty.
An instrument's influence on an interview may differ from its measured ability to classify responses. That distinction does not transform an unsuccessful detection result into proof of diagnostic accuracy. The responsible conclusion stays within the products, population, application, and methods actually examined.
Earlier government-sponsored research
An NIJ-sponsored investigation published in 2002 evaluated the Vericator and Diogenes Lantern systems. It found evidence that the evaluated units could recognize stress through voice analysis, but did not establish deception detection.
Importantly, the report states that a lack of deceptive-stress data prevented testing whether the systems could distinguish deception-related stress from emotional or physical stress. An untested distinction is not the same as a demonstrated failure on that distinction. Nor is recognizing stress sufficient proof of deception detection.
A person may experience stress for numerous reasons unrelated to dishonesty, including fear, uncertainty, embarrassment, personal circumstances, or the seriousness of an investigative interview. Conversely, a deceptive individual may not exhibit a particular measurable stress response.
Claims concerning stress identification and claims concerning deception detection must therefore be evaluated separately.
6. Why a 95% accuracy claim may not mean what buyers think
A single percentage can obscure very different kinds of performance. Several measures need to be considered together:
- Sensitivity: how often a test correctly identifies positive cases, such as independently established deceptive responses in a deception study.
- Specificity: how often it correctly identifies negative cases, such as independently established truthful responses.
- False positives: negative cases incorrectly classified as positive.
- False negatives: positive cases incorrectly classified as negative.
- Inconclusive results: examinations that do not produce a definitive classification under the applicable decision rules.
A test could identify most deceptive individuals while incorrectly classifying a substantial number of truthful individuals. Alternatively, it could correctly classify most truthful individuals while failing to identify many deceptive individuals. A single advertised percentage may conceal these differences.
The problem of base rates
Consider a hypothetical screening program involving 10,000 employees, only 10 of whom have engaged in the specific misconduct being investigated. When misconduct is rare, even apparently impressive test characteristics can yield many false alarms.
The National Academies' screening example uses a hypothetical accuracy index of 0.90. This index is not equivalent to saying that 90% of all individual decisions are correct. Under one illustrative decision threshold, the test identifies eight of the ten positive cases but incorrectly flags 1,598 of the 9,990 negative cases.
This is a mathematical illustration, not a report of actual operational results or an error estimate for a particular current product. Changing the decision threshold changes the balance between missed cases and false alarms.
The practical value of an examination cannot be determined from an advertised percentage alone. Agencies must understand the consequences of errors, the prevalence of the behavior being investigated, and how findings will be corroborated. A flagged result should not be converted automatically into an allegation of wrongdoing.
7. Investigative assistance is not proof of deception
An examination system may assist an investigator without being treated as definitive proof that a subject is truthful or deceptive.
Investigative interviews involve assessing statements, identifying inconsistencies, clarifying timelines, evaluating supporting evidence, and determining which questions require additional attention. Technology may contribute information to that process. However, the validity of any claimed detection capability must still be established through appropriate research.
A system's potential usefulness as an investigative aid should not be confused with independent proof of a particular deception-detection accuracy rate. Likewise, an admission or investigative lead obtained during an examination does not, by itself, establish that the technology accurately detected deception.
An interview may produce useful information because of effective questioning, evidence presentation, or the subject's own decision to disclose information. To attribute that result to a measurement capability requires a research design capable of testing the attribution.
Investigative utility and scientifically validated diagnostic accuracy are related considerations, but they are not interchangeable. This distinction protects investigators, the individuals being examined, and the credibility of the investigative process.
8. Does artificial intelligence change the standard of evidence?
Artificial intelligence is increasingly incorporated into technologies that analyze speech, behavior, and other measurable characteristics. AI systems can process complex datasets, identify patterns, and assist with consistent evaluation. These capabilities may support new approaches to investigative analysis.
However, incorporating AI does not automatically establish scientific validity or improve deception-detection accuracy. An AI-assisted system must still be evaluated against appropriate reference standards.
Important questions include whether testing used independent data, whether training and testing populations were appropriately separated, whether performance generalizes to new populations, and whether reported findings reflect realistic conditions. A software version and its decision rules should be identified so readers know what was actually evaluated.
The distinction between identifying vocal stress and identifying deception remains relevant whether analysis uses traditional signal processing or newer AI-assisted approaches. AI should strengthen the demand for meaningful validation, not replace it.
9. What should agencies request from manufacturers?
Before accepting an advertised accuracy claim, a prospective customer should be able to obtain clear answers to these questions:
- What specific product and version were evaluated? Research on an earlier system or a different technique may not validate the product now marketed.
- Who conducted and funded the research? Manufacturer-sponsored work may be useful, but sponsorship should be disclosed and independent replication offers additional confidence.
- Was the study published and independently reviewed? Peer review is not a guarantee of correctness, but creates an opportunity for outside scrutiny.
- How was truth or deception independently established? A credible accuracy study needs a reliable reference standard, not merely agreement with another unverified classification.
- Were errors and inconclusive results disclosed? Ask for false positives, false negatives, inconclusive rates, uncertainty estimates, and the denominators behind percentages.
- Were subjects and conditions representative? Laboratory conditions may not reproduce the pressures, consequences, and complexity of the intended use.
- Can qualified researchers replicate the findings? Reproducible results provide stronger support than isolated claims.
- Does the study support the advertised percentage? Conclusions must not exceed what the design, results, and limitations reasonably permit.
VIPRE's agency evaluation checklist addresses broader operational questions, including training, documentation, and deployment fit. Those questions complement, rather than replace, scrutiny of a numerical accuracy claim.
10. VIPRE's perspective: credibility begins with transparency
VIPRE Technology Group develops AISIS, its AI-assisted investigative analysis platform, and VASIS voice stress analysis technology. Both are intended to support trained investigative professionals in evaluating stress-related indicators and identifying responses that may warrant further examination.
The broader industry has faced longstanding questions concerning validation, performance claims, and appropriate interpretation. These questions deserve serious consideration. They should not be dismissed because they challenge established practice or commercial messaging.
The same standards should apply to polygraph systems, conventional voice stress analysis products, and emerging AI-assisted technologies, including VIPRE's own systems. Scientific findings involving one technology should not be generalized to unrelated products without adequate evidence.
This article does not present a new independent validation study, a head-to-head product comparison, or a product-specific accuracy estimate for AISIS or VASIS. None of the studies summarized here should be treated as independent validation of those systems.
Agencies evaluating VIPRE should request the evidence supporting the exact capability and version under consideration, distinguish independent research from company-supported material and operational experience, and identify what has not been independently established. Experience, training, and a technical explanation are not substitutes for a validation study.
VIPRE does not suggest that its technology, or any competing technology, should be accepted as infallible. Findings belong alongside professional judgment, appropriate procedures, and corroborating evidence. Agencies can request product-specific information from VIPRE without treating the educational discussion here as a performance guarantee.
11. Raising the standard for the entire industry
Investigative professionals make decisions involving public safety, national security, criminal investigations, personnel integrity, and individual reputations. Those responsibilities demand accuracy in how technology is described, transparency in how performance is measured, and restraint in how findings are presented.
This does not mean technologies have no value unless they achieve perfect performance. Few investigative tools are perfect. It does mean users should be able to distinguish demonstrated capabilities from assumptions, marketing estimates, and unsupported generalizations.
Manufacturers should welcome legitimate questions. Researchers should continue examining effectiveness and limitations. Agencies should evaluate the quality of supporting evidence rather than relying exclusively on impressive numerical claims.
The bottom line
The scientific literature does not justify treating any single advertised accuracy percentage as a universal measure of polygraph or voice stress analysis performance. Results vary with methods, conditions, populations, interpretation procedures, and the outcome being measured.
Some studies report meaningful performance under defined conditions. Others identify serious limitations or findings that fail to support particular claims. Both deserve consideration.
When a technology is advertised as 95%, 98%, or 99% accurate, the appropriate response is neither automatic acceptance nor automatic rejection. It is a request to examine the evidence: who conducted the research, what was tested, how accuracy was defined, and whether the findings support the claim.
The future of investigative technology should be built on credible evidence, not simply impressive percentages.
Frequently asked questions
Does a 95% accuracy claim mean 95 out of every 100 examinations are correct?
Not necessarily. The percentage may describe a particular technique, population, decision rule, or subset of conclusive examinations. Agencies should request the study, its definition of accuracy, error rates, inconclusive rate, and evidence that the findings apply to the intended use.
Did the 2008 NIJ-funded study evaluate every voice stress system?
No. It evaluated CVSA and LVA in a jail-based study of statements about recent drug use. It did not evaluate AISIS or VASIS, and it does not establish the performance of every voice analysis system or current product version.
Does detecting vocal stress establish deception?
No. Stress can arise for reasons unrelated to deception. A claimed ability to identify stress must be distinguished from a separately validated ability to classify deceptive responses.
Does this article independently validate AISIS or VASIS?
No. This is an educational review of selected published research, not a new independent validation study or a product-specific accuracy estimate for AISIS or VASIS. The same requirements for appropriate evidence, transparent methods, and disclosed limitations apply to VIPRE's own systems.
Research sources and further reading
- National Research Council (2003). The Polygraph and Lie Detection. National Academies Press. Foundational review of accuracy, research limitations, and screening.
- American Polygraph Association. Polygraph Validity Research. Summary of the association's 2011 meta-analysis and reported confidence intervals.
- Iacono, W. G., and Ben-Shakhar, G. (2019). Current status of forensic lie detection with the comparison question technique. Law and Human Behavior, 43(1), 86 to 98.
- Honts, C. R., Thurber, S., and Handler, M. (2021). A comprehensive meta-analysis of the comparison question polygraph test. Applied Cognitive Psychology, 35(2), 411 to 427. First published online December 18, 2020.
- Damphousse, K. R. (2008). Voice Stress Analysis: Only 15 Percent of Lies About Drug Use Detected in Field Test. NIJ account of the CVSA and LVA jail study.
- Haddad, D., Ratley, R., Walter, S., and Smith, M. (2002). Investigation and Evaluation of Voice Stress Analysis Technology, Final Report. NIJ-sponsored evaluation, NCJ 193832.
- American Psychological Association. Do “lie detectors” work? Further context on scientific criticism of polygraph validity. This organization is distinct from the American Polygraph Association.
