DEFENDING AGAINST A QUANTITATIVE ANALYSIS FOR A FORENSIC PURPOSE

Issues in Cross-examining  Government Scientists About Measurement Science

Help for Canadian Criminal Defence Lawyers Defending DUI Charges

How Can I Help Improve Canada's Justice System?

Gemmologist's scales with toy cars.

If the scales are biased against the accused, what can I do to make the system better?

Inquiries into Miscarriages of Justice in Ontario and Quantitative Analysis

The following is an excerpt from the Executive Summary pp. 20-21 to the Report of the Motherisk Hair Analysis Independent Review by Independent Reviewer, The Honourable Susan E. Lang:

"There should be ongoing and expanded continuing legal education for counsel, including
child protection counsel, and for the judiciary regarding expert evidence, particularly
expert scientific evidence. Members of the bar should ensure that they understand the
scope and limitations of an expert’s opinion and expertise. In addition, they should exercise care to qualify an expert properly and set precise parameters on an expert’s area of expertise. Counsel should be vigilant to ensure that justice is not undermined by the use of flawed forensic evidence. The recommendations of the Goudge Report continue to
provide valuable insights on these issues."

This site is our attempt to help expand continuing legal education for counsel, including criminal law counsel, and for the judiciary regarding expert scientific evidence.

​​

This site encourages criminal law counsel and the judiciary to distinguish quantitative analysis from qualitative analysis. See Motherisk Hair Analysis Independent Review at Glossary page xix:

"qualitative (result) A result that provides an indication of drug presence as a
positive (yes) or negative (no), rather than providing actual
quantitative results."


"quantitative (result) A result that is reported containing the actual concentration
of the drug in a sample, indicating a degree of precision and
accuracy."

This site encourages criminal law counsel and the judiciary to seek out expert scientific evidence from properly qualified experts whose scope of scientific (not just technical) expertise relates specifically to metrology - the science of measurement. Experts in the science of measurement are called "metrologists" and their field of expertise is "metrology". The sub-category of expert is "forensic metrologist" and the field is "forensic metrology".

 

Reliable scientific quantitative measurement, for forensic purposes, is essential, if Courts are to make reliable findings of fact as to quantitative results. Many sections of the Criminal Code of Canada define the actus reus of delicts as quantitative measurements, frequently concentrations. See the concept of "forensic purposes" used in many sections of the Motherisk Hair Analysis Independent Review, notably at p. 19 of the Executive Summary:

"Public confidence in the justice system demands that any evidence relied on in criminal
cases be adequate and reliable for forensic purposes."

Gemmologist's scale comparing mass of paperclips against traceable 10+1=11 gram weights.

The scales in the image above, appear to be in balance. The unknown mass of a number of paperclips is being compared with known gram weights. If the scales are balanced, then we can, with some degree of certainty, conduct a fair quantitative analysis. However, if the scales are not balanced or we don't have known reference weights traceable to the international system of units, then the quantitative analysis is biased against somebody. If used for a forensic purpose, the quantitative analysis is biased against the Crown or the accused, and that is unacceptable in Canada's criminal justice system. What can I do to make the system better?

Parliamentarians need to hear evidence from metrologists, experts in the science of measurement, before they enact amendments to the Criminal Code of Canada respecting criminal offences, where the delict is defined as a concentration or other quantitative result. Fair prosecution of a delict that is defined as a concentration or other quantitative result, requires a fair scientific measurement. A fair scientific measurement requires compliance with the laws of Canada that define fair weights and measures and incorporate the International System of Units. Before amending a statute, Parliamentarians need to consider whether the proposed change will result in the new section contradicting section 4(1) of the Weights and Measures Act and Canada's constitutional history of fair weights and measures (see Magna Carta and the Constitution Act, 1867 section 91(17). Parliamentarians also need to consider whether the proposed change will contradict the common law of Canada related to the foundational requirements of expert scientific evidence, particularly in light of the public inquiries into miscarriages of justice in Canada.

Unfortunately, Parliamentarians sometimes lose sight of scientific evidence that they have previously heard at the Commons Justice Committee. Public interest groups push Parliamentarians for legislation to control crime. Unfortunately, propoer short cuts and rebuttable presumptions, sometimes evolve into legislated "conclusive proof" (without legislating defence opprtunity to establish "evidence to the contrary") without appriopriate concern for the scientific rules of quantitative analysis for forensic purposes. 

Members of the Criminal Lawyers Association and other counsel who regularly make submissions to the Commons Justice Committee need to become familiar with the science of forensic metrology, and the expertise of metrologists, if they are to be effective in promoting well-drafted criminal legislation respecting quantitative delicts.

Criminal law counsel and the judiciary need to make themselves aware of the history of evidence given to Canada's Justice Committee and to the Courts, especially records of evidence considered by the Supreme Court of Canada.

 

A good example of why such history is important to a constitutional analysis of Criminal Code of Canada quantitative result delicts, is the contradiction between:

 

evidence given to the Justice Committee during consideration of Bill C-2 in 2007 (which was consistent with the record before the Supreme Court of Canada in St-Onge in 2012)

 

v.

 

evidence given to the Justice Committee in 2017 during consideration of Bill C-46 (which was consistent with the Position Paper of the Canadian Society of Forensic Sciences Alcohol Test Committee in 2012.

Evidence given to the Justice Committee during consideration of Bill C-2

Consider the evidence of Brian Hodgson, June 12, 2007 at (0910), Standing Committee on Justice and Human Rights, including the following :

"These instruments are all automated instruments. They require operator involvement. But when strict protocols are followed and the instrument is working properly as per the recommended procedures, then the tests obtained, especially when they're 15 minutes apart, provide conclusive proof of the person's blood alcohol concentration at the time of testing."

The next year, the Canadian Society of Forensic Sciences published a peer-reviewed article by Hodgson, Brian T., "The Validity of Evidential Breath testing", Can. Soc. Forensic Sci. J. Vol. 41 No 2 (2008) pp. 83-96.:

Hodgson report abstract.jpg

The Abstract from the 2008 article, indicates that [approved] instruments are "capable of producing scientifically sound results". However, "to achieve scientifically sound results in operational use", the instruments must be operated "using procedures based on good laboratory practice." Good laboratory practice is a condition precedent to reliability of the measurement result.

Hodgson on Reliability.jpg

At pages 85-86 of the 2008 Article, Hodgson provides a definition of "reliability" under the heading of "INSTRUMENTATION". In other words, "instrumentation" is one aspect of "reliability".  He states that "Reliability", reliability of the instrumentation, refers to the ability of the instrument "to perform", "over time", without any "significant drift", in "accuracy", or "precision". Please note that he does not refer under this first aspect of "reliability" to performance of the "instrument type" or the "instrument class", but rather to "the instrument: "the ability of the instrument to perform over time" [Emphasis added]. Performance is something that can be tested empirically. It is not a matter of faith.

At pages 87-92 of the 2008 Article, Hodgson provides  an additional aspect of "reliability", an "EVALUATION PROCESS". He states that "It was recognized early on the need for scientific standards in the selection of instruments." He describes Alcohol Test Committee evaluation standards and reports. He connects the Canadian evaluation process with the evaluation processes in the United States under NHTSA, and the international standard OIML R 126:

"With the increased interest in using evidential breath testing, pressure mounted to create an international standard for instrument evaluation and operational use. These efforts resulted in the publication of an International Recommendation on evidential breath alcohol instruments in 1998. This publication, designated “OIML R 126 Edition 1998 (E) - Evidential breath analyzers”, was a product of the International Organization of Legal Metrology, better known by the initials of its French name: OIML – Organisation Internationale de Métrologie Légale. OIML is an international, intergovernmental organization based in Paris that attempts to harmonize standards for the design and manufacture of certain measuring instruments, including evidential breath alcohol devices."

At pages 92-93 of the 2008 Article, Hodgson provides an additional aspect of "reliability" , "PERSONNEL". He states:

"The key element in this process is having competent and properly trained person-nel. The obvious choice for legal purposes is police personnel. Police officers are trained to do policing, and they are the ones who detect and apprehend suspected drinking drivers. Since very few would have a technical or scientific background, it is necessary to conduct a thorough and rigorous training program. The first step is to identify qualified police officers for this purpose. The objective is to select educated lay-persons: police officers who are willing to learn about the scientific and technical aspects of breath alcohol testing. The next step is a comprehensive training curriculum geared to those educated lay-persons. The third step is really an on-going one: regular refresher training or at least competency testing of qualified personnel. Overseeing the whole process are specially selected persons who conduct the training and supervise the on-going field operations. The whole program, training and field operations, should be monitored by qualified scientific personnel who ensure that a high quality is maintained." Conditions precedent to this aspect of "reliability" require:

1. identify qualified police officers for this purpose ... who are willing to learn about the scientific and technical aspects of breath alcohol testing

2. comprehensive training curriculum geared to those educated lay-persons

3. an on-going one:

(a) regular refresher training or

(b) at least competency testing of qualified personnel

4. overseeing the whole process are specially selected persons:

(a) who conduct the training and

(b) supervise the on-going field operations

5. the whole program, training and field operations, should be monitored by qualified scientific personnel who ensure that a high quality is maintained.

At page 93 of the 2008 article, Hodgson provides an additional aspect of "reliability", "OPERATIONAL PROCEDURES". He states: "The CSFS Alcohol Test Committee has identified a set of procedures that are necessary for the correct operation of approved instruments. These procedures will ensure that test results are scientifically sound in accordance with the principles of good laboratory practice." Hodgson then states that "the basis of these procedures consists of":

a blank test with ambient air to ensure the instrument is free of volatile substances that could contaminate the breath sample analysis,

verification of the proper working order of the instrument by testing with a known alcohol standard, often called a calibration check,

two (2) samples of deep lung air uncontaminated with extraneous volatile substances from a subject taken within a short time period of each other.

Hodgson continues at p. 93, however, with two other operational procedures conditions precedent:

to ensure that no extraneous volatile substances contaminate the breath samples, a waiting period is observed prior to taking the first of the two samples, usually of 15 minutes duration.

in addition to these operational procedures, a regular program of preventative maintenance ensures that instruments will be in proper working order during field operations."

The 2007 Justice Committee evidence of Hodgson and the 2008 article by Hodgson are consistent with:

International standard ISO 17025 on Testing and Calibration Laboratories:

ISO 17025 front page.jpg

The 2008 article by Hodgson, which lists a variety of conditions precedent to "reliability", is consistent with International Standard ISO 17025, Second edition 2005-05-15, "General requirements for the competence of testing and calibration laboratories". The 2005 edition of ISO 17025 lists in section 5:

5 Technical requirements 5.1 General

5.1.1 Many factors determine the correctness and reliability of the tests and/or calibrations performed by a laboratory. These factors include contributions from:

  • human factors (5.2);

  • accommodation and environmental conditions (5.3);

  • test and calibration methods and method validation (5.4);

  • equipment (5.5);

  • measurement traceability (5.6);

  • sampling (5.7);

  • the handling of test and calibration items (5.8).

The 2008 article by Hodgson, which lists a variety of conditions precedent to "reliability", is consistent with the National Research Council of Canada document "Recommended practices for calibration laboratories" :

NRC Recommended practices heading.jpg

The National Research Council of Canada list of conditions precedent to "reliability" is consistent with ISO 17025 and with the 2008 article by Hodgson. Their list of headings include:

  • environmental considerations (including electromagnetic interference)

  • environmental practices

  • documentary and operational protocols (including traceability of measurements, uncertainty list, measurement process control, calibration system, calibration records, intervals of calibration)

  • measurement capabilities (including a listing of its capabilities including parameters, ranges, and uncertainties along with details of the measurement equipment)

  • personnel

  • laboratory management tools

  • uncertainty budget template, and

  • calibration control charts

The National Research Council of Canada, under the heading "Documentary and Operational Protocols" states:

Test equipment and measurement standards should be calibrated at periodic intervals established and maintained to assure acceptable measurement uncertainty and reliability. Intervals should be shortened or may be lengthened when the results of previous calibrations indicate such action is necessary or sufficient to maintain acceptable reliability. ISO 10012-1 Annex A and NCSLI RP-1 Establishment and Adjustment of Calibration Intervals contain guidelines for the determination of calibration intervals for measuring equipment.

Reliability means the probability of equipment remaining in tolerance during the calibration interval, and for standards, the probability of the assigned value of the standard not changing by more than the list of uncertainties. In the client's laboratory, the list of uncertainties should include any uncertainty associated with drift rate. The procedure for assigning calibration intervals and adjusting them should be fully documented. The laboratory should have a fully-documented recall system for all its test equipment and standards to assure timely recalibrations.

The 2007 Justice Committee evidence and the 2008 article by Hodgson are consistent with the international standards for calibration laboratories and the National Research Council of Canada standards for calibration laboratories. The "Instrumental" definition of "reliability" used by Hodgson in the 2008 article is consistent with the National Research Council of Canada definition: "Reliability means the probability of equipment remaining in tolerance during the calibration interval, and for standards, the probability of the assigned value of the standard not changing by more than the list of uncertainties."

The 2007 Justice Committee evidence and the 2008 article by Hodgson are consistent with the International Standards for Evidential Breath Analyzers OIML R 126. Canada is a member state of OIML. Canadians have contributed to the updates to OIML R 126.

OIML R126 heading.jpg

OIML R 126 in Parts 1 and 2 includes:

metrological and technical requirements (including measuring range, maximum permissable errors for both type approval and in service, drift short-term and long-term, durability)

metrological controls and performance tests ("legal metrological control can consist of type approval, initial and subsequent verification, and metrological supervision" 

The Bibliography for OIML R 126 contains many international references, including:

[1] OIML V 2-200:2012 International vocabulary of metrology – Basic and general concepts and
associated terms (VIM)
[2] VIML:2000 International vocabulary of terms in legal metrology
[3] OIML G 1-100:2008 Evaluation of measurement data - Guide to the expression of uncertainty in
measurement (GUM). BIPM, IEC, IFCC, ISO, IUPAC, IUPAP and OIML
[4] The International System of Units (SI), 8th edition, BIPM, 2006
[5] OIML D 2:2007 (Consolidated edition) Legal units of measurement
[6] OIML D 11:2004 General requirements for electronic measuring instruments
[7] OIML D 31:2008 General requirements for software controlled measuring instruments

The 2007 Justice Committee evidence and the 2008 article are consistent with OIML R 126. Hodgson in 2008 writes about instrumental reliability as related to drift over time in accuracy and precision. Hodgson writes about an evaluation process that leads to type approval. Hodgson writes about metrological supervision: "monitored by qualified scientific personnel who ensure that a high quality is maintained." Hodgson writes about metrological supervision: "a regular program of preventative maintenance ensures that instruments will be in proper working order during field operations".

Please review the majority decision by Justice Deschamps in R. v. St‑Onge Lamoureux, 2012 SCC 57 (CanLII), [2012] 3 SCR 187, <https://canlii.ca/t/ftl1g>. The Court cited Hodgson, Brian T.  “The Validity of Evidential Breath Alcohol Testing” (2008), 41 Can. Soc. Forensic Sci. J. 83. The Court concluded that the Criminal Code presumptions in 258(1)(c) and (d.01) violated section 11(d) of the Charter citing Hodgson's 2008 article page 83:

[26]                          The Committee’s recommendations shed light on the circumstances that might explain how an instrument malfunctioned or was used improperly.  Thus, human error can occur when samples are taken and at various steps in the maintenance of the instruments, which, it should be mentioned, are used Canada‑wide.  Hodgson’s report, which the prosecution itself relied on as a source of the statutory amendments, refers to the importance of proper operation and maintenance:

                    . . . to achieve scientifically sound results in operational use, user agencies must ensure that approved instruments are operated by qualified personnel using procedures based on good laboratory practice. [p. 83]

Moreover, Parliament recognized the importance of following such practices and procedures in s. 258(1)(c) and s. 258(1)(d.01), since the accused can rebut the presumptions by showing that the instrument was not properly maintained or operated.

[27]                          However, Parliament did not adopt the Committee’s recommendations, and the prosecution referred to no alternative mechanisms that would enable a court to find that the instruments are generally maintained and operated properly or that the rate of failure attributable to improper maintenance or operation is insignificant.  The trier of fact could therefore entertain a reasonable doubt about the validity of the test results, since he or she will not have shown why they can be relied on in the case of the accused who is on trial.  But a judge who entertains such a doubt will nevertheless remain bound by the statutory presumptions and will be required to convict the accused unless the accused rebuts those presumptions in accordance with the requirements of s. 258(1)(c).  In view of the mechanism for applying the statutory presumptions established in s. 258(1)(c), I find that s. 258(1)(c) and s. 258(1)(d.01) infringe s. 11(d) of the Charter.

With the greatest of respect to Parliament and to the Alcohol Test Committee  there remains no empirical evidence, to this day, of "alternative mechanisms that would enable a court to find that the instruments are generally maintained and operated properly or that the rate of failure attributable to improper maintenance or operation is insignificant." 

 

The bottom line is that we continue to have no system of metrological supervision of police or provincial evidentiary breath testing systems in Canada."

Parliament does not permit the petroleum industry to pump gas without metrological supervision. Why does Parliament permit the police to conduct quantitative analysis for forensic purposes without metrological supervision? Below please see the Canadian government video on the Fairness at the Pumps Act and an example of a gas pump metrological supervision sticker. Why isn't there such a sticker on every Intoxilyzer and every wet-bath simulator used by police in Canada for forensic purposes?

Exh 36 gas pump sticker.jpg

Evidence given to the Justice Committee during consideration of Bill C-46

Bill C-2 in 2008 created a new presumption of accuracy/identity/reliability that was rebuttable by the defence raising a reasonalble doubt as to the reliability of the measurement result. The defence under Bill C-2 needed to look closely for evidence of operator error or instrument malfunction. The legislation, as construed and applied by the Supreme Court of Canada in St. Onge permitted a defence, if the measurement result was unreliable. To make full answer and defence on the issue of reliability, defence lawyers sought the disclosure of records and data related to that reliability.

Some participants in the system described Bill C-2 litigation as "disclosure wars". Some defence counsel sought disclosure without understanding the relationship of the disclosure sought to the reliability of the measurement results for their clients.

The police resisted. The prosecution resisted. Trial times got longer. Interest groups fighting drunk driving pushed hard and private members bills were introduced in Parliament (See Bill C-226 42-1 private member's bill, preceded by C-73 41-2 Conservative government Bill introduced June 16, 2015, preceded by an earlier private member's bill) . The approach to reliability evolved from Hodgson's good laboratory practice, to compliance with ATC "operational procedures set out in the document of the Alcohol Test Committee entitled Recommended Operational Procedures that is published on the Canadian Society of Forensic Science’s website" (C-73), to the three conditions precedent of the current Bill C-46 320.31. Bill C-46 deemed all individual approved instruments reliable in its "Recognition and declaration", even if AIs are used improperly, even if they are poorly maintained, and even if their measurement results are no longer reliable across the measuring interval. ISO 17025, OIML R 126, and the inquiries into miscarriages of justice in Ontario would be ignored.

In 2012 during St-Onge litigation, the Alcohol Test Committee published a "Position Paper". It is respectfully submitted that in the "Position Paper", the ATC surrendered many years of international measurement science, to prosecutorial, government, and interest group purposes of minimizing Crown disclosure, inconvenience to police, and trial time. It is conceded that litigation of sloppy procedure by police, uses up a great deal of police administration time, police witness time, Crown disclosure litigation time, and Court docket time. It is conceded that it is far simpler, and less time-consuming , for Courts to assume that forensic science by police is being done properly. It is conventional wisdom that approved instruments are reliable, most police officers are thorough, and drunk drivers kill people.

 

Take careful note of the References page of the 2012 Position Paper, image below. Every reference is to a paper published in Can. Soc. Forensic Sci. J.. Where are the international references to NHTSA, BIPM, CGPM, ISO, and OIML? Where is the vocabulary of VIM and VIML?

References in 2012 Position Paper.jpg

Take careful note of positions taken in the 2012 Position Paper, images below. Where are the footnotes? Where are the empirical studies to back up these bold assertions? Who are the members of the ATC taking this position and are any of them employed outside Canadian law enforcement, provincial labs, RCMP labs, or state labs? Is there a footnote showing a consensus with experts outside the Alcohol Test Committee? Where is the evidence of a consensus with or a connection with international science e.g. OIML R 126? Are these positions consistent with the recommendations coming out of the inquiries into miscarriages of justice in Ontario?

Position Paper p. 101 excerpt.jpg
Position Paper p. 102 top.jpg
Position Paper 102 bottom.jpg
Position Paper p. 103 bottom.jpg

Contrast the 2007 evidence by Hodgson leading up to Bill C-2 and the 2008 article, with that heard by the Commons Justice Committee leading up to Bill C-46.

Follow the link above and consider the points-of-view of groups that made submissions to the Justice Committee on September 20, 2017, September 25, 2017, and September 27, 2017. Did they advocate the fairness and science contemplated by the Motherisk Inquiry, or did they advocate for expeditious prosecution of alleged drunk drivers?

See the excerpt below from evidence of Dr. Daryl Mayers given to the Committee on September 25, 2017:

At (1535)

" There are some evidentiary matters that we'd like to comment on. The first thing I want to make clear for this committee is that the alcohol test committee thinks that any Canadian approved instrument is, by our very definition, accurate and reliable when operated properly according to our guidelines, and will provide accurate and reliable blood alcohol results at the time of testing. I've provided all our standards to this committee."

...

 

"Moving to the disclosure of information, the listed items in proposed subsection 320.34(1) are traceable to the ATC position paper, in which we said, “Any messages produced by the instrument during the subject breath testing procedure that indicate”—emphasis added here—“an exception or error has occurred should be provided and assessed to determine their impact, if any, on the breath test results. Messages produced at other times are not scientifically relevant and need not be reviewed.”"

Please think carefully about the statement "when operated properly according to our guidelines". Bill C-46 effectively mandates "type approval", but does not mandate "initial verification" or "subsequent verification" of individual instruments. Bill C-46 effectively mandates use of a 100 mg/100mls control and the use of an air blank, but does not mandate any other metrological controls, or more importantly, metrological supervision of the local police , or the provincial breath testing system. "Our guidelines", as used by Dr. Mayers in his Justice Committee evidence does not necessitate the good laboratory practice that Hodgson required as a condition precedent to reliability. The objective standard of good laboratory practice has evolved since 2012 into "our guidelines",  unenforceable norms and protocols, rather than good laboratory practice and the international science respecting reliability of measurements. The standard is, according to Dr. Mayer's evidence, what "the alcohol test committee thinks". Dr. Mayer provided copies of "all our standards to this committee". There is no suggestion in his evidence or in the Bill C-46 legislation, that the qualified technicians will be metrologically supervised by the Alcohol Test Committee, the respective provincial centre of forensic sciences, or the Courts.  The only reference to "traceability" is to the ATC position paper. There is no suggestion that measurement results must be in accordance with metrological traceability. The amended Criminal Code does not require compliance with "all our standards".

It is respectfully submitted that prior to the enactment of Bill C-46, the Justice Committee heard evidence from the Alcohol Test Committee and others based on technology and interest-driven policy, but not measurement science.

 

"Reliability" post-Bill-C-46 prioritizes technical evidence over science-based quantitative analysis for forensic purposes. Minimum technical evidence has been legislated by Parliament matching only some of the technical norms set by the Alcohol Test Committee. The mandated technical evidence does not preclude wrongful convictions. In particular, section 320.31 does not (to quote Justice Deschamps in St. Onge) guarantee "alternative mechanisms that would enable a court to find that the instruments are generally maintained and operated properly or that the rate of failure attributable to improper maintenance or operation is insignificant." Scientific evidence no longer has relevance to proof of reliability beyond a reasonable doubt, because the presumption of identity/accuracy/reliability cannot be rebutted by empirical fact and science.

The Weights and Measures Act, Magna Carta, and Canada's international metrological obligations were not addressed during the Justice Committee hearings leading up to Bill C-46.

 

The results of evidentiary breath testing in Canada have ceased to be "quantitative results" "for forensic purposes" as defined in  Report of the Motherisk Hair Analysis Independent Review. The Criminal Code, however, defines the delict using an alleged "quantitative result". This contradiction violates our constitution.

 

We have a serious constitutional problem. Criminal law counsel need help to prepare their Charter challenges and marshall expert evidence in every 80 and above prosecution.

Please note that such challenges will be difficult. Several learned authors have described extensive checks and balances within the hardware and firmware of Canada's approved instruments. Parliament and many Courts seem to have accepted, as a scientific fact, that the automated systems on approved instruments, combined with Parliament's minimum conditions precedent, cannot produce false or exaggerated positives that lead to innocent convictions. With the greates of respect, there is no empirical data and no international consensus among scientists, that supports that hypothesis. Technical opinions expressed by respected scientists are still technical opinions. The scientific validity of a technical opinion depends upon whether the norm that the technician is following fits good international science, and in this case, the international science of metrology. Defence lawyers therefore need all the help they can get in understanding the international science of metrology so that they can competently challenge inadequate quantitative analysis and prevent innocent convictions.

At the very least, every defence lawyer needs to work hard to challenge the evidence that the Crown relies upon to establish conclusive proof under 320.31(1). Defence lawyers need help in understanding ambient tests and control tests - the hands-on implications of that section. 

How We Can Help

Contact us at 905-273-3322 if you are a Canadian criminal defence lawyer and you need help developing a defence  to a DUI charge or a Charter challenge under Bill C-46.

 

A good starting point is to think about issues that can be raised during cross-examination of Crown witnesses. Over 40 years, we have learned how to build good defences and win DUI trials. Now we help our colleagues, throughout Canada,  find "evidence to the contrary" that is permitted under Bill C-46, and use expert evidence to displace "conclusive proof".

If you are a Canadian criminal defence lawyer, we can help you to defend a DUI in Canada through:

1. Online courses at Udemy

2. A free basic basic online course for Canadian defence lawyers only (go to Program List in the Menu above)

3. The Blog at this site (go to the Menu above)

  • including sample cross-examinations of Crown experts

  • including sample Argument

  • including Tips on challenging control test reliability under 320.31(1)(a)

  • including sample cross-examinations of Qualified Technicians

4. Hands-on training with evidentiary breath testing equipment

5. Private Consultation

 

Fruitful Areas for Cross-examination

The following are proper and relevant issues to be raised, and purposes for, cross-examinations on the scientific reliability of measurement instruments used for forensic purposes, including breath instruments and drug testing instruments. The blog at this site provides sample cross-examinations with these purposes:

 

To obtain admissions that the 2012 Alcohol Test Committee Position Paper:

- is a position paper

-is not a scientific article

-is not a research paper

-does not have any external references in international literature

-does not have any references outside of the CSFS Journal

-has no references to international metrology

-has positions not supported by empirical research

-is not scientific opinion, it is position

 

 

To obtain admissions that the opinion of the Crown expert (and indirectly the 2012 ATC Position Paper) that single point control test(s) at time of use are adequate to establish reliability is based upon a hypothesis that has no empirical study to support the hypothesis.

 

To challenge the assumption by the Crown expert (and indirectly the 2012 ATC Position Paper) of continued linearity of response in aging instruments.

 

To challenge the Crown to produce any empirical study that supports the Crown expert's (and the ATC's) hypotheses.

 

To ultimately suggest that the 2012 ATC Position Paper is not based on science, but rather policy.

 

 

 

To explore the analytical variability of the 8000C as determined by the Alcohol Test Committee during evaluation of the 8000C prior to type approval.

 

To compare the analytical variability of the individual 8000C used in the subject tests for the client with the analytical variability of the type or class 8000C determined by the Alcohol Test Committee.

 

To suggest that the instrument in the matter before the Court may no longer be a member of that class or type because it is no longer capable of maintaining the analytical variability of the type or class.

 

To suggest that the instrument in the matter before the Court may no longer have the linearity of the class or type 8000C because it no longer exhibits the linearity established during evaluation of the type or class.

 

To establish that we have some evidence,  that the linear kind of relationship, the created linear relationship that’s done by means of the calibration curve in terms of the – how the instrument works, in the case before the Court, we’ve got a possible interpretation that the relationship that normally should appear linear, the way that Ms. Martin found...is not linear.

 

To explain to the Court that creation of the calibration curve during factory calibration or re-calibration  of an 8000C instrument takes something which is inherently non-linear and turns the instrument  into a measuring device that can be used as if it were linear.

 

To suggest that if the instrument has lost that capability, over time, through drift, then the instrument ceases to be reliable and ceases to be a member of the type or class 8000C.

 

To confirm that when new instruments are being evaluated, various solutions are used between 50 and 400 mg/100mls.

 

To confirm that when new instruments are being evaluated, the specified accuracy requirement is  +/- 5 percent of the BAC with a precision requirement of +/- 3 mg/100mls under 100 mg/100mls and +/- 2.5 percent for readings greater than 100.

 

To confirm that the purpose of such evaluation is to ensure the accuracy and reliability of breath tests. This process is "type approval" in the international literature.

 

To obtain an admission that the manufacturer advertises that its instrument is accurate plus or minus 3 milligrams per 100 mls and standard deviation doesn’t exceed 3 milligrams per 100 mls.

 

To obtain an admission that under the ATC Best Practices document, new instruments must be individually inspected before being placed into service to ensure that they initially meet the manufacturer's specifications.

This process is "initial verification" in the international literature.

 

To obtain an admission that under the ATC Best Practices document, instruments in service must be individually inspected, periodically, to ensure that they continue to meet the manufacturer's specifications.

This process is "subsequent verification" in the international literature.

 

To obtain admissions as to the manufacturer's specifications for accuracy and precision in its advertising, in the information given to the evaluator during type approval, and in the servicing/maintenance documents given to the people who do work on these instruments on a regular basis.

 

To obtain an admission that although the local police service appears to be doing annual and periodic inspections, they are doing so without reference to the manufacturer's specifications for accuracy and precision across the measuring interval of the instrument.

 

 

 

To obtain an admission that when government scientists conduct quantitative analysis to determine blood alcohol concentration using blood, urine, or serum, they use positive and negative controls.

 

To obtain an admission from the government scientist that when they conduct such quantitative analysis they use a low control, an expected midpoint control, and a high control.

 

To obtain an admission from the government scientist that they would never use just one control at 100 mg/100mls.

 

To obtain an admission from the government scientist that using just one midpoint control would be unacceptable laboratory practice.

 

To suggest that use of only one mid-point control in a laboratory does not assist in checking linearity.

To suggest that use of only one mid-point control in a laboratory to obtain a quantitative analysis in a laboratory would not be in compliance with ASCLD/LAB accreditation.

 

To obtain an admission that if the bracketing controls failed then the result is at best qualitative rather than quantitative.

 

 

To establish that if there is an indication in the maintenance records that the instrument was taken out of service for consistently low checks, it is necessary to obtain disclosure or production of the contemporaneous documentation by the inspector, who made that decision, and the printouts obtained by the inspector from the Intoxilyzer to understand the context and significance of that decision to take the instrument out of service.

 

 

To suggest that there is empirical evidence in the matter before the Court of change in response by the approved instrument at the lower end of the measuring interval (reading much lower) and at the upper end of the measuring interval (reading slightly higher) without corresponding change in response at the single data point control test level.

To suggest that linearity has therefore changed, and in other words, the calibration curve programmed into the instrument, at the factory or on the last re-calibration, is no longer reliable.

 

To lay the foundation for the O'Connor order.

 

To connect the lack of multi-point calibration of an approved breath instrument with the lack of adequate multi-point calibration of the Elisa screening system (lack of multiple (5) calibrators) - the confusion of quantitative and qualitative analysis - criticized in the Motherisk Inquiry report.

 

To challenge the evidence of the government expert as to the adequacy of single point control tests to establish linearity in an instrument, that has not recently been re-calibrated across the measuring interval.

 

To suggest that the empirical evidence in the facts of this case - the annual inspections - supports the inference that the calibration curve has shifted, rotated, or stretched (or more correctly that although the learned calibration curve was fixed at time of last calibration, it is now different -shifted, rotated, or stretched, over time - from what the correct calibration curve would be if the instrument was properly re-calibrated) i.e. accuracy and precision have drifted over time.

 

 

 

To remind the Court, "thing 1" in 258(1)(c) is unconstitutional under Charter 11(d) (R v St-Onge) but is saved by section 1.

 

To remind the Court that 258(1)(c) is saved by section 1 because of Parliament's purpose which is weight consistent with scientific reliability.

 

To demonstrate to the Court that the SCC in St-Onge relied on the paper by Brian Hodgson. To bring that paper before the Court and make it an exhibit.

 

To ask the government scientist to concede the definition of "accuracy" in the Hodgson paper.

 

To ask the government scientist to concede the definition of "precision" in the Hodgson paper.

 

To ask the government scientist to concede the definition of "reliability" in the Hodgson paper, at least as it refers to instrumental reliability. The paper also contemplates other components of scientific reliability, i.e. good laboratory practice, see abstract.

 

To highlight the portion of the definition of "reliability" that contemplates "drift" ... "over time".

 

To demonstrate that such a definition requires empirical evidence of accuracy and precision at one time compared with accuracy and precision at a subsequent time.

 

To suggest that the ATC/CFS approach to determination of scientific reliability "at time of use" is not empirical - it is not an empirical approach and the approach is not supported by the scientific literature.

 

To suggest that the approach by the ATC/CFS of relying on a single data point control test,  to determine reliability, renders any analysis by the instrument "qualitative" rather than "quantitative".

 

To connect such misuse with the principles of the Motherisk Inquiry Report.

 

To lay the groundwork for the argument that Criminal Code forensic use of what Parliament contemplates is a quantitative analysis instrument, in a manner that only results in a instrument qualitative analysis will result in an unlawful search under Charter section 8. 

 

 

 

To explain to the Court, the differences between ABA (Esc Esc B) and ACA (Esc Esc C) sequences.

 

To confirm that ABA sequences are not recorded in COBRA data but ACA sequences are recorded in COBRA data.

To explain to the Court why the calibration checks at 40 or 50, 100, and 300 during annual inspections do not appear in COBRA data disclosed.

 

 

To obtain an admission from the government scientist that a review of the documents from 3 annual  inspections reveals a trend such that indications in the lower portion of the measuring interval are reading low and indications in the upper portion of the measuring interval are reading high, in other words, the response of the instrument to known levels of alcohol standard has drifted such that there has been a trend in change in the accuracy of the instrument.

 

To consider the alternative explanation that the inspectors are not following the same standard operating procedures during inspection from one annual inspection to the next.

 

To obtain an admission that further disclosure or production of information from the inspector  on the annual inspections is necessary to properly assess these anomalies.

 

To obtain an admission that the inspection procedure and use of the instrument continued even though the results were outside the low end of the range / tolerance.

 

 

 

To obtain an admission from the CFS scientist that the disclosed annual maintenance records indicate that the police failed to take any steps to correct control tests on inspection that indicated the instrument's response had shifted well beyond not only a 3 mg% tolerance, but well beyond a 10mg% tolerance.

 

To suggest to the CFS scientist that the calibration curve has shifted.

 

To suggest to the CFS scientist that the instrument's response is no longer as accurate and precise as it should be per manufacturer's specifications.

 

To suggest that police are not following their very generous 10 mg% tolerance SOPs.

 

To obtain an admission that measurement results on the instrument are no longer reliable.

 

To obtain an admission that the police did not stop use of the instrument and report the non-conformance to a superior.

 

 

 

To demonstrate that when the particular instrument was first placed into service, the tolerance verified by the independent authorized service centre for each of three test values was +/- 3 mg/100mls.

 

To demonstrate that the initial verification matched the manufacturer's published specifications of accuracy +/- 3 mg/100mls.

 

To demonstrate that when the particular instrument is subsequently being annually checked, by the police service rather than the independent service centre, at each of the three test values, the checklist indicates that the acceptable tolerance is now +/- 10 mg/100mls.

 

To demonstrate that the instrument's calibration is no longer being verified in accordance with the manufacturer's specifications.

 

To demonstrate that the police service is not adhering to the best practices document of the ATC.

 

 

To establish that "traceability" is a scientific concept used in Canada.

 

To define "traceabilty" in a Canadian context.

 

To establish that "calibration interval" is a scientific concept used in Canada.

 

To explain the two English meanings of "standard" by reference to the difference in French between "etalon" and "norme" in the NRC document in English and French.

 

 

 

To introduce the concept of "calibration interval" in the international literature.

 

 

 

To explain the function of internal standards, the ITP, internal test procedure to the Court.

 

To obtain an admission that the ITP system needs annual or periodic maintenance, just like the optical bench, so that the instrument can continue to function in accordance with manufacturer's specifications.

 

To obtain an admission that any adjustment or re-calibration of the optical bench also requires re-calibration of the internal standards.

 

 

To establish that the hypothesis by the ATC/CFS, that any drift in instrument response (what Hodgson describes as significant drift in accuracy and precision over time) will always be caught by a single point control test, is not supported by any empirical study.

 

To establish that there is no study abstracted in Wigmore on Alcohol that establishes the ATC/CFS hypothesis empirically.

 

To confirm that the new calibration curve created after a re-calibration compared with the old calibration curve prior to recalibration can move up, move down, move sideways, or rotate in either direction around an axis that may or may not be at 100 mg/100mls.

 

 

To explore the differences between a measurement instrument that has a linear relationship between the thing measured and the result v. a measuring instrument that has a calibration curve.

 

To search for an admission that the calibration curve can shift up or down, left or right, or rotate around a point over time.

 

To cross-examine the CFS expert on the lack of empirical study supporting the ATC/CFS hypothesis that a single point control test can always detect drift.

 

To obtain admissions about the differences between new instruments and aging instruments.

 

 

 

To lay the groundwork for the argument that traceability of the measurement results to the SI units is through the calibration of the individual instrument to reference standards - the étalons.

 

If reliability, requires traceability, then the Certificate of Calibration and the identity of the reference standards used during that calibration are relevant to the reliability of the measurement result.

 

 

 

To educate the Court about the calibration sequence run on the approved instrument at the factory.

To obtain an admission from the Crown expert that without the proper auto-calibration creation of a unique calibration curve, the instrument is not reliable.

 

 

To educate the Court about the Analytical Theory of the 8000C Optical Bench including Emitter, Sample Chamber, Dual Detectors, Inverse Logarithmic relationship, and building the Calibration Curve based on the theory that differing ethanol concentrations have differing % absorption of IR light.

 

To lay the groundwork for the importance of calibration and re-calibration respecting the reliability of any approved instrument.

 

To explain the auto-calibration function of the instrument that is run at the factory or the Authorized service Centre.

To lay the groundwork for why changes to the relationship between electrical signals coming off the detector and true indication result in drift in accuracy and precision, i.e. loss of reliability.

 

 

 

 

To obtain an admission that calibration or re-calibration needs to be done by an entity that is accredited by ASCLD/LAB ANLAB to ISO 17025 standards.

 

To obtain an admission that the local police service or local service centre which has conducted a re-calibration does not have such accreditation. The cross-examiner should have gone further on this issue to expand this line of questioning to Mega-Tech, Davtech, and GCS Technical Services.

 

 

To educate the Court as to the "why" of the unreliability of an approved instrument to measure across the measuring interval if it has not been recently calibrated, inspected, maintained, re-calibrated.

 

It seems strange to think that a modern "approved instrument" has to "learn" - that it has a kind of artificial intelligence. In reality it's true, an approved instrument has to learn the meanings of 67 mg/100mls, 94 mg/100mls, 117 mg/100mls, and 184 mg/100mls. The artificial intelligence uses extrapolation from its response during calibration to known values (from a NIST reference - un étalon with an unbroken chain of connection to SI units of the CGPM/BIPM in Paris) (maybe 0, 50, 100, 200, 300 or 0, 40, 80, 100, 300) that it is shown. This "calibration" is done by the calibrating or re-calibrating technician at the factory or Canadian Authorized Service Centre. A Certificate of Calibration is then prepared. This learning should never take place in the hands of the police. It should be done by a neutral entity that knows what it is doing and follows Standard Operating Procedures.

 

 

To connect evidentiary breath testing in Canada, the Criminal Code, and the Weights and Measures Act section 4(1) to the Metre Convention and the organizations created by the Metre Convention specifically the CGPM and the BIPM.

To establish the primacy of the CGPM/BIPM and its SI units and vocabulary in any consideration of measurement science in Canada and internationally.

 

To establish that Canada is a member state of the Metre Convention.

 

To lay the groundwork for an argument that there is a Principle of Fundamental Justice protection under Charter section 7 related to fair measurement in accordance with the international system of units, the SI units.

 

To the lay the groundwork for the principle that every measurement result must be traceable to the SI units.

 

 

To connect the concept of measurement standard, reference standard, étalon to Canadian law, Canadian constitutional law, and international measurement science.

 

To suggest to the Court that if measurement is a comparison, then it must always be a comparison to the international measurement standard, reference standard, étalon.

 

 

 

To develop the concept that, in metrology, accuracy is not a number. It is something that we work towards. It does not make sense to say that a particular measurement result "is accurate". We can take certain steps to encourage accuracy such as using the mean or average of many results. The proper approach is provide a measurement result that is as accurate as possible together with a statement of the uncertainty of the measurement.

 

 

 

To ultimately suggest that searches of breath are unreasonable and violate section 8 of the Charter, if police are using, for  forensic purposes,  "approved instruments" that are not capable of rendering  reliable "quantitative analyses".

To apply the findings and conclusions of the Motherisk inquiry Report in Ontario to evidentiary breath testing in Canada.

 

To establish why it is essential that approved instruments, in fact, be capable of conducting "quantitative analyses" as defined in the Motherisk Inquiry Report.

 

 

 

To connect the Criminal Code and its wording about concentration of alcohol in units of blood with the International system of SI units.

 

To establish the importance of SI units and their definitions according to the CGPM when construing and applying the Criminal Code of Canada, with respect to offences defined in terms of a concentration of alcohol in units of blood.

 

 

To connect "measurement" in Canadian evidentiary breath testing to "measurement" in the international literature, specifically the International Vocabulary of Metrology (the VIM Exhibit 18), referred to in most international scientific literature on measurement.

 

To define any measurement in Canada, including a measurement for a forensic purpose as a comparison.

 

To obtain admissions from the CFS scientist as to the applicability of the definitions in the VIM to the matter before the Court and the Criminal Code respecting:

 

measurement (as a comparison)

 

quantity

 

unit

 

metrology


calibration curve

 

metre & kilogram

 

 

To obtain an admission from the CFS scientist that the traceability of a measurement result on an approved instrument or a truck weigh scale is through the calibration of the instrument at the factory or a proper recent re-calibration by the manufacturer or factory authorized service centre. At the time of calibration a calibration curve is created to establish a relationship between the electrical signal coming off the detector in the AI or the weigh scale and the digital indication. That isn't done using controls at time of use.

 

To clarify that calibration of a gas chromatogaphy instrument  used for blood, urine, serum analysis is done quite differently at time of use. A calibration curve on a gas chromatograph is created electronically at time of use.

 

Traceability of a measurement result on an AI is therefore through the manufacturer's Certificate of Calibration or re-calibration certificate. The Certificate, reference standards, and methodology at the time of calibration or re-calibration are therefore relevant (and essential) to reliability of the measurement result.

 

 

 

To obtain admissions from a CFS scientist respecting the factors that influence reliability in a laboratory

To suggest that there are multiple components to "reliability"

 

To lay the groundwork for an argument that reliability means a lot more than a formula of two tests 15 minutes apart with 02 agreement and control tests between 90 and 110

 

To define scientific "reliability" using ISO 17025

 

 

To educate the Court about good laboratory practice.

 

To obtain an admission from the CFS scientist, that good laboratory practice requires contemporaneous documentation.

 

To obtain an admission from the CFS scientist that good laboratory practice requires that a technician stop, document, and report whenever an anomaly occurs.

 

To apply good laboratory practice to breath testing for a forensic purpose.

 

 

 

 

To further challenge the Crown's suggestion that the anomalous low cal. checks that occurred in this breath truck were not caused by a door opening from time to time in winter.

 

To support the O'Connor application for production of contemporaneous documentation by the QT who obtained the group of low cal. checks. Documentation would shed light on possible causes of the low cal checks, any troubleshooting attempted, and the likelihood that their cause was a problem with Intoxilyzer precision.

 

 

To use the cross-examination of the CFS scientist to educate the Court about Henry's Law.

 

 

To cross-examine a CFS scientist on use of Guth 2100 wet-bath simulator under Canadian cold operating conditions.

To build a case for O'Connor production of contemporaneous documentation by the QTs who obtained the groups of low cal. checks in the breath truck in winter.

 

During Direct Examination, the CFS expert had suggested in response to the Crown's request for the simplest explanation for anomalous low cal. checks, that the door being left open on the breath truck in winter could cause repeated cal. checks below 90. The purpose of this cross-examination was to suggest that if this was the case, then QTs of this police service are not using the simulator in accordance with manufacturer's recommendations for minimum ambient operating temperatures.

 

 

To obtain an admission from a CFS scientist that expectation of ATC Best Practices Recommendation is for annual inspection of wet-bath simulator to ensure it meets manufacturer's specifications.

 

To obtain an admission from a CFS scientist that manufacturer's specification for a Guth 2100 simulator is 34.00 +/- .05 degrees C, not just 34.0 +/- .2 degrees C.

 

 

To obtain an admission from a CFS scientist that uncertainty of measurement is not novel science.

 

 

To simplify the concept of Type A Uncertainty of Measurement to make it more understandable to a trial judge.

 

To obtain an admission from the CFS scientist that Uncertainty of Measurement is not novel science.

 

To explain calculation of average, precision, and standard deviation in simple math terminology.

 

To connect CFS documents that talk about coverage factor with the international literature of Uncertainty of Measurement.

 

 

To obtain admissions as to the differences in inspections, in inspection standard operating procedures, and completeness of an independent inspection v. an in-house annual or in-house periodic inspection by the local police service.

 

To establish that these inspections are inadequate unless accompanied by complete documentation - that needs to be produced on the O'Connor application.

 

 

To challenge the CFS expert's position that inconvenient data should be excluded for the purpose of calculating precision.

 

To obtain an admission that the local police service is not properly assessing accuracy and precision during periodic inspections because they are not assessing under stable conditions.

 

To illustrate the importance of an O'Connor order requiring production of officer's contemporaneous documentation at the time of the inconvenient data to determine the cause of the data that the CFS expert seeks to exclude, rather than speculating that the data is caused by something other than drift in accuracy and precision.

 

To consider the possibility that the recorded simulator temperatures (all exactly 3400) might be wrong and that there is a serious problem with documentation of simulator temperature.

 

 

To obtain an acknowledgement from a CFS scientist that even though he would exclude data outside  (Maximum Permissible Error) 90 to 110 in calculating precision, at least one police service in Ontario is using data outside 90 to 110 in calculations of precision during periodic inspection.

 

 

 

To challenge the opinion that data outside  maximum permissible error (outside +/- 10 mg%) should be excluded from any calculation of precision. The cross-examiner should have called evidence in reply from a statistician or other expert in outliers.

 

 

To establish a better methodology for calculating precision of an approved instrument in service.

To apply CFS methodology using control checks re calculation of uncertainty of measurement in blood/urine analysis to evidentiary breath testing.

 

 

To educate the Court as to the inadequacy of calculation of the instrument's precision by the local police service, close in time to the subject tests.

 

To obtain admissions from the CFS expert as to proper methods for calculating precision.

 

To confirm defence expert evidence that the local police had stopped doing linearity checks by the time of this periodic inspection.

 

 

To obtain admissions about the use of historical control test data by the Centre of Forensic Sciences in Toronto to calculate standard deviation and uncertainty of measurement.

 

To obtain an admission that the same approach could be used with historical data of Intoxilyzer control tests to prepare statistical data of accuracy and precision at different points in time so as to assess drift in accuracy and precision over time, in other words, reliability.

 

 

Confirming why disclosure of COBRA or other downloaded data is relevant to understanding the reasons why an instrument needed to be sent to the factory for re-calibration.

 

To establish the need for an O'Connor order to produce documentation of what was meant by "Consistently low cal checks in the maintenance log.

 

To establish the need for an O'Connor order to produce the technicians' contemporaneous documentation that went with the periodic inspections of 3 separate dates.

 

 

To establish non-compliance with the Standard Operating Procedure respecting entering accurate data into the tombstone data prior to a configuration of the alcohol standard or a subject test.

 

To establish improper use of the Esc Esc E function checking date and time.

 

To establish bad practice in recording or amending location data in the instrument.

 

To establish the unreliability of some of the information on the Intoxilyzer Test Record notwithstanding Criminal Code section 258(1)(f.1).

 

 

To explore the lack of a lab setting when accuracy and precision of the instrument are checked on periodic or annual inspection.

 

To explore the lack of Standard Operating Procedures when accuracy and precision of the instrument are checked on periodic or annual inspection.

 

 

To challenge the Crown's assertion that the AI will automatically shut down if anything is out of tolerance or ATC or manufacturer's specifications.

 

 

To remind the Court of the concept of "reliability" used by the SCC in St-Onge.

 

To educate the Court as to the definitions of "accuracy", "precision", and "reliability" used by Brian Hodgson in his paper relied on by the SCC in St-Onge.

 

To focus on drift in accuracy and precision over time from:

the manufacturer's specifications,

and/or the accuracy and precision of the 8000 that was evaluated,

and/or this specific instrument when first placed into service,

as compared with accuracy and precision close to time of use.

 

 

To support argument that the Maintenance History shows that the instrument was taken "out of service", for "consistently low cal. checks" and as a result "requires calibration". Can the matter not be distinguished from Vallentgoed where the maintenance log revealed that the instrument was taken out of service for routine maintenance and periodic re-calibration?

 

To support argument that the Maintenance History reveals that the instrument was taken out of service for a specific problem. Can the matter not be distinguished from Jackson para 135 (see green, orange, and blue highlighting below)?

 

To suggest that there is a problem with the CFS / ATC approach to assessing accuracy and precision if this instrument needed to be taken out of service - the instrument passed the CFS / ATC criteria and yet was taken out of service for some mysterious reason.

 

To suggest that full documentation of the mysterious reason should be the subject matter of an O'Connor order.

 

 

 

To distinguish R. v. Jackson on the basis of a difference in facts. The instrument in Jackson was new. See Jackson paragraph 135 highlight in red. The instrument in the matter before the Court was about 6 years old.

 

 

To suggest that ATC/CFS scientists cannot provide any scientific opinion of the reliability of aging instruments out in the field without conducting an empirical study of instruments sampled from the field.

 

To suggest that ATC/CFS scientists have no idea whether or not instruments in the field are performing in accordance with manufacturer's specifications.

 

To identify the lack of any system of "verification" in Canada that instruments in the field are performing in a manner similar to the instruments originally evaluated and given type approval.

 

To contrast the evaluated accuracy and precision of instruments evaluated by the ATC with actual accuracy and precision of instruments in the field.

 

To suggest that unlike gas pumps and retail meat scales, in Canada, we have no system in place to control "verification" that an individual instrument conforms to "type approval" of an approved instrument.

 

To suggest that in Canada we have no system of mandatory periodic verification of individual instruments in the field to ensure that they conform to type approval.

 

 

 

To obtain admissions respecting the inadequacy of ATC / CFS recommendations in requiring "stability of metrological characteristics" over time.

 

To obtain admissions that the Diagnostics test function only checks stability over a few seconds at best, not over weeks, months, or years following calibration by the manufacturer.

 

To underline the concept of "over time" in Hodgson's definition of "reliability".

 

 

To challenge the ATC hypothesis or policy that "each test stands on its own".

 

To identify the hypothesis as faith or policy, not scientific opinion.

 

To demand the wording of the hypothesis and the empirical testing methodology if it is a scientific opinion.

 

To identify exactly what other anchoring information ATC/CFS considers essential to reliability notwithstanding this sweeping statement.

 

To identify exactly what other information they label irrelevant.

 

To obtain an admission that this is not scientific opinion.

 

To educate the Court as to the difference between scientific opinion and technical opinion.

 

To separate the difference between a priori logical opinion and an opinion based on empirical science.

 

To identify the lack of empirical studies using "sampling" of aging instruments in the field.

 

To establish that the ATC Position Paper is not a consensus document generally accepted by all forensic toxicologists.

 

To introduce the concepts of "metrological control" and "metrological supervision" to the Court.

 

 

To establish that the international literature indicates that all of the approved instrument's software is legally relevant to reliability of the measuring system.

 

To distinguish "audit trail" (e.g. COBRA data) from instrument software (e.g. source code)

 

 

To identify that the international standard for MPE for instruments in service, 6 mg% at target 100 is much tighter than 10 mg%.

 

To identify that the international standard for MPE for instruments after repair is tighter than instruments in service.

To raise the concept of MPE after repair and in service at various target values across the measuring interval.

 

 

To show that the ATC recommendations for operational procedures at time of use do not account for the need during inspections to regularly conduct control tests at target values other than 100 mg/100mls.

 

To demonstrate that we have no metrological supervision to ensure that linearity is checked, that manufacturer's specifications are honoured across the measuring interval.

 

To demonstrate that searches of breath using"approved instruments" are unreasonable in Canada if there is no system in place to supervise and audit police maintenance of their instruments.

 

 

To suggest that an AI is a quantitative analysis instrument and an ASD is a qualitative analysis instrument and suggest that the Crown/CFS are confusing this distinction as happened at the Motherisk Lab.

 

To suggest that such confusion, if it persists, will lead to unconstitutionality of various Criminal Code sections or section 7 and 8 Charter violations.

 

 

To neutralize the CFS scientist's assertion that anomalous data should be excluded from calculation of precision.

 

 

To establish that the ASTC/CFS is not sampling from aging instruments out in the field tpo determine error rates.

 

To establish that the ATC/CFS is not allowing for drift in precision of instruments as they age without re-calibration.

 

To suggest possible acceptable or normal error rates.

 

 

To obtain an admission that the ATC Position Paper of 2012 contradicts the federal government policy in the Fairness at the Pumps Act.

 

 

 

 

To separate conceptually: control tests from calibration.

 

To obtain an admission that there are no "assessors" in the province of Ontario.

To obtain an admission that the historical maintenance records show a deterioration of performance - deterioration of linearity in this particular instrument.

 

The strategy of using control tests as indication of reliability depends upon completeness of records and transparency.

 

To obtain an admission that at the bottom of the valley in the infrared spectrum at approximately 9.4 microns, your detection limit will certainly be degraded and precision will also suffer in most instances, if you are no longer taking the reading at the absorbant’s maximum.

 

To obtain an admission as to what may happen if the detector becomes dirty.

 

 

To obtain admissions from the Crown expert to enable argument that Vallentgoed can be distinguished on its facts - particularly respecting:

- recent re-calibration on a regular calibration interval

- calibration by a service provider independent of the police.

 

 

To introduce the concept of "calibration interval".

 

To obtain admissions as to the importance of calibration interval in the international scientific literature.

 

To obtain an admission that neither the ATC/CFS nor the manufacturer  mandate a calibration interval for approved instruments, though the manufacturer so specifies for ASDs.

 

To introduce some international standards on reliability including ISO 17025.

 

To introduce the concept of "uncertainty growth".

 

To connect "reliability", "calibration interval", and "uncertainty growth" "over time".

 

 

To obtain admissions that the published studies dealing with the linearity of approved instruments assume a new instrument recently calibrated by the manufacturer.

 

 

To explore the reasons why measurement instruments in the field may deviate from the linearity alleged by the Beer-Lambert law

To introduce a university textbook dealing with inter alia:

 

External Calibration

Creating a Calibration Curve

Limits to Beer's law

No longer linear when the molar absorptivities differ

       

Instrumental Deviations from Beer-Lambert law

Polychromatic Radiation rather than Monochromatic IR

 

 

To suggest that aging filters at the end of the sample chamber result in changes in bandwidth and more polychromatic light so less linearity.

 

To expose over-simplification by Crown experts.

 

To obtain admissions that the concept of single point control test(s) at time of use,  is adequate to verify that calibration has not changed over time,  is not good measurement science.

 

To obtain admissions that checks of linearity during annual maintenance or other periodic inspection are necessary to confirm linearity, to confirm that the instrument is still calibrated across the whole measuring interval. 

 

To obtain an admission that although the Beer-Lambert Law suggests that the relationship between concentration in the sample chamber and the measurement result is linear (after adjusting for the logarithmic relationship of absorption/transmittance) is linear, there are instrumental deviations in the Beer-Lambert Law.

 

 

To separate the concepts of "calibration" from "control checks".

 

To clarify that "calibration" is something that happens at the factory, not at time of use by a qualified technician.

 

To clarify that control tests at time of testing are simply a verification (to use the CFS scientist's words) that calibration hasn't changed over time (note Hodgson concept of "over time" in his paper referred to in St-Onge).

 

 

To educate the Court about the meaning of "traceability" in measurement science.

 

To obtain an admission that there is a relationship between the calibration certificate (Certificate of Calibration) from the factory and the reference standards used during the factory calibration.

 

To obtain an admission that there is a relationship between the calibration certificate from the factory and the scientific reliability of the measurement result at time of use.

 

To introduce the NIST Certificate for the reference standards used at the time of calibration at the factory.

If you are a defence lawyer or attorney and you need help in drafting a cross-examination using some of these issues and purposes, please contact us at 905-273-3322. Online Courses and Continuing Education Programmes are also available.

Please find below, a simple explanation of the creation of the Intoxilyzer 8000C calibration curve at the factory or during re-calibration by the Canadian Authorized Service Centre. This video is an excerpt from one of our online courses for defence lawyers.