Introduction
Artificial intelligence (AI) refers to the capacity of machines to perform tasks that are typically associated with human decision-making. AI computer systems use a variety of datasets and sensory inputs to make decisions in real time and to modify future decisions with additional data and experience with minimal human intervention or additional programming. In conjunction with machine learning, AI touches on nearly all aspects of modern life. As digital technologies take the place of certain human activities, legal disputes surrounding AI are inevitable.
Already, such issues have reached both federal and state courts. Judges are tackling emerging AI issues and creating case law that will impact the future course of technological innovation. For example:
In these and other cases, judges must understand the role that AI and machine learning play in the legal system itself. Lawyers, as well as judges and their staff, use machine learning to improve case law searches for relevant legal authority to cite in briefs and decisions. Document production and technology-assisted reviews use AI to search for relevant documents to produce and to mine those documents for the information most important to a partys claims without attorneys having to review every document. Some scholars and practitioners are already using AI to predict the outcome of cases based on algorithms based on tens of thousands of prior cases. Recent research suggests that such outcome predictions may have around a 70% accuracy rate. AI is ushering in a new era of quantitative legal decision forecasting.2
AI is ushering in a new era of quantitative legal decision forecasting.
In short, courts face no small task in: identifying the legal and ethical issues at stake, including concerns about transparency, due process, and data privacy; understanding the AI technology at issue in order to make sound legal rulings; and appreciating the potential implications of legal rulings on future technological advances and individual rights.
With that in mind, it is vital to improve judges ability to understand the technical issues in AI-related litigation. There are several things court systems and professional organizations should do to enhance the technical capabilities of judges:
A variety of strategies are available to educate judges on the AI-related technology at issue in a litigation. These include the use of science or technology tutorials, court-appointed technical advisers or special masters, and court-appointed experts.
I have written previously on the use of technology tutorials to allow judges to ask the parties, experts, or technical advisers to identify and educate a judge about scientific and technological issues central to a litigation. The goal of a technology tutorial is to transform the courtroom into a classroom. Tutorials may include a demonstration of how a certain method, software, or product works, an overview of key technical terminology, or a presentation of how a certain innovation developed over time. Judges may request, or the parties may recommend, live presentations by one or more experts or by the parties, question and answer sessions, or videotaped tutorials or demonstrations. Tutorials provide a forum for judges to ask questions about AI technology outside the context of the parties advocating on behalf of a particular motion or at trial.
[S]afeguards should be added to ensure that there is limited opportunity for technical advisers to introduce bias into the judicial decision-making process.
In addition, federal judges have the authority to appoint technical advisers, use specially trained clerks, or request special masters to provide them with the technical expertise they need. These advisers usually do not testify at trial; their role is to educate the judge on technical issues involved in a case. To avoid any undue influence and to ensure that the parties views on science and technology are given proper weight, safeguards should be added to ensure that there is limited opportunity for technical advisers to introduce bias into the judicial decision-making process. These safeguards include limiting the scope of case-specific materials that a technical adviser reviews or analyzes and defining the content and nature of any scientific or technical help to be provided to the judge. Technical adviser appointments are mentioned in federal case law as early as 1950, and their use is becoming increasingly common.
Finally, judges may appoint experts for exceptional circumstances and particularly complex AI issues in a litigation. Judges may appoint such experts on a partys motion or on the judges own initiative. A court-appointed expert must advise all parties of any findings, may be deposed by any party, may be called to testify at trial, and can be subjected to cross examination by any party.3 While still fairly novel, court-appointed experts have been used in a number of litigations, and their use is becoming more common.
Regardless of the strategy used, it is crucial that the process provides technical information and expertise to judges in as neutral a fashion as possible. Sound, subsequent judicial decision-making is best served by an educational, neutral delivery of information on AI through a tutorial, technical adviser, or court-appointed expert. While it may seem counter to the underpinnings of our adversarial system, the judge should require that the parties work together to provide the court with mutually agreed-upon recommendations on the format, topics, and ideal presenters for tutorials, or a joint list of potential technical advisers, or court-appointed experts (should one be needed).
These methods, however, should not be read to preclude the parties from putting forth their own, separate expert witnesses at trial. Moreover, it is important that, regardless of the strategy used, these methods conform to the basic expectation underlying the adversary system that, with limited exceptions, judges should not receive advice and guidance without the parties to the dispute having an opportunity to contest that advice and guidance.
In addition to the practices outlined above, court systems and professional organizations should undertake research and pilot programs for the judiciary to explore other strategies that may be useful in assisting judges in developing the technical understanding needed for AI-related lawsuits. One example would be a pilot program to conduct technology tutorials at the appellate level. To date, trial court judges have been the primary users of tutorials. Scholars and judges alike have questioned the reliability of technical information obtained by judges informally outside the existing factual record, including information that has appeared in appellate and Supreme Court decisions. Providing tutorials on key AI-related issues to appellate judges may reduce reliance on non-validated resources, such as amicus briefs, that have not undergone third-party fact checking or materials that have not been subjected to cross examination by the parties at trial. Tutorials may help limit the perceived need for judges and clerks own independent research to supply additional facts in appellate decisions.
[G]iven the need for technical expertise in AI-related litigations, specialized technical courts may provide a viable solution in some instances.
Another proposal that has re-emerged recently is the creation of expert panels or science courts with special jurisdiction to hear complex scientific or technological disputes.4 Some judges, legislators, and legal scholars have argued that technically trained judges or panels should decide scientific issues instead of generalist judges or layperson juries to ensure that the scientific or technological components of litigation are decided correctly by those with the relevant expertise. Though this concept remains controversial, the idea of science or technology courts has gained renewed interest in our increasingly complex world. Further research is warranted to explore whether these panels meet our societal expectations of judicial fairness and process. It is also unclear whether complex scientific issues can be separated from policy and legal issues that arise, as well as which court should decide these issues where they overlap. As AI makes its way into all aspects of our daily lives, it may be seen as unreasonable to take away general courts (and juries) role in legal decisions surrounding AI. Nonetheless, given the need for technical expertise in AI-related litigations, specialized technical courts may provide a viable solution in some instances.
Initiatives to provide judges with the technical understanding needed for AI-related litigation are unlikely to succeed without support from the parties involved in a dispute and their counsel. It is important for state bars and other legal professional organizations to familiarize attorneys with the broader implications of AI-related legal cases and the methods that they can suggest to judges to provide them with neutral information on AI.
Attorneys may be understandably hesitant to recommend to either their client or a judge the use of tutorials, technical advisers, or other strategies with which they are unfamiliar. However, education of not just the judiciary but other legal professionals can help ensure their necessary buy-in to implement existing strategies, to participate in pilot programs of new approaches, and to assist judges in receiving technological understanding needed for sound judicial decision-making.
AI professional organizations and their members should work together to provide additional educational opportunities and resources to both federal and state courts. There are a number of models that professional organizations can follow to provide valuable assistance and technical expertise to judges generally. The Federal Judicial Center, the research and education agency of the federal judiciary, provides information to and educates judges on areas of emerging science and technology through written pocket guides, online tutorials and modules, and in-person workshops. The legal community often relies on the centers Reference Manual on Scientific Evidence to better understand and evaluate the relevance and reliability of scientific and technical evidence being proffered by experts in litigation.5 The centers new Technology and the Bench initiative will help provide federal judges with critical information on areas where technology and legal issues overlap. In addition, the National Academies of Sciences provides valuable opportunities for members of the judiciary (and the technology community) to discuss areas of emerging technology that are likely to appear in lawsuits.
AIs pervasive nature will require coordination among a variety of technology professionals to educate the public about AI and machine learning.
It is essential that AI professional organizations and relevant stakeholders join in these efforts and work together to develop additional neutral, educational content to the courts. Providing judges with silos of subject matter-specific training is unlikely to be effective, as AI reaches into all aspects of lifedata privacy, financial transactions, transportation, human health and safety, and the delivery of goods and services. AIs pervasive nature will require coordination among a variety of technology professionals to educate the public about AI and machine learning.
AI professionals should also consider developing a universal glossary of key technical terms or a basic set of general reference materials designed specifically to provide the judiciary with general background on AI that would be broadly applicable, regardless of any particular case assignment. Reference manuals on other science and technology-related topics have proven highly effective in delivering useful content to judges.6
In addition, AI professional organizations should consider forming a technical adviser referral system or panel that is available to assist judges or arbitrators in cases with unique AI issues. Such a panel or referral system, when requested, could provide judges with the names of potential independent AI experts, including computer scientists, engineers, data analysts, and software programmers. The American Association for the Advancement of Science assists the legal profession by providing an independent expert referral system for issues related to science. This type of system could be adapted to address AI-related technical expertise needs of judges. However, additional research is needed to assess whether judges are aware of this resource, how frequently judges have used this resource, and any changes that could improve its usefulness to them.
Finally, skilled individuals with technical expertise must be able to convey effectively, to judges and juries, relevant key concepts in their respective fields. This means that data scientists, programmers, and software developers will need training in communicating with lay audiences about the key aspects of the technology likely to be at issue in AI-related lawsuits. This is especially true given recent findings of low public literacy on topics related to technology generally and AI concepts in particular.
Others have written extensively on the costs and benefits of judicial policymaking, and that is not the focus of this policy brief. Nonetheless, it bears repeating that when legislators, policymakers, and regulators fail to anticipate and act on issues of emerging technology, judges are left in the unfortunate position of being the first branch of government to evaluate new issues related to AI.
[W]hen legislators, policymakers, and regulators fail to anticipate and act on issues of emerging technology, judges are left in the unfortunate position of being the first branch of government to evaluate new issues related to AI.
Legislation guided by sound policy considerations would establish means to provide courts with the guidance they need to avoid setting legal precedent that unintentionally stifles technological advancement on the one hand, or improperly interferes with individuals freedoms, safety, privacy, or right to fair compensation for harm on the other. Because both state and federal law impact AI-related litigation, actors at the state and federal level must work together to try to ensure federal and state policies and legislation are aligned. That would help address AI issues while also elevating the level of expertise available to decision-makers.
The Brookings Institution is a nonprofit organization devoted to independent research and policy solutions. Its mission is to conduct high-quality, independent research and, based on that research, to provide innovative, practical recommendations for policymakers and the public. The conclusions and recommendations of any Brookings publication are solely those of its author(s), and do not reflect the views of the Institution, its management, or its other scholars.
Microsoft provides support to The Brookings InstitutionsArtificial Intelligence and Emerging Technology (AIET) Initiative, and Google provides general, unrestricted support to the Institution. The findings, interpretations, and conclusions in this report are not influenced by any donation. Brookings recognizes that the value it provides is in its absolute commitment to quality, independence, and impact. Activities supported by its donors reflect this commitment.
Follow this link:
How to improve technical expertise for judges in AI-related litigation - Brookings Institution
- 001 Stem Cell Treatment Anti Aging - Video [Last Updated On: November 13th, 2011] [Originally Added On: November 13th, 2011]
- 002 Veterinary Preventive Medicine | College of Veterinary ... [Last Updated On: May 19th, 2015] [Originally Added On: May 19th, 2015]
- 003 Department of Public Health Sciences - Loyola University ... [Last Updated On: May 19th, 2015] [Originally Added On: May 19th, 2015]
- 004 American College of Preventive Medicine [Last Updated On: May 19th, 2015] [Originally Added On: May 19th, 2015]
- 005 Stritch School of Medicine Department of Preventive ... [Last Updated On: May 22nd, 2015] [Originally Added On: May 22nd, 2015]
- 006 Home | Stony Brook University Medical Center [Last Updated On: May 22nd, 2015] [Originally Added On: May 22nd, 2015]
- 007 Preventive healthcare - Wikipedia, the free encyclopedia [Last Updated On: May 22nd, 2015] [Originally Added On: May 22nd, 2015]
- 008 Preventative Medicine - Nurse Practitioner at Northeast ... [Last Updated On: June 13th, 2015] [Originally Added On: June 13th, 2015]
- 009 preventative medicine | Michigan Associates of Acupuncture ... [Last Updated On: June 19th, 2015] [Originally Added On: June 19th, 2015]
- 010 Department of Preventive Medicine [Last Updated On: June 22nd, 2015] [Originally Added On: June 22nd, 2015]
- 011 What is Preventive Medicine? American College of ... [Last Updated On: July 2nd, 2015] [Originally Added On: July 2nd, 2015]
- 012 Preventive Medicine - Miami Children's Hospital [Last Updated On: July 7th, 2015] [Originally Added On: July 7th, 2015]
- 013 Preventive Medicine Residency and Fellowship (PMR/F)|CDC [Last Updated On: August 1st, 2015] [Originally Added On: August 1st, 2015]
- 014 American Board of Preventive Medicine - a Member Board ... [Last Updated On: August 5th, 2015] [Originally Added On: August 5th, 2015]
- 015 U.S. Preventive Medicine - OurMission [Last Updated On: August 5th, 2015] [Originally Added On: August 5th, 2015]
- 016 Nicklaus Children's Hospital - Preventive Medicine [Last Updated On: August 29th, 2015] [Originally Added On: August 29th, 2015]
- 017 Preventive Medicine Residency Program, Program Director ... [Last Updated On: September 15th, 2015] [Originally Added On: September 15th, 2015]
- 018 Preventive Medicine | Student Health Center | SIU [Last Updated On: October 17th, 2015] [Originally Added On: October 17th, 2015]
- 019 Internal Medicine Doctors St. Louis | Holistic Doctors St ... [Last Updated On: October 30th, 2015] [Originally Added On: October 30th, 2015]
- 020 Preventive Medicine - Residencies - Family Medicine and ... [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 021 Home - LLUMC Preventive Medicine Residency Program [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 022 UAB - Division of Preventive Medicine - Home [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 023 Preventive Medicine 2015 - Home Page [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 024 Preventive Medicine Residency Program, University of ... [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 025 Preventive Medicine: A Student Resource Page [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 026 Preventive Medicine Residency with UCSF | UC Berkeley School ... [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 027 Preventive Medicine | Center for Health Promotion | Loma ... [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 028 Preventive medicine - Dictionary.com [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 029 American Journal of Preventive Medicine - ScienceDirect.com [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 030 Preventive Medicine - Home [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 031 Preventive Medicine - facebook.com [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 032 "M*A*S*H" Preventative Medicine (TV Episode 1979) - IMDb [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 033 Preventative vs. Preventive - Daily Writing Tips [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 034 Home - Army Public Health Center [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 035 Epidemiology : Department of Preventive Medicine: Feinberg ... [Last Updated On: August 4th, 2016] [Originally Added On: August 4th, 2016]
- 036 Preventive Medicine Residency Program: Epidemiology ... [Last Updated On: August 13th, 2016] [Originally Added On: August 13th, 2016]
- 037 Preventive Medicine Residency at the University of Michigan ... [Last Updated On: August 13th, 2016] [Originally Added On: August 13th, 2016]
- 038 American Board of Preventive Medicine [Last Updated On: August 13th, 2016] [Originally Added On: August 13th, 2016]
- 039 Resources for Medical Students - American College of ... [Last Updated On: August 13th, 2016] [Originally Added On: August 13th, 2016]
- 040 Preventive Medicine - Free E-Books [Last Updated On: August 15th, 2016] [Originally Added On: August 15th, 2016]
- 041 Giraffe Preventative Medicine Guidelines - American ... [Last Updated On: August 31st, 2016] [Originally Added On: August 31st, 2016]
- 042 Vitamin and Mineral Supplements in the Primary Prevention ... [Last Updated On: September 15th, 2016] [Originally Added On: September 15th, 2016]
- 043 Pain Medicine 2017 | Pain Medicine Conferences | Pain ... [Last Updated On: October 5th, 2016] [Originally Added On: October 5th, 2016]
- 044 Mount Sinai Health System - New York City | Mount Sinai ... [Last Updated On: October 29th, 2016] [Originally Added On: October 29th, 2016]
- 045 UT Southwestern, Dallas, Texas - UTSW Medicine (Patient ... [Last Updated On: November 15th, 2016] [Originally Added On: November 15th, 2016]
- 046 Preventive healthcare - Wikipedia [Last Updated On: November 18th, 2016] [Originally Added On: November 18th, 2016]
- 047 Tobacco use continues in UP - UpperMichigansSource.com [Last Updated On: July 12th, 2017] [Originally Added On: July 12th, 2017]
- 048 Tulane gets $12M for Lassa fever animal studies - Lexington Herald Leader [Last Updated On: July 12th, 2017] [Originally Added On: July 12th, 2017]
- 049 Diabetes Health in The News: Teens and 60-Year- Olds Do the Same Level of Physical Activity - Diabetes Health (press release) [Last Updated On: July 12th, 2017] [Originally Added On: July 12th, 2017]
- 050 Drinking More Coffee Leads to a Longer Life, Two Studies Say - wnep.com [Last Updated On: July 12th, 2017] [Originally Added On: July 12th, 2017]
- 051 3 Reasons Entrepreneurs Should Consider the Opportunities in Healthcare - Entrepreneur [Last Updated On: July 12th, 2017] [Originally Added On: July 12th, 2017]
- 052 Preventative Medicine: Get a Health Check for Your SIEM - Security Intelligence (blog) [Last Updated On: July 12th, 2017] [Originally Added On: July 12th, 2017]
- 053 Prevent issues through lifetime of medical care - The Lima News - Lima Ohio [Last Updated On: August 1st, 2017] [Originally Added On: August 1st, 2017]
- 054 Research Affirms the Health Benefits of Elizabeth Bennet's Favorite Exercise - Verily [Last Updated On: August 1st, 2017] [Originally Added On: August 1st, 2017]
- 055 Norwalk grad comes home as new family physician - Norwalk Reflector [Last Updated On: August 1st, 2017] [Originally Added On: August 1st, 2017]
- 056 10 Things You Never Knew About Chakras By Patricia Mercier - FemaleFirst.co.uk [Last Updated On: August 3rd, 2017] [Originally Added On: August 3rd, 2017]
- 057 Crosstalk: It's time to stop the nonsense - Dalles Chronicle [Last Updated On: August 3rd, 2017] [Originally Added On: August 3rd, 2017]
- 058 Prevent issues through lifetime of medical care - Lima Ohio [Last Updated On: August 3rd, 2017] [Originally Added On: August 3rd, 2017]
- 059 Pharma and proactive, preventative healthcare: how to use the pharmacy channel - pharmaphorum [Last Updated On: August 3rd, 2017] [Originally Added On: August 3rd, 2017]
- 060 CHI St. Luke's heading to Valley Ranch in far northeast Houston area - Chron.com [Last Updated On: August 3rd, 2017] [Originally Added On: August 3rd, 2017]
- 061 Tommy Thompson: Congress has a Golden Opportunity on Health Care - WisBar [Last Updated On: August 4th, 2017] [Originally Added On: August 4th, 2017]
- 062 Planning underway for combined medical engagement in Angola with Ohio, Serbia - U.S. Africa Command (press release) [Last Updated On: August 4th, 2017] [Originally Added On: August 4th, 2017]
- 063 Tonawanda medical practice thinks holistically, despite insurance challenges - Buffalo News [Last Updated On: August 4th, 2017] [Originally Added On: August 4th, 2017]
- 064 LETTER: HMSA and Primary Care Physicians - Big Island Now [Last Updated On: August 4th, 2017] [Originally Added On: August 4th, 2017]
- 065 Smartphone app may help older adults manage serious mental illness and chronic health conditions - Medical Xpress [Last Updated On: August 16th, 2017] [Originally Added On: August 16th, 2017]
- 066 Business Briefcase published 08-13-17 - Helena Independent Record [Last Updated On: August 16th, 2017] [Originally Added On: August 16th, 2017]
- 067 Trump administration halts study on coal mining's impact on health - Roanoke Times [Last Updated On: August 24th, 2017] [Originally Added On: August 24th, 2017]
- 068 Family medicine residents worked their way to Victoria - Victoria Advocate [Last Updated On: August 24th, 2017] [Originally Added On: August 24th, 2017]
- 069 Alternative medicine: An opportunity for patients to be seen and heard - Rappahannock News [Last Updated On: August 24th, 2017] [Originally Added On: August 24th, 2017]
- 070 Will Navicent McDonalds stay or go? | 13wmaz.com - 13WMAZ [Last Updated On: August 24th, 2017] [Originally Added On: August 24th, 2017]
- 071 The latest federal guidelines on prostate cancer screenings are important - The Hill (blog) [Last Updated On: August 24th, 2017] [Originally Added On: August 24th, 2017]
- 072 One Vet's Opinion On Marijuana As Medicine For Your Pet - The Fresh Toast [Last Updated On: August 24th, 2017] [Originally Added On: August 24th, 2017]
- 073 Final Fantasy XV is heading into the Animus with Assassin's Creed DLC - Critical Hit [Last Updated On: August 25th, 2017] [Originally Added On: August 25th, 2017]
- 074 Scarce Public Health Funds Block Social Determinants of Health Aid - RevCycleIntelligence.com [Last Updated On: August 25th, 2017] [Originally Added On: August 25th, 2017]
- 075 Why People May Have Pig Organs Inside Them One Day - TIME [Last Updated On: August 26th, 2017] [Originally Added On: August 26th, 2017]
- 076 Whole Genome Sequencing Reveals Actual Disease Risk in Healthy Adults - Medical News Bulletin [Last Updated On: August 26th, 2017] [Originally Added On: August 26th, 2017]
- 077 Science Weighs in On How Fat Raises Cancer Risk - Montana Standard [Last Updated On: September 2nd, 2017] [Originally Added On: September 2nd, 2017]
- 078 Skin imaging company moves from Arizona to Portsmouth - WMUR Manchester [Last Updated On: September 2nd, 2017] [Originally Added On: September 2nd, 2017]
- 079 What We Know About Medical Marijuana's Effect On Heart Disease - The Fresh Toast [Last Updated On: September 2nd, 2017] [Originally Added On: September 2nd, 2017]
- 080 The Heart and Medical Center welcomes new physician - Durant Daily Democrat [Last Updated On: September 2nd, 2017] [Originally Added On: September 2nd, 2017]