4 Threat 2: Information Disruption 4 Threat 2: Information Disruption

4.1 Background on AI-based Dis- and Mis-Information 4.1 Background on AI-based Dis- and Mis-Information

  • Guiding Questions
    • What are the technical reasons for inaccurate content produced by LLMs?
    • Does disinformation constitute an existential risk? 
    • How does disinformation impact other risks associated with AI?
  • Pre-class exercise
    • Review the current status of AB 2098 in California.
  • In-class exercise
    • In groups, go through Parts III.B. and III.C.1.i-ii McDonald v. Lawson, 2022 U.S. Dist. LEXIS 232798 and identify the following:
      • Court’s definition of misinformation and disinformation
      • Court’s application of First and Fourteenth Amendment
      • Court’s analysis of the state’s compelling interest
    • Evaluate the likelihood of a bill regulating the use of AI with the intent of stemming dis- and mis-information withstanding First and Fourteenth Amendment scrutiny. 

 

4.1.1 Guiding Questions 4.1.1 Guiding Questions

  • What are the technical reasons for inaccurate content produced by LLMs?
  • Does disinformation constitute an existential risk? 
  • How does disinformation impact other risks associated with AI?

4.1.2 Readings (Recommended and Assigned) 4.1.2 Readings (Recommended and Assigned)

Required

  • Craig S. Smith, Hallucinations Could Blunt ChatGPT's Success, IEEE SPECTRUM (Mar. 13, 2023), https://spectrum.ieee.org/ai-hallucination
    • Entire article is informative; does a good job defining what hallucinations are in the context of AI/ LLM
      • Possible class discussions about whether the name hallucinations is logical? Is it misleading? 

 

  • Chris Barankiuk, Why We Place Too Much Trust in Machines, BBC (Oct. 19, 2021), https://www.bbc.com/future/article/20211019-why-we-place-too-much-trust-in-machines
    • Automation complacency is explained; possible in class discussion about how automation complacency could evolve as AI evolves, and what impacts that may have on society. 

 

  • Alina Polyakova, Weapons of the Weak: Russia and AI-driven Asymmetric Warfare, BROOKINGS (Nov. 15, 2018), https://www.brookings.edu/research/weapons-of-the-weak-russia-and-ai-driven-asymmetric-warfare/
    • Good article on AI use in warfare
      • Possible discussion about whether AI warfare costs should be increased so that it is less obtainable? Would that make a difference in the ability of countries to obtain those resources?
  • Amelia Glaese et al., IMPROVING ALIGNMENT OF DIALOGUE AGENTS VIA TARGETED HUMAN JUDGEMENTS, ARXIV (2022), available at https://arxiv.org/pdf/2209.14375.pdf 
    • Personally not a huge fan of this one; it is a bit overwhelming to digest.

Recommended

    • Quinton Temby, Colourless Green Content: AI, Disinformation and Geopolitical Risk, LOWY INSTITUTE, (Sept. 9, 2020), https://www.lowyinstitute.org/the-interpreter/colourless-green-content-ai-disinformation-geopolitical-risk\
      • Easily understandable artcile on AI unintelligence. Can be used to spark conversation about how likely students think they would be able to tell the difference between a ChatGPT written article and a human written article; were there any signs that helped students decide their answers?

 

4.1.3 Exercise 4.1.3 Exercise

 

  • In groups, go through Parts III.B. and III.C.1.i-ii McDonald v. Lawson, 2022 U.S. Dist. LEXIS 232798 and identify the following:
    • Court’s definition of misinformation and disinformation
    • Court’s application of First and Fourteenth Amendment
    • Court’s analysis of the state’s compelling interest
  • Evaluate the likelihood of a bill regulating the use of AI with the intent of stemming dis- and mis-information withstanding First and Fourteenth Amendment scrutiny.

4.2 Disinformation 4.2 Disinformation

  • Guiding Questions
    • How will improvements in AI tools exacerbate the risks posed by disinformation?
    • Why are the risks posed by disinformation in the context of AI distinct from those posed by other sources?
    • Is disinformation best thought of as a local, national, or global issue?
  • Pre-class exercise
    • Outline your legal and policy responses to the following hypothetical.
  • In-class exercise
    • In groups:
      • discuss your responses and compare them with those offered by Villasenor (you’ll find his analysis of the risks posed by AI-empowered disinformation as well as his solutions here).
      • analyze how Villasenor characterizes the type of AI risk at issue and determine whether he does so accurately and comprehensively

 

4.2.1 Guiding Questions 4.2.1 Guiding Questions

 

  • How will improvements in AI tools exacerbate the risks posed by disinformation?
  • Why are the risks posed by disinformation in the context of AI distinct from those posed by other sources?
  • Is disinformation best thought of as a local, national, or global issue?

4.2.2 Readings (Recommended and Assigned) 4.2.2 Readings (Recommended and Assigned)

Required

  • [Read up to Part 4] Josh Golstein et al., Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations, ARVIX (2023), https://arxiv.org/pdf/2301.04246.pdf

 

  • Katerina Sedova et al., AI and the Future of Disinformation Campaigns: Part 2, CSET (2021), available at https://cset.georgetown.edu/wp-content/uploads/CSET-AI-and-the-Future-of-Disinformation-Campaigns-Part-2.pdf
    • Read pages 1-4; skim 6-42; read 43-58.
      • Possible in class discussion about the process in which the media can report disinformation; how to sort through disinformation?
  • Major D. Nicholas Allen, Deepfake Fight: AI-Powered Disinformation and Perfidy Under the Geneva Conventions, 3, NOTRE DAME J. ON EMERGING TECH. (2022), available at https://ndlsjet.com/wp-content/uploads/2022/11/JET-_-Vol.-3-2-_-Allen.pdf
    • Start at the bottom of page 11

Recommended

  • Seth D. Baum, Superintelligence Skepticism as a Political Tool, 9 INFORMATION (SPECIAL ISSUE) 209 (2018), available at https://www.mdpi.com/2078-2489/9/9/209
    • Begin reading at section 2; spark conversation on skepticism and how to possibly combat it. 
  • Alejo Jose G. Sison et al., ChatGPT: More than a "Weapon of Mass Deception" Ethical Challenges and Responses from the Human-Centered Artificial Intelligence Perspective, SSRN (2023), available at https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4423874
    • Read pages 4-23

 

4.2.3 Exercise 4.2.3 Exercise

 

    • In groups:
      • discuss your responses and compare them with those offered by Villasenor (you’ll find his analysis of the risks posed by AI-empowered disinformation as well as his solutions here).
      • analyze how Villasenor characterizes the type of AI risk at issue and determine whether he does so accurately and comprehensively.

4.3 Cyber 4.3 Cyber

4.3.1 Guiding Questions 4.3.1 Guiding Questions

    • How do recent AI developments make cyberattacks—a long-known risk—into an existential risk?
    • To what extent can pre-existing cybersecurity-related regulations and laws mitigate the threats posed by AI-enabled cyberattacks?

4.3.2 Readings (Recommended and Assigned) 4.3.2 Readings (Recommended and Assigned)

Required

  • Ben Buchanan et al., AUTOMATING CYBER ATTACKS, CSET (2020), available at https://cset.georgetown.edu/publication/automating-cyber-attacks/
    • Pages 2-10 for introduction/vocabulary; Conclusion contains questions that may spark in class discussion--article provides some preliminary assessment. 
  • [Skim 10-25, read 26-33 and 36-36. The remainder is optional]. Algorithms and Terrorism : The Malicious Use of Artificial Intelligence for Terrorist Purposes, UNCCT & UNICRI (2021), available at https://www.un.org/counterterrorism/sites/www.un.org.counterterrorism/files/malicious-use-of-ai-uncct-unicri-report-hd.pdf
    • Agree with the reading assignment, especially the figure on page 14 which differentiates AI, ML, and DL. 
      • Given the dangers of the possible attacks, thinking about how the law should come into the picture and place restrctions/how to lessen the possibility of these attacks could be a class discussion. 
  • [skim 13-60] Arthur Gustave Henri Duforest, To What Extent Can Cyberattacks Constitute A Global Catastrophic Risk? (2021) (M.A. Thesis Aalborg University), available at https://projekter.aau.dk/projekter/files/421001366/MT___Arthur_Duforest.pdf
    • Discussion about the dangers of military use of AI; how far should the military go when use of cyberattacks; at what point does it become TOO catastrophic?

Reccomended

  • [read "1. Digital / Physical Domain" for useful background and refresher and insights on cyber] Jessica Cussins Newman, TOWARD AI SECURITY, CLTC (2019), available at https://cltc.berkeley.edu/wp-content/uploads/2019/02/Toward_AI_Security.pdf
    • How should the law interfere when it comes to using biological components as possible destruction tactics; is this where the line should be drawn? Should biological components be strictly accessible to the medical field only for advances in regards to health? 
  • Shahar Avin & S.M. Amadae, Autonomy and Machine Learning at the Interface of Nuclear Weapons, Computers and People, in, 1, THE IMPACT OF ARTIFICIAL INTELLIGENCE ON STRATEGIC STABILITY AND NUCLEAR, 105 (Vincent Boulanin ed., 2019), available at https://api.repository.cam.ac.uk/server/api/core/bitstreams/893b8921-73e7-44e1-b442-ad63295bcb56/content
    • Skim beginning pages; read pages 12-14 to have insight on some policy discussion. 

 

4.3.3 Exercise 4.3.3 Exercise

 

    • Review "Introduction" and "Discussion on Research Questions" from Blessing Guembe et al., The Emerging Threat of AI-Driven Cyber Attacks: A Review, 36 App. Art. Intell. (2022), https://www.tandfonline.com/doi/full/10.1080/08839514.2022.2037254
      • Discuss policy and legal responses to AI-augmented cyberattacks of the following sort: password guessing/password cracking (brute-force attack),” intelligent captcha/manipulation, smart abnormal behavioral generation, AI model manipulation, and smart fake reviews generation