[AI Policy] Quizzes!!!

_bookdown.yml

@@ -25,9 +25,9 @@ rmd_files: ["index.Rmd",
             "03f-Determining-AI-Needs-interface.Rmd",
             "03g-Determining-AI-Needs-evaluation.Rmd",
             "04a-AI_Policy-intro.Rmd",
-            "04b-AI_Policy-how_to_navigate.Rmd",
             "04b-AI_Policy-ai_regs_and_laws.Rmd",
-            "04c-AI_Policy-data_laws.Rmd",
+            "04c-AI_Policy-how_to_navigate.Rmd",
+            "04d-AI_Policy-data_laws.Rmd",
             "04e-AI_Policy-creating_your_ai_policy.Rmd",
             "About.Rmd",
             "References.Rmd"]

coursera_quizzes/04-AI_Policy_overall_quiz.md.yml

@@ -0,0 +1,116 @@
+
+- typeName: multipleChoice
+  prompt: What are examples of user agreements?
+  options:
+    - answer: Commercial agreements
+      isCorrect: false
+      feedback: This is one such example of user agreements but there is more
+    - answer: Enterprise agreements
+      isCorrect: false
+      feedback: This is one such example of user agreements but there is more
+    - answer: Intellectual agreements
+      isCorrect: false
+      feedback: Intellectual agreements were not something we described as an example of a user agreement
+    - answer: Both A and C
+      isCorrect: false
+      feedback: Intellectual agreements were not something we described as an example of a user agreement
+    - answer: Both A and B
+      isCorrect: true
+      feedback: Yes! These are both examples of user agreements
+    - answer: All of the above
+      isCorrect: false
+      feedback: Intellectual agreements were not something we described as an example of a user agreement
+
+- typeName: multipleChoice
+  prompt: Which of the following were NOT a topic we discussed that may be a part of an AI policy?
+  shuffleOptions: true
+  options:
+    - answer: Governance and Oversight
+      isCorrect: false
+      feedback: Education and Training was considered a part of effective AI policies
+    - answer: Education and Training
+      isCorrect: false
+      feedback: Education and Training was considered a part of effective AI policies
+    - answer: Pricing points for customers
+      isCorrect: true
+      feedback: This was not a part of an AI policy
+    - answer: Feedback and Review
+      isCorrect: false
+      feedback: Feedback and Review was considered a part of effective AI policies
+
+- typeName: multipleChoice
+  prompt: Which of the following are legitimate pieces of advice your should adhere to regarding AI policy?
+  options:
+    - answer: Always consult your legal council about the AI regulations that apply to you.
+      isCorrect: false
+      feedback: This is true, but there's more
+    - answer: It is not enough to build a policy, support systems need to be in place to support individuals in their ability to follow that policy.
+      isCorrect: false
+      feedback: This is true, but there's more
+    - answer: You should seek advice from a variety of experts and sources when building a comprehensive AI policy
+      isCorrect: false
+      feedback: This is true, but there's more
+    - answer: A and B are true
+      isCorrect: false
+      feedback: A and B are true, but there's more
+    - answer: B and C are true
+      isCorrect: false
+      feedback: B and C are true, but there's more
+    - answer: All of the above are true
+      isCorrect: true
+      feedback: Yes! All of these above are true statements!
+
+- typeName: multipleChoice
+  prompt: What is one concern around the use of copyrighted data to train AI models?
+  shuffleOptions: true
+  options:
+    - answer: The models may produce biased results
+      isCorrect: false
+      feedback: Bias is important to look out for but is not necessarily related to copyrighted data
+    - answer: The models may violate intellectual property rights
+      isCorrect: true
+      feedback: Correct, this has and will continue to be a concern
+    - answer: The models may be insecure
+      isCorrect: false
+      feedback: Security is important for but is not necessarily related to copyrighted data
+    - answer: The models will use too much computer processing power
+      isCorrect: false
+      feedback: Efficient computing is important but is not necessarily related to copyright data
+
+- typeName: multipleChoice
+  prompt: What does the text recommend to allow an AI policy to stay relevant as technology changes quickly?
+  shuffleOptions: true
+  options:
+    - answer: Update it daily
+      isCorrect: false
+      feedback: Daily would be a lot to do. This isn't what was recommended.
+    - answer: Make it a short-term policy only
+      isCorrect: false
+      feedback: This isn't what was recommended. What would happen after that policy expired?
+    - answer: Create it as an ongoing living document
+      isCorrect: true
+      feedback: Yes! Continue to modify and update the policy to better meet the changing needs and landscape of AI
+    - answer: Don't create a policy at all
+      isCorrect: false
+      feedback: This wouldn't help! Policy is needed!
+
+- typeName: multipleChoice
+  prompt: An effective AI policy...
+
+  shuffleOptions: true
+  options:
+    - answer: Is agile and readily adjusted as the landscape of technology changes
+      isCorrect: false
+      feedback: This is true, but there is more
+    - answer: Is accompanied by training, education and infrastructure
+      isCorrect: false
+      feedback: This is true, but there is more
+    - answer: Has been created by a team of experts weighing in
+      isCorrect: false
+      feedback: This is true, but there is more
+    - answer: Discusses how bias and discrimination is being monitored
+      isCorrect: false
+      feedback: This is true, but there is more
+    - answer: All of the above should be included with an effective AI policy!
+      isCorrect: true
+      feedback: Correct! All of the above are items that should be included with an effective AI policy!

coursera_quizzes/04b-AI_Policy-ai_regs_and_laws_quiz.md.yml

@@ -0,0 +1,39 @@
+
+- typeName: multipleChoice
+  prompt: What is the main goal of the EU's AI Act according to policymakers?
+  shuffleOptions: true
+  options:
+    - answer: To ban all AI systems
+      isCorrect: false
+      feedback: Incorrect, it does not ban all AI systems
+    - answer: To limit the capacity of AI systems to cause harm
+      isCorrect: true
+      feedback: Correct! THat is the goal of the EU's AI act
+    - answer: To standardize AI systems across Europe
+      isCorrect: false
+      feedback: It would be difficult and impractical to standardize AI systems at this point in time
+    - answer: To tax companies using AI systems
+      isCorrect: false
+      feedback: EU's AI act does not really concern itself with taxation
+
+- typeName: multipleChoice
+  prompt: True or False - All open-source software is excluded from EU Act regulations
+  options:
+    - answer: True -- open source software is always exempt
+      isCorrect: false
+      feedback: There was an exception - go back and see the chapter
+    - answer: False -- high risk open source software applications are not exempt
+      isCorrect: true
+      feedback: Correct. High risk open source software are not exempt
+
+
+- typeName: multipleChoice
+  prompt: Which of these statements is true about the EU AI act?
+  shuffleOptions: true
+  options:
+    - answer: There are exceptions to the facial scraping ban that allow law enforcement and intelligence agencies to use AI applications for facial recognition purposes.
+      isCorrect: true
+    - answer: AI software for manipulative strategies like deepfakes and automated disinformation campaigns are allowed under certain conditions.
+      isCorrect: false
+    - answer: Companies do not need to disclose to customers if they are using AI tools.
+      isCorrect: false

coursera_quizzes/04c-AI_Policy-how_to_navigate_quiz.md.yml

@@ -0,0 +1,35 @@
+
+- typeName: multipleChoice
+  prompt: True or false - The author recommends having only technical experts like data scientists and AI researchers on an AI oversight team.
+  shuffleOptions: true
+  options:
+    - answer: True
+      isCorrect: false
+      feedback: This is not recommended. Many types of expertise are needed on an AI oversight team besides technical experts.
+    - answer: False
+      isCorrect: true
+      feedback: Correct. Many types of expertise are needed on an AI oversight team besides technical experts.
+
+- typeName: multipleChoice
+  prompt: Which of the following were not individuals listed as part of an AI team?
+
+  shuffleOptions: true
+  options:
+    - answer: Legal council
+      isCorrect: false
+      feedback: Legal council WERE listed as a part of an AI team
+    - answer: Policy and governance analysts
+      isCorrect: false
+      feedback: Policy and governance analysts WERE listed as a part of an AI team
+    - answer: Data protection officers
+      isCorrect: false
+      feedback: Data protection officers WERE listed as a part of an AI team
+    - answer: Ethicists and oversight board members
+      isCorrect: false
+      feedback: Ethicists and oversight board members WERE listed as a part of an AI team
+    - answer: Marketers
+      isCorrect: true
+      feedback: Correct, markerters were NOT listed as a required part of an AI team
+    - answer: Trainers and educators
+      isCorrect: false
+      feedback: Trainers and educators WERE listed as a part of an AI team

coursera_quizzes/04d-AI_Policy-data_laws_quiz.md.yml

@@ -0,0 +1,48 @@
+
+- typeName: multipleChoice
+  prompt: What does copyright protect?
+  shuffleOptions: true
+  options:
+    - answer: Ideas for new inventions
+      isCorrect: false
+      feedback: That isn't what copyright covers
+    - answer: The exclusive right to publish or reproduce artistic material
+      isCorrect: true
+      feedback: Yes! This is underneath copyright!
+    - answer: Software code
+      isCorrect: false
+      feedback: Software code is not underneath copyright
+    - answer: Scientific discoveries
+      isCorrect: false
+      feedback: Scientific discoveries are not underneath copyright
+
+- typeName: multipleChoice
+  prompt: What type of information is covered under special data privacy protections?
+  shuffleOptions: true
+  options:
+    - answer: Social media posts
+      isCorrect: false
+      feedback: Social media posts are not underneath data privacy protections
+    - answer: Personal health information
+      isCorrect: true
+      feedback: Yes! PHI is underneath data privacy protections!
+    - answer: Public government reports
+      isCorrect: false
+      feedback: Public government reports are not underneath data privacy protections
+    - answer: News articles
+      isCorrect: false
+      feedback: New articles are not underneath data privacy protections
+
+- typeName: multipleChoice
+  prompt: Who is most likely legally liable if an AI system was inherently flawed in its philosophy?
+  shuffleOptions: true
+  options:
+    - answer: The end user of the AI system
+      isCorrect: false
+      feedback: The end user didn't put the inherent flaw in the system
+    - answer: The developer of the open source training model used
+      isCorrect: false
+      feedback: How a training model is used is not necessarily the original developers fault
+    - answer: The designer or manufacturer of the system
+      isCorrect: true
+      feedback: Yes. The designer or manufacterer of the AI system is likely liable for the inherent flaws.

coursera_quizzes/04e-AI_Policy-creating_your_ai_policy_quiz.md.yml

@@ -0,0 +1,51 @@
+
+- typeName: multipleChoice
+  prompt: According to the text, what should an AI policy support system include in addition to the policy itself?
+  shuffleOptions: true
+  options:
+    - answer: Guidelines on best practices only
+      isCorrect: false
+      feedback: Guidelines is a start, but there are other items that also should be included
+    - answer: Infrastructure to handle AI only
+      isCorrect: false
+      feedback: Infrastructure is a start, but there are other items that also should be included
+    - answer: Training materials only
+      isCorrect: false
+      feedback: Training materials are a start, but there are other items that also should be included
+    - answer: Guidelines, infrastructure, and training materials
+      isCorrect: true
+      feedback: Yes! AI policy support systems should include all of these things
+
+- typeName: multipleChoice
+  prompt: Who should be involved in creating a comprehensive AI policy?
+  shuffleOptions: true
+  options:
+    - answer: Chief Data Officer's office only
+      isCorrect: false
+      feedback: This office should be involved, but others should be involved as well
+    - answer: IT department only
+      isCorrect: false
+      feedback: IT should be involved, but others should be involved as well
+    - answer: Legal department only
+      isCorrect: false
+      feedback: Legal department should be involved, but others should be involved as well
+    - answer: Representatives from legal, IT, compliance, governance, diversity offices, etc.
+      isCorrect: true
+      feedback: Yes! All of these individuals are persons who should be involved in policy making! And potentially more individuals.
+
+- typeName: multipleChoice
+  prompt: What should training on an AI policy focus on?
+  shuffleOptions: true
+  options:
+    - answer: Explaining every detail of the policy
+      isCorrect: false
+      feedback: It is not practical and unnecessary for every person to understand every detail of policy
+    - answer: Outlining the key points to consider and detailing who they should consult for guidance
+      isCorrect: true
+      feedback: Yes outlining what they need to know and encouraging communication with the proper channels is a great training strategy
+    - answer: Punishments for non-compliance
+      isCorrect: false
+      feedback: Punishments aren't a good idea if you'd like people to effectively be able to follow AI policy
+    - answer: Using scare tactics about AI going wrong
+      isCorrect: false
+      feedback: Scare tactics aren't probably what people need most in a training session

quizzes/04-AI_Policy_overall_quiz.md

@@ -0,0 +1,48 @@
+
+{quiz, id: policy_overall, attempts: 10}
+
+## AI Policy Overall quiz
+
+? What are examples of user agreements?
+a) Commercial agreements
+b) Enterprise agreements
+c) Intellectual agreements
+d) Both A and C
+E) Both A and B
+f) All of the above
+
+? Which of the following were NOT a topic we discussed that may be a part of an AI policy?
+a) Governance and Oversight
+b) Education and Training
+C) Pricing points for customers
+d) Feedback and Review
+
+? Which of the following are legitimate pieces of advice your should adhere to regarding AI policy?
+a) Always consult your legal council about the AI regulations that apply to you.
+b) It is not enough to build a policy, support systems need to be in place to support individuals in their ability to follow that policy.
+c) You should seek advice from a variety of experts and sources when building a comprehensive AI policy
+d) A and B are true
+e) B and C are true
+F) All of the above are true
+
+? What is one concern around the use of copyrighted data to train AI models?
+a) The models may produce biased results
+B) The models may violate intellectual property rights
+c) The models may be insecure
+d) The models will use too much computer processing power
+
+? What does the text recommend to allow an AI policy to stay relevant as technology changes quickly?
+a) Update it daily
+b) Make it a short-term policy only
+C) Create it as an ongoing living document
+d) Don't create a policy at all
+
+? An effective AI policy...
+
+a) Is agile and readily adjusted as the landscape of technology changes
+b) Is accompanied by training, education and infrastructure
+c) Has been created by a team of experts weighing in
+d) Discusses how bias and discrimination is being monitored
+E) All of the above should be included with an effective AI policy!
+
+{/quiz}

quizzes/04b-AI_Policy-ai_regs_and_laws_quiz.md

@@ -0,0 +1,22 @@
+
+{quiz, id: regs_laws, attempts: 10}
+
+## AI Regulations and Laws quiz
+
+? What is the main goal of the EU's AI Act according to policymakers?
+a) To ban all AI systems
+B) To limit the capacity of AI systems to cause harm
+c) To standardize AI systems across Europe
+d) To tax companies using AI systems
+
+? True or False - All open-source software is excluded from EU Act regulations
+a) True -- open source software is always exempt
+B) False -- high risk open source software applications are not exempt
+
+? Which of these statements is true about the EU AI act?
+A) There are exceptions to the facial scraping ban that allow law enforcement and intelligence agencies to use AI applications for facial recognition purposes.
+b) AI software for manipulative strategies like deepfakes and automated disinformation campaigns are allowed under certain conditions.
+c) Companies do not need to disclose to customers if they are using AI tools.
+
+
+{/quiz}

quizzes/04c-AI_Policy-how_to_navigate_quiz.md

@@ -0,0 +1,19 @@
+
+{quiz, id: building_a_team, attempts: 10}
+
+## Building a team to guide your AI use quiz
+
+? True or false - The author recommends having only technical experts like data scientists and AI researchers on an AI oversight team.
+a) True
+B) False
+
+? Which of the following were not individuals listed as part of an AI team?
+
+a) Legal council
+b) Policy and governance analysts
+c) Data protection officers
+d) Ethicists and oversight board members
+E) Marketers
+f) Trainers and educators
+
+{/quiz}