Merge pull request #28 from fhdsl/cansavvy/moar-moar-quizzes

[Avoiding Harm] Quizzes!

quizzes/02a-Avoiding_Harm-Overall_quiz.md

@@ -0,0 +1,55 @@
+
+{quiz, id: avoiding_harm_overall, attempts: 10}
+
+## Avoiding Harm - Overall Quiz
+
+? Which of the following is TRUE?
+
+a) Unintended harm is okay because it wasn't intended
+b) AI systems are unbiased and should be used to address human biases
+C) Evaluate new AI tools for biases throughout its development and use
+d) AI tools are accessible and useful in an equitable sense
+
+
+? What is one potential issue with using AI systems that lack interpretability?
+
+A) It can be unclear why the system made a certain decision
+b) The systems always behave as expected
+c) There are no risks associated with using them
+d) They cannot be trusted for any applications
+
+? According to the material, what should be considered at every stage of AI system development and use?
+
+a) Funding sources
+b) Model usage
+C) Ethical implications
+d) Marketing strategies
+
+? What can help reduce issues with faulty AI responses?
+
+a) Never questioning the accuracy of AI responses
+b) Relying completely on AI tools without human review
+c) Assuming AI tools reflect current best practices
+D) Cross-checking responses from multiple AI tools
+
+? Why is transparency important when using AI systems?
+
+a) It builds user trust in the systems
+b) It facilitates public monitoring and feedback
+c) It enables better understanding of AI-assisted decisions
+D) All of the above
+
+? What should be done to mitigate algorithmic bias?
+
+a) Nothing, AI systems are inherently unbiased
+B) Train models on more diverse and inclusive data
+c) Disable safety checks that restrict harmful content
+d) Rely completely on AI systems for decision-making
+
+? What helps ensure user compliance to standards for AI use?
+a) Complex, frequently changing policies
+b) Generic training materials
+c) Self-education by users
+D) Relevant training content
+
+{/quiz}

quizzes/02b-Avoiding_Harm-concepts_quiz.md

@@ -0,0 +1,27 @@
+
+{quiz, id: societal_impact, attempts: 10}
+
+## Societal Impact Quiz
+
+? Which of the following is NOT considered a major ethical consideration discussed in the material?
+
+a) Security and privacy issues
+b) Climate impact
+C) Efficiency of the AI project
+d) Inadvertent harm
+
+? What does the concept of "AI paternalism" refer to?
+
+A) Trusting an AI system over human judgment or patient experiences in healthcare
+b) The use of AI systems as replacements for human parents
+c) Regulations restricting the development of advanced AI systems
+d) Biases inherent in AI systems against certain groups
+
+? According to the material, which of the following can help reduce potential harms from AI systems?
+
+a) Assuming AI systems will behave as expected in all situations
+b) Implementing new AI solutions quickly without extensive testing
+c) Avoiding transparency about AI system development
+D) Involving diverse perspectives in discussions of intended uses
+
+{/quiz}

quizzes/02c-Avoiding_Harm-algorithms_quiz.md

@@ -0,0 +1,32 @@
+
+{quiz, id: algorithms, attempts: 10}
+
+## Algorithms Quiz
+
+? What is one potential issue with using AI systems that lack interpretability?
+A) It can be unclear why the system made a certain decision
+b) The systems always behave as expected
+c) There are no risks associated with using them
+d) They cannot be trusted for any applications
+
+? According to the material, which of the following can help reduce issues with faulty AI responses?
+a) Never questioning the accuracy of AI responses
+b) Relying completely on AI tools without human review
+c) Assuming AI tools reflect current best practices
+D) Cross-checking responses from multiple AI tools
+
+? What does the term "hallucinate" refer to in the context of AI systems?
+
+a) AI systems having visions or dreams
+B) AI systems making up information based on artifacts of their algorithms
+c) AI systems malfunctioning due to hardware issues
+d) AI systems being trained on datasets containing hallucinogens
+
+? What recent real-world example demonstrates issues with faulty AI responses?
+
+a) AI systems spreading misinformation on social media
+b) An AI system beating the world chess champion
+C) A website banning AI-generated code that provided incorrect answers
+d) AI systems writing biased news articles
+
+{/quiz}

quizzes/02d-Avoiding_Harm-adherence_quiz.md

@@ -0,0 +1,24 @@
+
+{quiz, id: adherence, attempts: 10}
+
+## Adherence Quiz
+
+? According to the material, what is one benefit of starting slow when implementing AI systems?
+A) It allows time to understand how the systems work
+b) It eliminates any possible unexpected consequences
+c) It speeds up the rollout to more users
+d) There are no benefits to starting slow
+
+? What does the material recommend related to copyright when using AI systems?
+a) Assume AI-generated content does not violate any copyright
+B) Obtain permission to use copyrighted content used for training
+c) Never citing sources used by AI systems
+d) Waiting to address copyright issues until after system launch
+
+? According to the material, what can help ensure individuals comply with ethical standards for AI system use?
+a) Complex policies that frequently change
+b) Training materials not tailored to actual use cases
+c) Relying on users to educate themselves
+D) Education emphasizing relevance and fundamentals
+
+{/quiz}

quizzes/02e-Avoiding_Harm-consent_and_ai.md

@@ -0,0 +1,33 @@
+
+{quiz, id: consent, attempts: 10}
+
+## Consent and AI Quiz
+
+? Why is obtaining meaningful consent tricky with AI systems?
+
+a) Users readily understand all the risks of providing their data
+b) The risks associated with data collection are static and known
+c) AI systems anonymize all collected data
+D) The potential risks to users change dynamically over time
+? Which of the following are concerns with data collection and AI?
+
+a) Accountability
+b) Data persistence
+c) Data reuse
+D) All of the above
+
+
+? Which of the following technologies has been an especially debated topic in relation to consent in the EU?
+
+a) Speech recognition
+B) Live Facial recognition
+c) Object detection
+d) Machine translation
+
+? What is data spillover?
+
+A) A situation where data collection happens accidentally for other individuals in collecting data for intended people
+b) When datasets are too large that the AI system fails
+c) When datasets are too large that too many resources are used to support computing
+d) The deliberate collection of data not specified in an individual's consent agreement 
+{/quiz}

quizzes/02f-Avoiding_Harm-idare_and_ai.md

@@ -0,0 +1,31 @@
+
+{quiz, id: idare_and_ai, attempts: 10}
+
+## IDARE and AI Quiz
+
+? What does the acronym IDARE stand for?
+
+A) Inclusion, Diversity, Anti-Racism, and Equity
+b) Intelligence, Data, Algorithms, Research, Engineering
+c) Interfaces, Developers, Administrators, Regulators, End-users
+d) Identification, Development, Assessment, Regulation, Evaluation
+
+? Why can bias occur in AI systems?
+A) Humans and human-created data are inherently unbiased
+b) AI systems are intentionally designed to discriminate
+c) The training data for AI systems is too diverse in representation
+d) Bias only occurs when using unsupervised learning
+
+? What example demonstrates an AI system perpetuating existing biases?
+a) An AI system beating a human at chess
+b) AI-written articles discussing IDARE principles
+c) Algorithms that help flag medical images for further review based on patient reported pain
+D) Chatbots giving biased answers that lack diverse perspectives to users
+
+? What does the material recommend regarding using AI for employment decisions?
+a) AI should be fully relied upon to make unbiased choices
+b) Humans should have final say but AI can select a small number of resumes to evaluate without any potential bias issues
+C) AI is not appropriate for use in employment decisions with our current systems
+d) Guidelines are unnecessary as bias is no longer an issue
+
+{/quiz}

quizzes/02g-Avoiding_Harm-ethical_process_quiz.md

@@ -0,0 +1,25 @@
+
+{quiz, id: ethical_process, attempts: 10}
+
+## Ethical Process Quiz
+
+? When should ethical considerations occur according to the proposed framework?
+
+a) Only after an AI system is already in use
+b) At the beginning of during development only
+c) Just before an AI system is deployed
+D) Throughout the entire process of development and use
+
+? What is NOT a consideration when reflecting on AI use during the inception of an idea?
+a) What training datasets are a reasonable size
+b) What would the impact be if the AI system performed poorly
+c) Whether AI is actually appropriate for the use case
+d) How you could be more efficient and implement faster
+
+? What is needed after an AI system is launched according to the material?
+a) The system should not change after launch
+b) Occasional spot checks for issues
+c) Fixes only if users report problems
+D) Continual audit for unexpected and problematic behaviors
+
+{/quiz}

resources/dictionary.txt

@@ -2,6 +2,7 @@ ai
 Ai
 AI
 analytics
+anonymize
 anonymization
 AnVIL
 auditability
@@ -46,6 +47,7 @@ Embeddings
 Ethicists
 EU's
 EURACTIV
+eval
 favicon
 findable
 FLOPs
@@ -60,6 +62,7 @@ gpt
 GPT
 HIPAA
 HuggingFace
+idare
 IDARE
 impactful
 inadvertent
@@ -101,10 +104,12 @@ PrivateAI
 programmatically
 relIabiliTy
 reproducibility
+rollout
 Samsung
 scORe
 skillsetes
 skillsets
+timeframes	
 transformative
 UE
 UE5