英文K - 12 教育中的生成 AI：挑战与机遇

1

GenerativeAI

inK–12Education:

ChallengesandOpportunities

UpdatedAugust2024

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).2

TableofContents

Introduction

Howtoreadthispaper

Background

ResponsibleAI

Education-specificconsiderations

ExamplesofprinciplesandguidelinesforresponsibleAICautionarynotes

HowAmericansviewAI

Generalattitudes

AwarenessandknowledgeUsage

AIliteracyamongteachersThestateofschoolpolicy

PolicyapproachesintheU.S.,acrosstheAtlantic,andbeyondUnitedStates

EuropeanUnion

UnitedKingdomandAustralia

GovernancemodelsOpportunities

Student-supporting

AdaptivelearningCreativity

Project-basedlearningandcollaborationTeacher-supporting

LessonplanningandcontentdifferentiationCoachingandfeedback

GradingandassessmentsSystem-supporting

Datainteroperability

AdministrationandlogisticsParentengagement

SeckingerHigh:AllInonAI

Risks,harms,andchallenges

InaccuraciesandhallucinationsBiasandinequity

LackofrepresentationInformationcensorshipCheatingandplagiarism

OverrelianceontechnologyandlossofcriticalthinkingDatasecurity

Consentandprivacy

HumanreplacementWhatstudentsthink

RecommendationsConclusion

AcknowledgmentsAPPENDIX

Resources,links,andinformation

Educatorsnapshot:howonesocialstudiesteacherisnavigatingAI

Educatorsnapshot:howonefourthgradeteacherusesKyronLearningEducatorsnapshot:howonefourthgrademathteacherusesTeachFX

About

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

3

Introduction

Lessthantwoyearsago,generativeAImovedfromadevelopingtechnologystillmostlyconfinedtoresearchpurposesandacademicdebatetowidespreadusage.OpenAIpubliclyreleasedtheirtext-to-imagemodel

DALL-E2inSeptember2022,1followedbytheirAItextchatbotChatGPTthatNovember.2ByJanuary2023,

ChatGPThadclocked100millionusers—thefastest-growingconsumerapplicationever.3Ayearlater,userscouldchoosefromseveralchatbotcompetitors,includingGoogleGeminiandAnthropic'sClaude,andthousandsof

applicationsbuiltonthesetoolshadfloodedthemarket.

Accordingtocountlessheadlines,theadventofgenerativeAImarkedthebeginningofa"revolution"4acrosseveryimaginablesectorofbusinessandsociety,includingbanking,manufacturing,healthcare,law,

entertainment,retail,design,and,ofcourse,education.Butheadlinesareheadlines,andwe'vebeenthrough

technologicalrevolutionsbefore(thinkautomobiles,television,nuclearpower,computing,andtheinternetinthelastcentury,tosaynothingofindustry,railways,andelectricityinthemoredistantpast).WhatmakesAI

different?Isthisrevolutionthemotherofalltechnologicalrevolutions?Howdowekeepupwith,andmakesenseof,thelatestdevelopments?

Inresearchingandreportingthispaper,wespoketomorethan40peopleaboutAI,runningthegamutfrom

expertPhDstoeighthgraders.WealsodrewonthecollectivewisdomofCommonSense,whichhasbuilta

wellspringofexpertiseandknowledgeongenerativeAIoverthelastfewyearsacrossitseducation,policy,

research,advocacy,andgrowthteams.We'vetriedtobringtogetherpeoplewhodon'tnormallyinteractwitheachotherinordertostitchdisparateviewpointsintomoreofaquilt.Acrossthatwidespectrumofvoices,weheardasimilarlywiderangeofreactions—fear,consternation,excitement,anxiety,andoptimism—sometimessimultaneously.Noneofthosereactionsarewrong.AlmosttwoyearsafterChatGPT'srelease,welackclearguidelines,guardrails,orpolicy,evenasweentertaingreathopesforthefuture.

OuraimistoprovideanoverviewofgenerativeAIinK–12education,includingbackgroundonthetechnology;thestateofAIliteracyandschoolguidelines;opportunities;risks;andrecommendationsforthefield.

1OpenAI.(2022,September28).DALL·Enowavailablewithoutwaitlist.

/blog/dall-e-now-available-without-waitlist

2OpenAI.(2022,November30).IntroducingChatGPT./blog/chatgpt

3Hu,K.(2023,February2).ChatGPTsetsrecordforfastest-growinguserbase–analystnote.Reuters.

/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/

4Thorbecke,C.(2023,November30).AyearafterChatGPT'srelease,theAIrevolutionisjustbeginning.CNN.

/2023/11/30/tech/chatgpt-openai-revolution-one-year/index.html

;Candelon,F.,Burtsev,M.,Jha,G.,Sack,D.,Zhukov,L.,&ZuluagaMartínez,D.(2023,December1).ChatGPT'sAIrevolution:Howmanagementcanadapt.Fortune.

/2023/12/01/chatgpt-ai-revolution-management-bcg/

;Rosenbaum,E.MITdatashow'industrialrevolution-level'leapforworkersusingAI.(2023,May10).CNBC.

/2023/05/10/mit-data-show-industrial-revolution-level-leap-for-workers-using-ai.html

;Kessler,S.(2023,June10).TheA.I.revolutionwillchangework.Nobodyagreeshow.NewYorkTimes.

/2023/06/10/business/ai-jobs-work.html

;Fernandez,B.(2023,August28).GenerativeAIpromisesaneconomicrevolution.Managingthedisruptionwillbecrucial.WallStreetJournal.

/articles/generative-ai-promises-an-economic-revolution-managing-the-disruption-will-be-crucial-b1c0f054

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

4

Howtoreadthispaper

Readerswillnotethatthetitleofthispaperfocuseson"generativeAI,"butwediscussAImorebroadly

throughout;it'snearlyimpossibletodisentangleonefromtheotherbecausethey'vebecomesynonymousin

mostpeople'sminds.Whenweusetheterm"AI,"wearereferencingAImorebroadly.Weuse"generative"and

otherqualifierswhenthatistheareaoffocus.Finally,giventherapidpaceofchange,weacknowledgethatthis

paperrepresentsasnapshotintime,butwe'vetriedtofocusasmuchaspossibleonconsiderationsthatwon'tgeteasilyresolvedinthenearterm.

WebeginourpaperwithbackgroundinformationaboutAIingeneral,giventheimportanceofAIliteracy.WeincludeasummaryofthetenetsofresponsibleAI,aswellasexamplesofprinciplesthatfollowthosetenets,tohelpsetafoundationforhowwemightapproachAIineducation.Wealsowantedtobustsomecommonlyheldmyths,soweincludedafewcautionarynotestocomplementthisintroductorymaterial.

Next,werunthroughresultsfrommultiplesurveystoprovideahigh-levelviewofsentiment,usage,andunderstandingofgenerativeAIamongAmericansingeneral,andyoungpeople,parents,andteachersinparticular.Andwhilesurveyresultsareinformative,wealsowantedtotalkdirectlywithpeopletogeta

qualitativesenseofhowtheyfeelaboutthistechnology.You'llnotequotesfromteachersandparentsthroughoutthispaper,aswellasasectiondedicatedtotakeawaysfromconversationswithyoungpeople.Weincludedfull

Q&AswiththreeteachersintheAppendix.

Intermsofpolicy,weofferanoverviewbothofselectcurrentgovernmentpolicyandofschool/districtpolicy.(Spoileralert:There'smuchmoretobedoneonbothfronts.)

Allofthat—backgroundanddefinitions,exampleprinciples,surveyresults,andpolicyoverviews—servesasa

foundationforunderstandingoursectionsonopportunitiesandrisks.Andthroughout,certainthemescomeuprepeatedly:

●Hypevs.reality

●Datasecurityandprivacy

●Transparency,trust,andaccountability

●Biasandequity

●Humanoversight

Thesesamethemesalsorunthroughoutourrecommendations.

ThisisstillearlydaysforgenerativeAI,andwedon'tclaimtohavealltheanswers.Butwehopethispapercanfunctionasaguidetothisevolvinglandscapeandhelpeducationalstakeholdersmakeinformeddecisionsaboutwhen,how,andwhethertouseAItoolsineducationalsettings.

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

5

Background

Ask10peoplethedefinitionofartificialintelligenceandyou'llget20answers.Merriam-WebsterdefinesAIas

"thecapabilityofcomputersystemsoralgorithmstoimitateintelligenthumanbehavior."5Thatsumsitup

succinctly,butother,moretechnicallyaccuratedefinitionsrefrainfromanyreferencetohumans,giventherisksofanthropomorphizingthetechnology.TheEuropeanCommission'sHigh-LevelExpertGrouponArtificial

Intelligence,forexample,definesAIas"systemsthatdisplayintelligentbehaviorbyanalyzingtheirenvironmentandtakingactions—withsomedegreeofautonomy—toachievespecificgoals."6AndtheGoogleDevelopers

glossaryusesthisdefinition:"anon-humanprogramormodelthatcansolvesophisticatedtasks."7AIhasbeen

aroundfordecades,fromrecommendationenginesonNetflixandvoiceassistantssuchasSiritocustomer

servicechatbots,searchengines,andmonitoringsystemsthatpredictwhenfactorymachineswillrequire

maintenance.ThisearlierformofAIperformsdiscretetasksandrespondstoaparticularsetofinputs.8These

systemscanlearnfromdataandmakepredictionsbasedonthatdata,butthey'renotproducingoriginalcontent.

GenerativeAI,ontheotherhand,cangeneratecontent,suchastext,images,audio,andvideo,thatiscomplex,coherent,andoriginal,inresponsetoasubmittedpromptorquery,bylearningfromlargereferencesetsof

existingdata.9Alexasettingatimerforyourturkeywhileyourhandsarecoveredinrawpoultrygoopis

convenient,butChatGPTgeneratinganoriginalsonnetaboutyoursecondcousininthestyleofPetrarchisprettymind-blowing.

ThespectrumofreactionstogenerativeAIweencounteredasweresearchedthisreportaresimilartothe

spectrumintheAIindustryitself,thoughnotaspolarized.Ononeend,"doomers"advocateforaslowerapproachtoAIdevelopmentduetoconcernsaboutthespeculativerisksthatsomebelieveitposestohumankind'sfuturesurvival.10Ontheotherend,"boomers"believethepositivebenefitsfaroutweighanyrisks,andthatdevelopmentcan'tandshouldn'tbecurbed.Butwhiletheextremesgetmostoftheattention,neitheraddressesthe

complicatedrealityandmyriadconcernsofcurrentusage.Inthemiddle,there'sagrowingefforttodevelop

responsible,trustworthyAIthatworksforallpeopleinthehereandnow.Thevastmajorityofpeopleingeneralalsoliesomewhereinthemiddleinhowthey'rethinkingaboutAIintheirownlives:skeptical,butcurious.Andthey'relookingforguidance.

There'sonebigproblemwiththeemphasisonpreparingforapossiblefutureworldwhereAIrulessupreme:Thatvisionobscurespresent-daychallengesthatneedtobeaddressed.Longtermism—thefocusonensuringthat

humankindwillsurvivemillionsofyearsfromnow11—isterribleforAI,saysTracyPizzoFrey,aformerGoogleAI5Merriam-Webster.(n.d.).Artificialintelligence.InMerriam-Wdictionary.

/dictionary/arti

ficial%20intelligence#dictionary-entry-1

6High-LevelExpertGrouponArtificialIntelligence.(2018,December18).AdefinitionofAI:Maincapabilitiesandscientificdisciplines.EuropeanCommission.https://ec.europa.eu/futurium/en/system/files/ged/ai_hleg_definition_of_ai_18_december_1.pdf

7GoogleforDevelopers.(n.d.)Machinelearningglossary.

/machine-learning/glossary

8Marr,B.(2023,July24).ThedifferencebetweengenerativeAIandtraditionalAI:Aneasyexplanationforanyone.Forbes.

/sites/bernardmarr/2023/07/24/the-difference-between-generative-ai-and-traditional-ai-an-easy-explanatio

n-for-anyone/

9CommonSenseMedia.AIrating:ChatGPT.

/ai-ratings/chatgpt

;McKinsey&Company.(n.d.).WhatisgenerativeAI?

/featured-insights/mckinsey-explainers/what-is-generative-ai

10TheSamAltmandramapointstoadeepersplitinthetechworld.(2023,November19).TheEconomist.

/business/2023/11/19/the-sam-altman-drama-points-to-a-deeper-split-in-the-tech-world

;EdinburghFuturesInstitute.(2023,November23).OpenAIchiefexecutive'sfiring,rehiringcastsnewlightonthewarbetweenAIdoomers,boomers.

https://efi.ed.ac.uk/openai-chief-executives-firing-rehiring-casts-new-light-on-the-war-between-ai-doomers-boomers/

11Samuel,S.(2023,September7).SiliconValley'svisionforAI?It'sreligion,repackaged.FuturePerfect.Vox.

/the-highlight/23779413/silicon-valleys-ai-religion-transhumanism-longtermism-ea

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

6

executivewholedthedevelopmentofCommonSenseMedia'sAIprinciples."Somepeoplearetalkingabout

colonizingotherplanetsandnotthinkingaboutclimatechangeandsystemicracism.It'sasleightofhandtotalkaboutexistentialrisk—itcoversupwhatishappeningnow."

Ineducation,PizzoFreyseessimilaritiestotheriseofedtechoverthepast20years,anditsaccelerationduringandsincethepandemic."Whatyouhaveatahighlevelisaprettybifurcatedexperience:peoplewhoarereally,reallyexcitedaboutAIandnewtechnologyandwanttoimplementasfastaspossible,andpeoplewhoarereallyskeptical,especiallyfrontlineeducatorswhowerealreadyskepticaloftechnologyineducationandarealso

skepticalofAI."AIlikelywon'tbeanovernightrevolution,butmoreofanevolution,aseriesofsmallerstepsandchangesthatcanadduptobigtransformationsovertime."Wecouldletthathappenbydefaultorwecouldbeintentionalaboutit.Weneedtoquestionwhomakesdecisions.Rightnowit'shappeningmorebydefault,"saysPizzoFrey.

ResponsibleAI

TheresponsibleAImovementrespondstothatcallforintentionality.ResponsibleAIreferstoartificial

intelligencethatisdesigned,developed,deployed,andusedinawaythatalignswithhumanvaluesandminimizesrisksandharms.12Thinkofitasafocusonhowtomakethesetoolsandtechnologiesworkbetter—thatis,more

accurately,fairly,andethically—today,notin10years.Whilethere'snofixeddefinitionofexactlywhatresponsibleAIlookslikeinpractice,consensusisemergingaroundcertainthemes.

"Hundredsofprinciplesandchartersexistacrosstheglobe,andthey'reremarkablysimilarinsomepredictableways,"saysPizzoFrey."Theytendtoalltouchonunfairbias,transparencyandexplainability,andprivacyand

safety."Here,explainabilityreferstoimprovinghumanunderstandingofhowAIworks,whichalsobuildstrustinthesystem'sresults.13

Mostpeoplewon'tbeabletounderstandthedeepertechnicalaspectsofhowChatGPTworks,buteveryoneshouldbeabletounderstand,inplainlanguage,thebasicsofhowthetechnologyfunctions.

Mostpeoplewon'tbeabletounderstandthedeepertechnicalaspectsofhowChatGPTworks,buteveryone

shouldbeabletounderstand,inplainlanguage,thebasicsofhowthetechnologyfunctions.Thatalsomeansthattechcompaniescan'thidebehind"blackbox"terminologyasanexcuseforalackofexplanation.

"Humanintheloop"isaphrasethatalsocropsupinmanysetsofAIprinciples:theneedforahumantobepresentatcertainpointsinthesystem,ratherthantheuseofAIasawholesalealternativetohuman

decision-making.Ineducation,thisideaofhumaninvolvementisespeciallyimportant.TheU.S.Departmentof

12Nguyen,A.,Ngo,H.N.,Hong,Y.,Dang,B.,&Nguyen,B.T.(2023).Ethicalprinciplesforartificialintelligenceineducation.Educationand

InformationTechnologies.28(4):4221–4241.

/10.1007%2Fs10639-022-11316-w

;IEEEStandardsAssociation.(n.d.).Generalprinciples.

/wp-content/uploads/import/documents/other/ead_general_principles.pdf

13Turri,V.(2022,January17).WhatisexplainableAI?SoftwareEngineeringInstituteblog,CarnegieMellonUniversity.

/blog/what-is-explainable-ai/

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

7

Education'sMay2023report("ArtificialIntelligenceandtheFutureofTeachingandLearning")issuesthedirectiveto"alwayscentereducatorsininstructionalloops,"furtherdetailingthoseloopsas:

1.Theloopinwhichteachersmakemoment-to-momentdecisionsastheydotheimmediateworkofteaching.

2.Theloopinwhichteacherspreparefor,plan,andreflectonteaching,whichincludesprofessionaldevelopment.

3.TheloopinwhichteachersparticipateindecisionsaboutthedesignofAI-enabledtechnologies,

participateinselectingthetechnologies,andshapetheevaluationoftechnologies—thussettingacontextfornotonlytheirownclassroombutthoseoffellowteachersaswell.14

The2024NationalEducationTechnologyPlanalsomakesapointtoemphasizehumansintheloop:"Regardlessoftechnologists'claims,noemergingtechnologywillinandofitselfsolvethelong-standingchallengesfacedby

educationalsystems.Asnewtechnologiesemerge,educatorsmustbeinvolvedindesigninganddevelopingdigitaltoolsforclassroomuse.Evaluatingthesetechnologiesforpotentialclassroomuseatthestate,schoolsystem,orschoollevelshouldbeiterativeandincludeeducatorandstudentinput."15Similarly,emergingstate-levelguidancealsoplaceshumansatthecenter.AccordingtoWashingtonstate'sguidance,forexample:"InK–12education,

usesofAIshouldalwaysstartwithhumaninquiryandalwaysendwithhumanreflection,humaninsight,andhumanempowerment."16

PizzoFreygoesastepfurtherthanthe"humanintheloop"principle.What'sneeded,shesays,especiallyincaseswhereAIcanhaveadirectandmeaningfulimpactonpeople'slivesandopportunities(suchaseducation),is

meaningfulhumancontrol."Youcannot,andfromaprincipledperspectiveshouldnot,separatehumansfromAI,"shesays.Infact,AIissociotechnical;thetechnologycannotbedivorcedfromthehumanswhoinformandshapeitsuse.17

Education-specificconsiderations

AsstakeholdersdebateandclarifytheappropriateplaceofgenerativeAIineducation,it'simportanttokeepinmindsuchthemesasbias,transparency,andsafety.It'salsoworthhighlightingsomeadditionalconsiderationsaroundAIinaneducationalcontext.

First,we'retalkingaboutchildren.Thismaybestatingtheobvious,butthefactthatchildrendeservegreateranddifferentprotectionsthanadultsdoesn'tgetforegroundedenoughinconversationsaroundAIineducation.Ina2021papersummarizingAIresearchers'responsestoquestionsabouttheethicsofAIineducation,thefocusonyoungpeoplewasassociatedwithissuesofconsent,learningagency,dataprivacy,andalgorithmicbias,aswellaslonger-term"impactsofengagingwithyoungpeopleduringaformativeperiod."Saidonerespondent:"Weare

14U.S.DepartmentofEducation,OfficeofEducationalTechnology.(2023,May).Artificialintelligenceandthefutureofteachingandlearning:Insightsandrecommendations.

/documents/ai-report/ai-report.pdf

15U.S.DepartmentofEducation,OfficeofEducationalTechnology.(2024.)Nationaleducationaltechnologyplan.

16WashingtonOfficeofSuperintendentofPublicInstruction.(2024,January18).Human-centeredAIguidanceforK–12publicschools.

https://ospi.k12.wa.us/sites/default/

files/2024-01/human-centered-ai-guidance-k-12-public-schools.pdf

17CommonSenseMedia.AIinitiative.

/ai

;Weidinger,L.,Rauh,M.,Marchal,N.,Manzini,A.,Hendricks,

L.A.,Mateos-Garcia,J.,Bergman,S.,Kay,J.,Griffin,C.,Bariach,B.,Gabriel,I.,Rieser,V.,&Isaac,W.(2023,October31).SociotechnicalsafetyevaluationofgenerativeAIsystems.GoogleDeepMind.

/10.48550/arXiv.2310.11986

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

8

influencingimpressionableyoungpeople,andthatcomeswithamoralobligationtobeascorrectandproperaspossible."18

Twootherconsiderationsareimportanttorecognizeasschoolsevaluate,review,andpossiblyadoptnew

AI-poweredtools.OneisthattheimpactsofAIineducationalsettings,whetherviamoretraditionalalgorithmsormorerecentgenerativeAItechnology,aren'tnecessarilyreadilyapparent.AmalfunctioningAIsystemina

self-drivingcarcouldresultinimmediate,significantbodilyharmordeath,whereastheeffectsofAIonchildrenmaybeharder,andtakelonger,toidentify.Educatorsandschoolleadersnonethelessneedtoconsiderthose

potentialdownstreameffectsnow,andresearchwillberequiredtostudyoutcomes.

ThesecondisthatAIeducationaltoolsmayembodyassumptionsaboutwhichinstructionalstrategiesarebestforlearners,andnotenoughattentionisalwayspaidtowhichpedagogyisdrivingaspecificAItool.19Intherushto

releaseandevaluatenewproducts,oftenthereisnotenoughfocusonthepedagogicalapproachthateach

producthasadopted—ortheefficacyofthetoolatall."Pedagogy-drivenAIineducationisoftenconsideredasgoodregardlessof[whether]thepedagogychosentodriveAIisanappropriateoneornotinthefirstplace,"

anotherresearchercommentedinthatsamepaperontheethicsofAIineducation.20

ExamplesofprinciplesandguidelinesforresponsibleAI

Frameworksneedroadmapsthatspellouthowtheyworkinpractice,andanumberofentitieshavebegun

releasingactionableAIprinciplesandguidelinestothatend.In2023,CommonSenseMediareleaseditsfirst

ratingsofAIproducts,whichencompassmanyofthethemescommontoresponsibleAIframeworks.Geared

towardaneducator,family,andpolicyaudience,theratingsaregroundedinasetofeightcoreprinciplesforhowtothinkaboutAIanditsimpactsonadultsandchildren:

●PutPeopleFirst

●PromoteLearning

●PrioritizeFairness

●HelpPeopleConnect

●BeTrustworthy

●UseDataResponsibly

●KeepKidsandTeensSafe

●BeTransparentandAccountable21

Similarly,DigitalPromise,aglobalnonprofitworkingtoexpandeducationalopportunitiesthroughresearchandtechnology,listsfourcomponentsinitsAIevaluationframework:transparency,safety,ethics,andimpact.22AndtheNationalInstituteofStandardsandTechnologyincludesthesecharacteristicsoftrustworthyAI:

18Holmes,W.,Porayska-Pomsta,K.,Holstein.K.,Sutherland,E.,Baker,T.,BuckinghamShum,S.,Santos,O.C.,Rodrigo,M.T.,Cukurova,M.,Bittencourt,I.I.,&Koedinger,K.R.(2022).EthicsofAIineducation:Towardsacommunity-wideframework.InternationalJournalofArtificialIntelligenceinEducation,32:504–526.

/10.1007/s40593-021-00239-1

19Ibid.

20Ibid.Jurenka,I.,Kunesch,M.,McKee,K.R.,Gillick,D.,Zhu,S.,Wiltberger,S.,Phal,S.M.,Hermann,K.,Kasenberg,D.,Bhoopchand,A.,

Anand,A.,Pîslar,M.,Chan,S.,Wang,L.,She,J.,Mahmoudieh,P.,Rysbek,A.,Ko,W.-J.,Huber,A.,...&Ibrahim,L.(2024,May14).Towards

responsibledevelopmentofgenerativeAIforeducation:Anevaluation-drivenapproach.GoogleDeepMind.

/abs/2407.12687

21CommonSenseMedia.(n.d.).HowwereviewandrateAIproducts.

/ai-ratings/how-we-rate-and-review

22Mills,K.,Ruiz,P.,&Lee,K.(2024,February21).RevealinganAIliteracyframeworkforlearnersandeducators.DigitalPromise.

/2024/02/21/revealing-an-ai-literacy-framework-for-learners-and-educators/

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlogos

aretrademarksofCommonSenseMedia,a501(c)(3)nonprofitorganization(FEIN:41-2024986).

9

●Safe

●Secureandresilient

●Explainableandinterpretable

●Privacy-enhanced

●Fair—withharmfulbiasmanaged

●Validandreliable

●Accountableandtransparent23

Transparencyandaccountabilityaretwoofthetoughestnutstocrack.AIalgorithmsareoftendifficultto

understand,evenforexpertsinthefield,andlargelanguagemodels(LLMs)likeChatGPTareoftenreferredtoas"blackboxes,"orsystemswhoseinnerworkingsareinvisibletotheuser.24

Amara,25anAIethicsresearcher,notesthatalotofthepeoplewhocreatethesesystemsdon'tunderstandhowthesystemsareworkingthemselves.

Asforaccountability,Amaraacknowledgesthevalueofpolicy,butaddsthatAIsystemsaredifficulttoregulate

evenwhenruleshavebeencreated.ShepointstoaNewYorkCitylawineffectsince2023thatmandatesan

independentauditforanyAIhiringtool.CompaniesmustalsodisclosetheuseofanyAItoolsinthehiringprocess

toprospectiveemployees.26Amaraquestionsthecity'sabilitytomonitorforviolationsandenforceanyconsequences."Wehaven'tfiguredouthowtoregulatethesesystems,"shesays.

Frameworksandprinciplesareimportantnotjustforunderstanding,evaluating,andregulatingproductsalready

onthemarket—theyalsoneedtobeimplementedatthedesignanddevelopmentstages,beforeusersare

exposedtopotentialrisksandharms.Andit'scrucialtobeexplicitaboutthevaluesthatinformthedesignofAI

systems,platforms,andtools,becausethosesamevaluesinformthetools'outcomes."Ifwebuildthesetoolswithequityinmind,itwillhelpusbuildequityintherestofoursystems.Ifwedesignthemtotrackkids,they'lltrack

kids,"saysErinMote,executivedirectorofInnovateEDU."Technologyisn'tneutral,andit'salsobuiltbyhumans."

23NationalInstituteofStandardsandTechnology.(2023,January).Artificialintelligenceriskmanagementframework.

/nistpubs/ai/NIST.AI.100-1.pdf

24Bagchi,S.,&TheConversationU.S.(2023,May26).WhyweneedtoseeinsideAI'sblackbox.ScientificAmerican.

https://www.scientifi/article/why-we-need-to-see-inside-ais-black-box/

25Wehaveusedapseudonymattheresearcher'srequest.

26NewYorkCityDepartmentofConsumerAffairs.(n.d.).Automatedemploymentdecisiontools.

/site/dca/about/automated-employment-decision-tools.page

©2024CommonSenseMedia.Allrightsreserved.CommonSenseandotherassociatednamesandlo