ylai@lemmy.ml to AI@lemmy.mlEnglish · 2 years agoChatGPT gets code questions wrong 52% of the timewww.theregister.comexternal-linkmessage-square9fedilinkarrow-up1165arrow-down15cross-posted to: models@lemmy.intai.tech
arrow-up1160arrow-down1external-linkChatGPT gets code questions wrong 52% of the timewww.theregister.comylai@lemmy.ml to AI@lemmy.mlEnglish · 2 years agomessage-square9fedilinkcross-posted to: models@lemmy.intai.tech
minus-squareSirGolan@lemmy.sdf.orglinkfedilinkarrow-up5arrow-down3·2 years agoGPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.
GPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.