HardReasoning
Estimate Complexity
Tests an AI's ability to make educated estimates based on technical knowledge
The Prompt
Estimate the total number of FLOPs required to train GPT-3 without searching online. Explain your reasoning step by step.
How the models did
198 found
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity39
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity70
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity28
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity7
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity50
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity55
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity46
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity62
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity59
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity14
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity31
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity23
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity11
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity43
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity11
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity49
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity35
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity50
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity11
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity31
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity36
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity34
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity31
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity41
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity39
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity3
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity36
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity43
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity41
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity11
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity31
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity28
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity42
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity50
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity4
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity10
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity4
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity43
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity59
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity55
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity7
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity68
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity67
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity34
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity19
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity50
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity28
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity57
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity0
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity23
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity4
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity3
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity19
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity31
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity4
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity4
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity11
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity50
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity62
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity0
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity50
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity36
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity3
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity78
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity76
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity48
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity13
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity14
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity41
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity28
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity31
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity34
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity19
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity20
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity7
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity21
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity19
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity36
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity6
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity25
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity55
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity29
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity43
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity48
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity46
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity22
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity14
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity11
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity18
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity27
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity15
Nothing here. The model returned empty. We stared at it for a while.
·Estimate Complexity8