Explore or Exploit? The Trade-Off Between Learning and Using What You Know.
Exploring is rational while there is something left to learn and time left to use it, so the discipline is not to sample less but to give every round of sampling a purpose, a price and an end. Here is what the science actually says, and what to do with it.
01The Sampling Problem
What the Research Actually Found
Every choice about what to do next hides a second choice: how much do you still need to learn? A coach can repeat last season's training block or test the method the team keeps debating. Decision science calls the first move exploitation, using what you already know, and the second exploration, acting mainly to learn. In general form, nobody has solved the contest between them.[5]
The laboratory version is the multi-armed bandit: several levers with unknown payouts, a fixed number of pulls, and a score that adds up your winnings. An early mathematical paper framed it as sequential design, where what you sample next depends on what you have seen.[6] A later formal account reduced problems that had resisted solution to one index number per option.[7]
Everyday language usually rules against the explorer: dithering, analysis paralysis, research that never ends. This article tests that charge.
Before you judge anyone's exploring, ask what exploring is worth. An untried option carries option value: it may look no better than your usual choice, but one trial may show it is, and every later choice collects on that discovery. Take this article's worked example. A known option pays 0.5 a try, and an unknown option's success rate could be anything, every value equally likely. With one try left, exploring gains nothing. With ten tries left, it gains 0.82 reward units over committing at once; with fifty, 5.35.
In this worked model, the value of exploring rises with the horizon, the number of future choices in which a lesson can still be used. People act as if they know it. In one laboratory task, participants who expected six more choices sought more information and chose more noisily than those who expected one.[9] In another set of experiments, people explored more when they expected to meet an option more often in future.[10]
So the charge "you explore too much" has more to prove. Exploring pays only when what you could learn is worth more than the next sample costs. The charge holds only if time has run out, nothing learnable is left, or the next sample costs more than it could repay.
Sampling goes wrong when it loses two anchors. One is a purpose: something learnable that would change what you do next. The other is a stopping rule: a point, agreed in advance, where one more sample is not worth its price. A review proposes that curiosity arises from a perceived gap in knowledge.[11] A later theory holds that people can seek information with no practical use and avoid information that might help them.[12] That is why the anchors matter: curiosity can make an answer feel valuable even when it changes nothing.
The laboratory record does not point one way. In the meta-analysis of decisions made from experience, people free to stop searching sampled too little.[1] In a task modelled on choosing the best applicant, participants stopped too early.[13] In a related task, they gave early applicants too many important positions.[14] The foraging survey runs the other way: animals stayed too long.[2] No study in this bibliography measures how often adults over-sample in daily life.
So the lesson is to explore on purpose, not to explore less. Before you act, decide three things: whether the action is meant to learn or to use, what you will pay for the lesson, and what result ends the search. This three-part discipline is the article's own proposal, built from the studies cited here and untested as a package.
02The Mechanism
The Machinery of the Trade-Off
There is no known generally optimal solution to the exploration versus exploitation problemnarrative review [5]
Start with the theory, because it marks where knowledge ends. One fenced, discounted version of the problem has a complete answer: independent options with stationary payoffs. In that model the dynamic allocation index gives every option a number, and playing the highest number is optimal.[7] Three later proofs reached the result by different routes.[15][16][17] When ignored options keep changing, the case called restless bandits, a related index reduces to the original only if those options stand still.[18]
For the general problem, no optimal policy is known, and a review of the field adds that one may not be possible.[5] So "optimal" works as a benchmark inside a defined task, not as a standard for an ordinary life.
Practitioners use rules that perform well without claiming to be perfect, and score them by regret: the reward lost compared with playing the best option every time.[22][23] Randomised probability matching chooses each option with a probability equal to the chance that it is the best.[19][20] For coin-flip rewards, its regret was proved asymptotically optimal after the question had stood open for nearly eighty years.[21]
The mathematics is firm but narrow, human behaviour fits two fitted strategies, and the brain account is only partly written.
Narrow problems have best answers; the general problem has none anyone can name. The mathematics is firm but narrow.
How do people handle the trade-off? The Horizon task, a laboratory choice game, changes only the number of choices left and fits models to what people do next. Two strategies came out of those fits.[9] Directed exploration gives uncertain options a bonus, a deliberate lean toward learning. Random exploration adds noise to choice, so unfamiliar options get picked by chance. With the longer horizon, participants showed more of both.[9]
Later work sharpened the split. When one experiment varied two kinds of uncertainty separately, people used both strategies, each driven by a different computation.[24] In two further experiments, a model combining them fit best.[25] Reviews report that the two draw on different brain systems, develop on different schedules, and appear in many organisms.[26][27]
Hold both labels loosely: nobody observes either strategy directly. In two data sets from a two-step task, a simpler model that only repeated choices fit as well as one with heuristic exploration.[28] In changing environments, another team traced most departures from the best-looking option to noise in learning rather than information seeking.[29]
Directed and random exploration are labels on a fitted model, not machinery anyone has found in the brain.
The study changed only the number of choices left. With a longer horizon, people sought more information and chose more noisily, and fitting models to those choices produced two strategies: directed exploration and random exploration. Hold the labels lightly: they are dials on a fitted model, not organs, and the brain evidence for them is only partly written.
Diagram
Horizon: the last choice is never worth exploring. Returns: each sample teaches less than the one before. Stop: the rule is where value meets price. Illustrative exact calculations on a toy problem; not data about any person or any real decision.
Diagram
Return to the worked example with a new question: what is the next sample worth? Picture a sure payoff of zero against an uncertain option whose value only noisy trials can reveal. In this article's calculation, the first sample is worth 0.18. The fifth is worth 0.015, the ninth 0.006, and the sixty-fifth 0.0002.
In this worked model, each further sample is worth less than the last, and each has a price. In two monkeys and six humans making perceptual decisions, the estimated cost of gathering more evidence was neither zero nor constant over time.[30] A formal analysis proved that a best balance of speed and accuracy exists for many reward schemes.[31] At a price of 0.02 a sample, a rule that looks one step ahead stops after four samples.
That arithmetic counts only what information is worth for action, and people also want information they cannot use.[12] A framework for what people want to know weighs effects on action, feeling and thought, and allows for seeking both too little and too much.[32] These accounts explain the pull of useless information; they do not show how often it wins.
Each further sample has a price against a shrinking payoff; a stopping rule is the crossing point written down.
is where one more sample stops paying for itself in this article's worked example, at a price of 0.02 a sample against a first sample worth 0.18, under a rule that looks one step ahead (This article's worked example · normal-normal choice · toy numbers)
What does the brain add? Less than the popular story claims. The best-known theory, built on monkey recordings and modelling, holds that short bursts from the locus coeruleus, a small brainstem nucleus, accompany engagement with the task, while a steadier mode accompanies disengagement and search.[33] Its account of adaptive gain is elegant. In humans it remains unconfirmed. A double-blind trial gave 52 people reboxetine or citalopram and found no difference in exploration against placebo.[34] In a crossover study of 22 people, atomoxetine reduced random exploration where the theory predicted a rise.[35]
The pupil, often offered as a window on that system, gives a blurred view. In one study a larger baseline pupil came before exploratory choices.[36] In another it tracked total uncertainty, with the link to the locus coeruleus resting on an assumption.[37] In a third, pupil size and slower responses marked disadvantageous choices only after participants had learned the task; the authors read those choices as directed exploration.[38]
The cortical evidence is firmer. In one imaging study, frontopolar cortex and the intraparietal sulcus were more active during choices a model labelled exploratory.[39] Magnetic stimulation over right frontopolar cortex reduced directed exploration and spared random exploration, the one causal test in this evidence.[40] The dopamine results split. L-DOPA blunted directed exploration in 31 healthy men,[41] but a preregistered study of 75 people found no overall effect.[42]
The brain account is half-written: one causal test, scattered correlations, and drug results that sometimes run backwards.
Foraging theory gives the sharpest yardstick for leaving. Its best-known rule is the marginal value theorem:[43] leave a patch when its current intake rate falls to the average rate the environment offers.[44][45] With identical patches, longer travel between them justifies longer stays. In this article's toy patch, with gain over time of 10(1 - exp(-t/2)), the best leaving time rises from 1.27 at a travel time of 0.5 to 3.87 at a travel time of 8.
People follow the theorem loosely. In a patch-foraging task, participants adjusted their stays to the cost of their time, and a threshold rule built on the theorem explained their leaving better than a standard learning model.[44] In visual search, the theorem fit while patches were uniform and broke down when patch quality varied or the display was degraded.[45] When people recalled animal names, they moved from one category to the next at times the theorem predicts.[46]
The departures teach more than the fits. The survey of 26 studies found foragers staying too long.[2] A formal model predicts that uncertainty makes foragers overstay poor patches and leave rich ones too soon.[47] After an environment turned worse, people kept rejecting good options in the hope of better ones.[48]
Foraging theory tells you when to walk away, and its clearest violations involve staying too long.
03Evidence
The Five Studies That Carry the Weight
01The claim
The single load-bearing finding
The hero study pooled 70,000+ choices.
Across more than 70,000 laboratory choices by more than 6,000 people, those free to stop searching explored too little to see every outcome.[1]
choices
70,000+ choices
Meta-analysis
02How we measured
The six-criterion rubric
Evidence has weight classes: a fitted model, a brain scan and a meta-analysis are three different kinds of fact.
Evidence in this field comes in different weights. A fitted parameter is not an observation, and an active region on a scan is not a switch. A drug that leaves behaviour unchanged counts, but less when the task has poor test-retest reliability, the degree to which a score repeats when the same person is tested again. A meta-analysis pools studies to estimate a pattern across the tasks it includes; it cannot make that pattern universal or turn correlation into cause.
The ranking below scores each study out of 100 on design, sample, rigour, causality, replication and field influence. The scores are editorial judgments read from abstracts, with full text opened for two papers only to confirm sample sizes. No validated instrument stands behind them.
Design (/30): How strong the study design is for the question, from pooled analyses down to single-task experiments. Sample (/20): How many people and observations stand behind the headline result. Rigour (/15): Quality of measurement, modelling and reporting. Causality (/15): How far the design supports a causal reading rather than an association. Replication (/10): Whether independent work reproduces or builds on the result. Citations (/10): Field influence, scaled from citation counts in a public scholarly index on the day of scoring.
Rubric maxima
03Lifespan
Lifespan studies
Exploration changes across a life, but the direction depends on strategy and task; age has no single arrow.
Lifespan studies add detail. Preschoolers learned an unusual physical cause-and-effect rule better than older children, adolescents or adults.[49] In a reward-search task, children explored more eagerly than adults and earned less.[50] In a Horizon task study of 149 people aged 12 to 28, directed exploration tuned to long horizons emerged during adolescence.[51] A model fitted to 281 people aged 5 to 55 changed quickly through childhood and levelled off in adulthood, and none of the tested optimisation methods reliably beat the adults' strategies.[52]
Later life varies by measure. One foraging study found only a trend toward less exploration with age.[53] In a Horizon task study, about 26 percent of older adults sought almost no information and performed worse.[54] A meta-analysis of 29 comparisons found that age differences in risk taking, a related question, varied with the task.[55] Two child studies disagree on whether children's extra exploration is directed or random.[50][56]
Do not conclude that you should explore like a child. Where measured, children explored more and earned less. The idea that a long childhood exists to solve the explore-exploit problem is a proposal with early evidence, not a finding.[57]
People aged 5 to 55
281
Sample of the lifespan model fitted in the cited study.
04What does not hold
Negative knowledge
Firm mathematics, task-dependent behaviour, an unsettled mechanism: read the evidence that way and it will not mislead you.
Under all of this sits the measurement problem. In the retest study, the same strategy barely correlated across tasks, and the factors tracked working memory, not self-reported exploration, mood or anxiety.[4] Studies of other tasks show the same gap between laboratory measures and questionnaires: reliability ranged from 0 to .82 across seven classic tasks,[58] and self-report surveys repeated well while behavioural task scores did not.[59]
None of this makes exploration unmeasurable. It makes a single-session score suspect, and "I am a high random explorer" claims more than today's instruments support.
Retested participants
175
In the reliability study behind Study #5.
The 5 Strongest Studies on Explore-Exploit Decisions
Ranked on a six-criterion, 100-point editorial rubric applied to abstracts, with full text read for two sample sizes. Together they show under-sampling in some tasks, modest brain differences, one causal frontopolar result and weak measurement.
01Anchor
A meta-analysis of decisions made from experience, comparing them with decisions made from described odds
The study pooled laboratory decisions made after people learned about options by trying them, including conditions in which they chose when to stop. It found a robust description-experience gap: decisions from experience differ from choices made from described odds, mostly because of reliance on small samples. People free to stop searching explored too little to see every possible outcome. The gap remained even when sampling error was largely removed, so small samples are not the whole explanation.[1]
When people control their own sampling in this kind of task, the documented error is sampling too little. The only pooled behavioural analysis in the set, with the largest sample and a design that measures the stopping decision. One family of laboratory tasks; it shows early stopping there, not in everyday planning.
Rubric breakdown
The strongest studies, ranked by methodological weight.
Each scored 0 to 100 against a six-criterion rubric, tagged by design; the anchor leads.
02
A meta-analysis of 23 brain-imaging studies of exploring and exploiting[3]
A coordinate-based meta-analysis, which pools the reported locations of brain activity, found that dorsolateral prefrontal cortex, anterior insula and dorsal anterior cingulate cortex separate exploring from exploiting. Overall, activity in the two modes was more alike than different and varied with the task. Proves: a few regions differ between the two modes, modestly and depending on the task. Its pooled design earns the place, but imaging shows correlation, and the paper is too new to have gathered citations. Score breakdown: Design 27/30, Sample 14/20, Rigour 11/15, Causality 4/15, Replication 7/10, Citations 1/10.
64/100
03
A brain-stimulation experiment on right frontopolar cortex and two kinds of exploration[40]
Suppressing right frontopolar cortex with transcranial magnetic stimulation, a magnetic pulse applied through the scalp, reduced directed exploration and left random exploration intact. Proves: right frontopolar cortex plays a causal role in directed exploration in this task. The only direct intervention in the set, marked down for a small sample (25 with complete data), one lab and one task. Score breakdown: Design 22/30, Sample 6/20, Rigour 11/15, Causality 13/15, Replication 4/10, Citations 6/10.
62/100
04
The experiment that introduced the Horizon task and its two exploration strategies[9]
In the Horizon task, participants facing six remaining choices instead of one sought more information and chose with more noise, which a fitted model reads as directed and random exploration. Proves: exploration responds to the horizon, and the response can be modelled as two separate parts. A clean manipulation that later studies reuse, held back because the strategies are model labels and the abstract omits the sample size. Score breakdown: Design 18/30, Sample 8/20, Rigour 10/15, Causality 10/15, Replication 8/10, Citations 7/10.
61/100
05
A two-session test of whether exploration scores repeat across time and across three bandit tasks[4]
Exploration estimates from three bandit tasks were poorly to moderately stable across sessions and barely correlated across tasks. Simpler models produced two factors that tracked working memory, the capacity to hold information in mind, not personality or mood. Proves: a single-session exploration score is a weak basis for calling anyone a high or low explorer. It tests the measurement every other row relies on, but it is one recent study with few citations so far. Score breakdown: Design 22/30, Sample 12/20, Rigour 12/15, Causality 6/15, Replication 4/10, Citations 1/10.
57/100
What the literature does not say
- It makes a single-session score suspect, and "I am a high random explorer" claims more than today's instruments support.
- No study in this bibliography measures how often adults over-sample in daily life.
- What exists is the mathematics of option value and cost, a laboratory record of errors in both directions, and one inference: a written horizon and stopping point give these errors fewer places to hide.
- Editorial judgment. Read together, the five ranked papers show four things. People under-sample in some tasks. Brain differences between the modes are modest. One causal test links frontopolar cortex to directed exploration, and the measures are weaker than their citation counts imply. That is enough to justify exploring with a purpose, and not enough to tell anyone how much exploring is right.
04Stakes
The cost is not exploring. It is not knowing which one you are doing.
The documented failures run in opposite directions, so a single instruction to explore less cannot fix them.
Set the four failures side by side and they share no direction. One is thin sampling, one is staying too long, one is deliberating past the point of value, and one is a belief that never gets tested. "Explore less" fixes one and worsens another. The common factor is structure, not amount: each failure is what a missing label, a missing budget or a missing stopping criterion would allow.
The stakes for performance are real but unmeasured. What exists is the mathematics of option value and cost, a laboratory record of errors in both directions, and one inference: a written horizon and stopping point give these errors fewer places to hide.
The symptom lines translate the findings into felt experience; no cited study measured them.
A broken sampling process fails in both directions, which is why the repair is a rule and not a direction.
Under-Sampling
Free to stop searching, people in laboratory choice tasks often quit early; reliance on small samples was the largest cause of the description-experience gap.[1] Small samples also make options look more distinct and easier to choose between, at a cost.[60] Deciding on too little evidence is a documented error.
a verdict after two tries, sudden confidence, surprise later
Overstaying
Across 26 animal studies, foragers tended to stay in patches too long,[2] and people in a worsened environment kept rejecting good options while waiting for better ones.[48] Staying in a depleted patch is the mirror-image failure.
"it has to turn around soon," sunk effort too heavy to walk away from
Deliberation That Outruns Its Value
In a laboratory choice task, people spent too long on hard choices between options close in value, and cutting long decisions short improved their use of time.[61] Within a single decision, gathering evidence has a cost that is neither zero nor constant.[30] In this task, extra time on close-valued options bought little.
comparing near-identical options, reopening a shortlist you had closed
Learning Traps
In a set of experiments, people reliably fell into a learning trap, a false belief that persists through extensive experience, even with help that was predicted to break it.[62] Some behaviour that looks like exploring may instead be computational noise, random error in learning.[29] Sampling that never tests the belief it protects teaches nothing.
an option you ruled out once and never tried again
05Protocol
A Four-Step Sampling Protocol
Each step draws on the evidence above; together they turn the amount you explore into a decision you make in advance.
The protocol, as a sequence.
Before → Set → During → After
Label the Action
Label every action EXPLORE or EXPLOIT before you take it.
In laboratory tasks, people explored more when they expected more future choices or encounters with an option.[9][10] Because the two modes lie on a continuum,[8] the label is a convention that makes you state the purpose.
Labelling after the result comes in, which makes every outcome look intended.
Fix the Horizon and the Price
Write down your horizon, how many more times you will use what you learn, and what one sample costs you.
In the worked example above, the value of exploring grows with the horizon and falls to zero at the last choice. In a perceptual task, the cost of gathering evidence within one decision was neither zero nor constant.[30]
Pricing a sample in effort alone rather than in everything it takes from you.
Write the Stopping Criterion
Name the result that ends the search, and the count or date that ends it if that result never comes.
Each sample returns less: in the worked example the fifth sample is worth under a tenth of the first. Stopping too early and staying too long both appear, in different tasks,[1][2] so the criterion names both a result and a limit.
A criterion that cannot fail, such as "until I feel sure."
Review the Log
Count your Exploration Rate, and check whether each EXPLORE action changed a decision.
Exploration Rate is a process count: actions taken mainly to learn or to "see what happens", divided by total actions. In one study across three bandit tasks, exploration scores were only poorly to moderately stable across sessions.[4] The count reviews your process; it does not score your personality.
Judging the process by whether the exploring paid; one lucky sample says little about whether the budget was sound.
Operational logic
It also protects exploration. An action labelled EXPLORE, with its purpose written down, is a legitimate use of time rather than a lapse. The rule cuts both ways: a lucky sample taken outside the budget is still a breach of process, and a well-run exploration that finds nothing was still well run.
Keep the protocol to everyday choices such as tools, routines and training methods; the cited models do not reach markets or investments. Its structure mirrors the Special's article on Signal Detection Theory: Hits, Misses, False Alarms and Correct Rejections: a criterion set in advance and a price on each kind of error. The parallel is structural. The nearest research is the sequential-sampling work on single decisions, where evidence builds until it crosses a threshold.[31][63]
A budget is permission as much as a limit.
06Verdict
The verdict.
Explore on purpose, and stop on purpose.
Bottom line
The aim was never to explore less; it is to know what every sample is for.
The explore-exploit trade-off is a real decision problem: firm mathematics in narrow cases, no known general optimum, behaviour that changes with the task, and an unsettled brain account. Exploring is not irrational in itself. In this article's worked bandit model, a long horizon raises option value, but another sample pays only when what it could teach is worth more than it costs. The evidence supports a narrower discipline: know whether an action is meant to learn or to use, what a sample costs, and what result ends the search, the job of a stopping rule. That discipline rests on the mathematics and on laboratory errors that run both ways, not on a measured habit of over-sampling.
Put a label, a price and an end on every round of sampling, and the question of whether you explore too much largely answers itself.
Leave this topic by dropping its favourite question. "Do I explore too much?" asks for a verdict on your character. "What is this sample for, what does it cost, and what ends it?" asks for a decision, and only that question has a useful answer.
If a search that never quite closes sounds familiar, the evidence takes your side and then sets terms. It never calls the urge to learn a flaw. It also prices every sample, and it shows people failing in both directions.
The change is small. Exploring and exploiting are not temperaments. They are two jobs the same next action can do, and your task is to name the job before you act. The parent guide, Strategic Inaction: Why Doing Nothing Is Sometimes the Highest-Performance Decision, shows where this piece sits in the series; the glossary entry on the exploration-exploitation trade-off, the Strategic Inaction Assessment and Decision Threshold Calibration are its companions.
Value of a sample, against what it costs.
Exploring Is Not Irrational in Itself
In this article's worked example, the value of exploring rises with the choices that remain, in the bandit framework that formal theory describes;[7] in a human task, exploration rose with the number of future encounters people expected.[10] No general optimum is known, so no one can name the right amount of exploring.[5]
The Failures Run Both Ways
The documented errors range from stopping too early in some tasks to staying too long in others.[1][2] A rule that only says "explore less" would cure one failure and feed another.
Label, Price, End
Before you act, label the action EXPLORE or EXPLOIT, fix the horizon and the cost, and write the stopping criterion. The protocol gives each sample a purpose and an end, which is the part of the trade-off you control.
07Bibliography
The bibliography.
-
01
Meta
doi: 10.1037/bul0000115
A meta-analytic review of two modes of learning and the description-experience gap
-
02
Journal
doi: 10.1093/oxfordjournals.beheco.a000381
State dependent behavior and the marginal value theorem
-
03
Meta
doi: 10.1111/ejn.70081
Meta-analysis reveals that explore-exploit decisions are dissociable by activation in the dorsal lateral prefrontal cortex, anterior insula, and dorsal anterior cingulate cortex
-
04
Journal
doi: 10.1038/s41598-025-09152-2
Model-based exploration is measurable across tasks but not linked to personality and psychiatric assessments
-
05
Review
doi: 10.1098/rstb.2007.2098
Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration
-
06
Journal
doi: 10.1090/s0002-9904-1952-09620-8
Some aspects of the sequential design of experiments
-
07
Journal
doi: 10.1111/j.2517-6161.1979.tb01068.x
Bandit processes and dynamic allocation indices
-
08
Review
doi: 10.1037/dec0000033
Unpacking the exploration-exploitation tradeoff: A synthesis of human and animal literatures
-
09
Journal
doi: 10.1037/a0038199
Humans use directed and random exploration to solve the explore-exploit dilemma
-
10
Journal
doi: 10.1037/dec0000074
Exploratory choice reflects the future value of information
-
11
Review
doi: 10.1037/0033-2909.116.1.75
The psychology of curiosity: A review and reinterpretation
-
12
Journal
doi: 10.1037/dec0000068
Information gaps: A theory of preferences regarding the presence and absence of information
-
13
Journal
doi: 10.1002/1099-0771(200010/12)13:4<391::aid-bdm359>3.0.co;2-i
Optimal stopping behavior with relative ranks: The secretary problem with unknown population size
-
14
Journal
doi: 10.1002/bdm.521
Experimental studies of sequential selection and assignment with relative ranks
-
15
Journal
doi: 10.1111/j.2517-6161.1980.tb01111.x
Multi-armed bandits and the Gittins index
-
16
Journal
doi: 10.1214/aoap/1177005207
A short proof of the Gittins index theorem
-
17
Journal
doi: 10.1214/aoap/1177005588
On the Gittins index for multiarmed bandits
-
18
Journal
doi: 10.2307/3214163
Restless bandits: Activity allocation in a changing world
-
19
Journal
doi: 10.1002/asmb.874
A modern Bayesian look at the multi-armed bandit
-
20
Review
doi: 10.1561/2200000070
A tutorial on Thompson sampling
-
21
Journal
doi: 10.1007/978-3-642-34106-9_18
Thompson sampling: An asymptotically optimal finite-time analysis
-
22
Journal
doi: 10.1561/2200000024
Regret analysis of stochastic and nonstochastic multi-armed bandit problems
-
23
Journal
doi: 10.1561/2200000068
Introduction to multi-armed bandits
-
24
Journal
doi: 10.1037/dec0000101
Uncertainty and exploration
-
25
Journal
doi: 10.1016/j.cognition.2017.12.014
Deconstructing the human algorithms for exploration
-
26
Review
doi: 10.1016/j.conb.2018.11.003
The algorithmic architecture of exploration in the human brain
-
27
Review
doi: 10.1016/j.cobeha.2020.10.001
Balancing exploration and exploitation with information and randomization
-
28
Journal
doi: 10.5334/cpsy.101
Signatures of perseveration and heuristic-based directed exploration in two-step sequential decision task behaviour
-
29
Journal
doi: 10.1038/s41593-019-0518-9
Computational noise in reward-guided learning drives behavioral variability in volatile environments
-
30
Journal
doi: 10.1523/jneurosci.4010-11.2012
The cost of accumulating evidence in perceptual decision making
-
31
Journal
doi: 10.1037/0033-295x.113.4.700
The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks
-
32
Journal
doi: 10.1038/s41562-019-0793-1
How people decide what they want to know
-
33
Review
doi: 10.1146/annurev.neuro.28.061604.135709
An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance
-
34
Journal
doi: 10.3389/fnhum.2010.00170
The role of the noradrenergic system in the exploration-exploitation trade-off: A psychopharmacological study
-
35
Journal
doi: 10.1371/journal.pone.0176034
The effect of atomoxetine on random and directed exploration in humans
-
36
Journal
doi: 10.1162/jocn.2010.21548
Pupil diameter predicts changes in the exploration-exploitation trade-off: Evidence for the adaptive gain theory
-
37
Journal
doi: 10.1162/jocn_a_02025
Pupil size encodes uncertainty during exploration
-
38
Journal
doi: 10.3758/s13415-022-00996-z
Pupil dilation and response slowing distinguish deliberate explorative choices in the probabilistic learning task
-
39
Journal
doi: 10.1038/nature04766
Cortical substrates for exploratory decisions in humans
-
40
Journal
doi: 10.7554/eLife.27430
A causal role for right frontopolar cortex in directed, but not random, exploration
-
41
Journal
doi: 10.7554/elife.51260
Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making
-
42
Journal
doi: 10.1523/JNEUROSCI.0261-26.2026
Individual differences in dopaminergic modulation of exploration-exploitation behaviour
-
43
Journal
doi: 10.1016/0040-5809(76)90040-x
Optimal foraging, the marginal value theorem
-
44
Journal
doi: 10.3758/s13415-015-0350-y
Learning the opportunity cost of time in a patch-foraging task
-
45
Journal
doi: 10.1167/13.3.10
When is it time to move to the next raspberry bush? Foraging rules in human visual search
-
46
Journal
doi: 10.1037/a0027373
Optimal foraging in semantic memory
-
47
Journal
doi: 10.1098/rsif.2021.0337
Uncertainty drives deviations in normative foraging decision strategies
-
48
Journal
doi: 10.1038/s41467-020-16964-5
Biased belief updating and suboptimal choice in foraging decisions
-
49
Journal
doi: 10.1073/pnas.1700811114
Changes in cognitive flexibility and hypothesis search across human life history from childhood to adolescence to adulthood
-
50
Journal
doi: 10.1177/0956797619863663
Searching for rewards like a child means less generalization and more directed exploration
-
51
Journal
doi: 10.1037/xge0000250
Charting the expansion of strategic exploratory behavior during adolescence
-
52
Journal
doi: 10.1038/s41562-023-01662-1
Developmental changes in exploration resemble stochastic optimization
-
53
Journal
doi: 10.3389/fnins.2013.00053
Foraging across the life span: Is there a reduction in exploration with aging?
-
54
Journal
doi: 10.1037/pag0000791
Differential impacts of healthy cognitive aging on directed and random exploration
-
55
Meta
doi: 10.1111/j.1749-6632.2011.06200.x
Age differences in risky choice: A meta-analysis
-
56
Journal
doi: 10.1111/desc.13095
Development of directed and random exploration in children
-
57
Review
doi: 10.1098/rstb.2019.0502
Childhood as a solution to explore-exploit tensions
-
58
Journal
doi: 10.3758/s13428-017-0935-1
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
-
59
Journal
doi: 10.1073/pnas.1818430116
Large-scale analysis of test-retest reliabilities of self-regulation measures
-
60
Journal
doi: 10.1016/j.cognition.2009.12.009
Decisions from experience: Why small samples?
-
61
Journal
doi: 10.1098/rspb.2015.1439
Irrational time allocation in decision-making
-
62
Journal
doi: 10.1037/xge0000466
The limits of learning: Exploration, generalization, and the development of learning traps
-
63
Review
doi: 10.1146/annurev.neuro.29.051605.113038
The neural basis of decision making
No entries match the current filter and search.
THE HAND-OFF — Performance Scan: find your limiting factor. Three minutes, 24 questions, six systems — and your answers never leave your device.
The Dispatch
One evidence-graded idea, worth the read, every Sunday.
One deep dive a week, graded the way this one was: every source checked before it is cited.