Mathematical Problem Solving
Specify the worlds, the legal actions and the claim before calculating.
On this page
A quantitative puzzle often needs only elementary tools. The difficult step is choosing a model that preserves the question. An average, a probability and a worst-case guarantee are different claims, even when they concern the same process.
First describe possible worlds and legal actions. Then ask what an action changes, reveals or preserves. Counting and algebra become useful only after those meanings are clear.
What would count as an answer?
| Question | Needed evidence |
|---|---|
| Is it possible? | One valid construction |
| Must it happen? | A proof covering every allowed case |
| With what probability? | A specified random experiment and event |
| On average? | An expectation under that model |
| Can we guarantee it? | A strategy against the worst allowed case |
| What is the minimum? | An impossibility bound and a matching construction |
A randomized strategy can have a small mean cost and an unbounded worst case. A strategy using k steps proves an upper bound, not optimality. An information limit proves a lower bound, not an attainable procedure.
Write down replacement policy, independence, available observations, legal queries and what the answer must identify. A counterfeit coin's identity and its heavy/light status may be different requested outputs.
Define the elementary outcomes
Counting requires a definition of distinct outcomes. Choosing three people for a committee ignores order. Choosing a chair, secretary and treasurer preserves order. Drawing with replacement permits repeated choices; drawing without replacement does not.
| Construction | Count |
|---|---|
| Choose k without order | |
| Choose and order k without repetition | |
| Order all n | n! |
| Length-k sequence with repetition | nᵏ |
The product rule multiplies stage counts when every preceding construction has the stated number of continuations. If the next count depends on the first choice, sum the counts of those branches instead.
Two fair-coin tosses have four equally likely sequences: HH, HT, TH, TT. Grouping them into “two heads”, “one head” and “zero heads” does not make those three categories equally likely. Their probabilities are 1/4, 1/2 and 1/4.
Conditioning changes the relevant worlds
For ten independent fair-die rolls, at least one six is easier through its complement: . Multiplication is valid because the rolls are independent. Events occurring at different times are not automatically independent.
For , . Keep only worlds compatible with B and renormalize their weights. If a message was produced by a selection procedure, include that procedure; the message's wording alone may not specify its likelihood.
A table of hidden types, prior probabilities and observation likelihoods helps with tests, boxes, doors and family-information puzzles. Probability and Distributions → gives the full conditional/joint framework.
For independent events with P(A) > 0, P(B | A) equals P(B), so the intersection probability is P(A)P(B). For mutually exclusive events, the union rule reduces to P(A)+P(B).
Mutually exclusive events have zero overlap. Independent events have product overlap. Positive-probability mutually exclusive events therefore cannot also be independent.
Count events with indicators
For a discrete quantity X with a finite expectation, . Instead of finding its complete distribution, sometimes write X as a sum of indicators. Indicator Iᵢ is 1 when event i occurs and 0 otherwise, so .
In a uniformly random permutation of n≥1 objects, let Iᵢ indicate that object i stays in its original position. Each has probability 1/n, so the expected number of fixed points is .
Linearity also applies to any finite sum of random variables with finite absolute expectations: the expectation of the sum equals the sum of their expectations. Indicators are a useful special case, not a separate independence assumption.
The events are dependent. For two objects, either both remain or neither remains. Dependence does not invalidate linearity. The empty permutation has zero fixed points; the argument does not cover n=0.
An expectation is not a typical outcome or a guarantee. If signed quantities have divergent positive and negative parts, an expression such as ∞−∞ does not define an expectation. Infinite sums require additional convergence or nonnegativity conditions.
Keep only the useful past
For a waiting-time problem, store enough history to predict the next transition, but no irrelevant history. To wait for HH in independent fair tosses, the useful suffix is either empty or H. Once HH appears, the process has finished.
From the empty state, H leaves suffix H and T leaves no useful suffix. From H, another H finishes, while T resets. The reset term is why “two heads means four tosses on average” is not the correct calculation for consecutive heads.
The equations have a finite solution here. One independent two-toss block succeeds with probability 1/4, giving a finite upper bound of eight tosses by checking only disjoint blocks. Allowing overlapping successes can only finish earlier. This supports using finite first-step expectations.
For a nonnegative integer completion time T and nonnegative integer cutoff m, . Each included toss contributes one exactly when completion has not yet occurred. The finite sum measures truncated waiting, not a guaranteed completion by m.
A state must be sufficient for the actual model. A biased or dependent coin changes the transition probabilities, and a longer target can require more suffix states. This is stochastic state reasoning, related to Dynamic Programming →, not enumeration of every past sequence.
Probability mass moves through suffix states
Exact distribution over independent fair-coin sequences, not one random animation. Finished mass stays finished as toss count increases.
After 6 tosses, P(T > 6) = 32.81%. Here T is the first completion time, not an individual coin outcome.
E[min(T,6)] = 4.281250 tosses. This finite partial tail sum approaches 6; it is not the full expectation at a finite step.
Exact small input, not a speed benchmark. Step order follows the algorithm; playback is optional. Rows show probability mass. Every state is labeled; bar width is measured on the same probability scale.
A rate is not a probability
A homogeneous Poisson process has stationary independent increments and a constant rate λ>0. In a short interval Δ, one arrival has probability λΔ+o(Δ), and multiple arrivals have probability o(Δ). A constant long-run average alone does not establish these properties.
Six calls per hour during ten minutes gives . Therefore , about 63.21%. The number six is a rate, not a probability of a call.
The wait Tₖ to the kth arrival is Gamma with shape k and rate λ, also called Erlang for integer k. and . Counts and waiting times describe the same arrivals from different directions.
Exponential memorylessness gives , for nonnegative s and t. Waiting without an arrival does not make one due. This conclusion is not appropriate for scheduled buses, aging hardware or history-dependent rates. Poisson definition and waiting-time derivation ↗
The mean wait is not the median, which is , or a deadline. Bursts, resource limits and self-exciting arrivals require a different model. The lab includes zero rate as a no-arrival boundary case, not an exponential distribution with rate zero.
One count event, one waiting-time event
Keep the homogeneous independent-increment assumptions fixed. Change rate, interval length and the arrival number.
μ = 6 arrivals/hour × 10/60 hour = 1.000 arrivals.
P(N(t) ≥ 1) = P(T1 ≤ t) = 63.21%. Both expressions describe the same event.
Expected time to arrival 1: 10.00 minutes. That mean is not a deadline or a guaranteed waiting time.
Bars use a fixed 0–100% scale. The 9+ row groups the remaining count tail, not exactly nine arrivals. This is a model calculation, not sampled traffic.
Combine, label and condition arrival streams
Independent Poisson streams with rates λᵢ combine into a Poisson stream with rate Σᵢλᵢ. For two positive-rate streams, the next arrival's type is 1 with probability λ₁/(λ₁+λ₂), and the waiting time is exponential with their combined rate.
Independent labeling of each event as retained with probability p gives retained rate pλ and discarded rate (1−p)λ. The two labeled streams are independent before conditioning on a total. Keeping every second event is not independent labeling and does not have this thinning guarantee. Merging and independent thinning ↗
Given N(t)=n for t>0, the unordered event locations have the distribution of n independent uniform points in the interval. The ordered arrival times are their order statistics, not mutually independent ordered values.
For four arrivals in an hour, the number in its first quarter has mean . Its complement count is four minus that number. The two counts are no longer independent once their total is fixed. Conditional arrival locations, Lecture 4 ↗
A lower bound is not a strategy
A depth-k adaptive decision tree has at most bk leaves. If every hidden world must be identified separately, there must be at least N leaves. Yes/no questions have at most two branches; a balance scale has at most three.
Eight hidden cases need at least 3 binary answers. Arbitrary subset questions can attain this bound by successively halving the cases. A scale cannot necessarily realize every desired partition: legal weighings restrict which cases produce each outcome.
If the answer must identify both one of n suspect coins and its heavy/light status, there are 2n worlds. If only a coarser answer is required, worlds that can safely share that answer need not occupy separate leaves. State the identification objective before counting.
Impossible branches, unequal splits and legal-query restrictions can make the bound unattainable. Adaptive strategies choose the next query from previous outcomes; non-adaptive strategies fix every query beforehand. Prove both the lower bound and a legal matching construction before claiming an optimum.
Information Theory → connects probabilities to average code lengths. A worst-case leaf-count bound is not the same as an expected-length entropy bound.
Delay the event as long as possible
The pigeonhole principle guarantees a repeated box when more objects than boxes are assigned. More generally, N objects in n>0 boxes force at least one box to contain ⌈N/n⌉ objects.
With twelve birth months, thirteen people force a shared month. Twelve people do not: put one in each month. This arrangement supplies the matching lower-bound example, not merely an intuitive argument.
For a guarantee of at least an integer r≥1 objects in one of n boxes, the delaying arrangement puts r−1 in every box. Thus n(r−1)+1 objects suffice and n(r−1) need not suffice, assuming those assignments are all allowed. Unequal capacity or prohibited assignments change the argument.
No probability model is needed. A birthday probability question with random birthdays is a different calculation; worst-case assignment is not replaced by an average distribution.
A legal move cannot repair every difference
An invariant is a property preserved by every legal move. Candidate properties include parity, a sum or difference, a residue modulo m, permutation parity or a connectivity feature. Prove preservation for the actual move; do not assume a component count stays fixed when moves can connect components.
Remove opposite corners of an 8×8 chessboard. Both have the same color, leaving 30 of that color and 32 of the other. Every domino covering adjacent squares uses exactly one of each color. Therefore 31 dominoes cannot cover the remaining board.
Equivalently, every placed domino changes the uncovered color counts by (−1,−1), preserving their difference of two. A fully covered board would have difference zero, so it is unreachable.
Equal color counts would only remove this obstruction. They would not prove a tiling exists: disconnected regions or other shape restrictions can still prevent one. An invariant usually proves impossibility before it provides a construction.
Strict progress needs a well-founded domain
A monovariant changes strictly in one direction on each move. To prove termination, the possible values must forbid an infinite chain in that direction. A decreasing nonnegative integer works because each move lowers it by at least one.
Strict decrease and a real lower bound alone are insufficient. decreases forever while staying above zero. A real-valued potential needs an additional argument, such as a uniform decrease of at least ε>0 or a finite set of allowed values.
Separate termination from efficiency. A potential can prove that a process ends without giving a useful bound in the input size. Also verify strict progress for every legal step, including ties and no-op moves.
Preserve the experiment, not just the picture
A transformation can equate case probabilities only when it preserves the random experiment and exchanges those cases. Relabeling a fair die's faces preserves its procedure. A weighted die can have the same shape without preserving the probability law.
Rotate, reflect, permute or relabel to simplify cases. Check exceptional configurations: some have fewer distinct images under the transformation. For two fair tosses, swapping toss positions exchanges HT and TH but leaves HH unchanged. Counting symmetry classes as equally likely would reproduce the wrong three-category model.
A bijection proves equal counts when it pairs valid objects. Probability equality additionally requires preserving their weights. Symmetry is a proof tool, not a substitute for defining the experiment.
Use total time instead of every trip
Two objects moving directly toward each other at constant speeds v₁ and v₂ close a separation D at rate v₁+v₂. The collision time is , for positive total closing speed.
A fly traveling continuously at speed vf until the collision covers vft. Summing every back-and-forth trip adds complexity without changing the total available flight time. This uses instantaneous turning and no pauses as idealized assumptions.
Machines taking two and three hours per unit have combined rate units/hour. They complete one unit in hours, not the average of their completion times.
Sequential dependencies, indivisible tasks, interference and varying speed can invalidate rate addition. Track units: distance=speed×time and work=rate×time. Matching units is necessary but does not by itself establish the physical model.
Translate statements into constraints
Name unknowns before manipulating numbers. If a father and child have current ages x and y, their ages d years ago are x−d and y−d. Shift both ages by the same duration; their difference stays x−y.
Choose a representation that makes actions explicit: a table for hidden cases, a graph for routes, a state tuple for containers, a decision tree for adaptive observations, equations for conserved quantities.
When the goal is highly constrained, work backward through possible predecessor states. Every reversed step must correspond to a legal forward move. Directed transitions are not automatically reversible; a backward search may need incoming edges rather than the ordinary forward rule.
Choosing Algorithms → connects representation, requested output and maintained state. The representation should simplify the legal operations without losing information needed by the question.
The same observation can fit different models
Suppose the probability of seeing at least one truck in one hour is 0.99. That number alone does not determine the half-hour probability.
If the two half-hours have identical independent no-arrival probabilities q, then . Therefore q=0.1 and the half-hour arrival probability is 0.9. A homogeneous Poisson model supplies these assumptions, but the single observation does not prove that model.
| Model | One-hour arrival probability | Half-hour arrival probability |
|---|---|---|
| Independent identical halves | 0.99 | 0.90 in either half |
| With probability 0.99, a truck in each half; otherwise none | 0.99 | 0.99 in either half |
| With probability 0.99, only the first half has a truck | 0.99 | 0.99 first half; 0 second half |
The second model has identical halves but dependence. The third loses stationarity. These constructions show exactly which additional assumptions the square-root answer uses.
Recognizing underdetermination is a valid result. State the extra assumption needed for a unique answer instead of silently solving a stronger question.
From a conjecture to a proof
Use small cases n=1,2,3,4 to find a candidate pattern or counterexample. Then seek induction, a recurrence, an invariant, a bijection or a counting argument. Small successes suggest a theorem; they do not prove it.
Check empty sets, probabilities zero/one, equal values, attained boundaries and singleton states. For a minimum, pair an impossibility argument with a matching legal strategy. For an expectation, verify finiteness or state that it diverges.
- Write the objective and hidden states.
- Specify the random model and legal observations.
- List assumptions: independence, replacement, constant rates, information and movement rules.
- Choose a representation and a preserved or changing quantity.
- Try small cases or legal backward steps.
- Derive the result, then check probability bounds, units and edge cases.
- Separate a bound, a construction and an optimality proof.
For revisiting these tools, a useful order is conditioning/counting, then indicators and state equations, then arrivals, guarantees, information bounds and invariants. Rates and algebra are often simpler than a long simulation.
Common failure modes are multiplying without independence, counting without equal weights, confusing means with guarantees, claiming a lower bound is attainable, using visual symmetry as probability evidence and assuming bounded real progress must terminate.
References
Poisson counts and arrival times ↗ · Independent stream operations ↗ · Conditional arrival locations ↗
Backtracking → makes legal branch exploration and restoration explicit. Bits, Numbers, and Geometry → applies arithmetic and coordinate invariants to algorithms.
Interactive probabilities are calculated from explicitly stated idealized models. They are not measured arrival data or claims about a particular physical system.