Bullpen.News From Edwin Dorsey
Get Daily Recap Feedback

Monday, October 5, 2026

Back to today

From X

@convequity

Convequity on X

Batch size sets the trade-off between speed and cost in AI inference. An AI server answers many users at once by bundling their requests into one batch. Our $CBRS note compares this to running a bus. There are two ways to run it, and each gives something up. 1. Fill the bus. Put as many passengers as possible on every run. More stops slow each passenger's trip, but the cost of the run is spread across more people, so the cost per passenger falls. Larger batches do the same: each user's answer is slower, and the cost per token falls because the system produces more tokens from the same hardware. 2. Carry fewer passengers and stop less. Each trip is faster, but fewer seats mean the cost of the run is spread less well, so the cost per passenger rises. Smaller batches are fast for one user and raise the cost per token. So in the analogy, speed for each user is how fast each passenger arrives. Cost per token is cost per passenger. A system set up for one gives up some of the other. When someone compares two inference systems, check the batch size behind each number. A speed figure or a cost-per-token figure quoted without it cannot be compared fairly.

Investor Letters

All letters

British American Tobacco: Harvest

British American Tobacco’s U.S. reset revives combustibles and rebuilds its nicotine-pouch portfolio after legacy-brand writedowns and Velo…

BTI $120B
Invariant 5 clicks

Practical Parametric Yield

Cerebras’s WSE-3 faces parametric-yield constraints that could restrict supply, making power and clock-speed tradeoffs central to its next…

CBRS $39B
Irrational Analysis 3 clicks
BTU · long

Peabody Energy Corporation

Peabody Energy, ticker BTU, is a low-cost producer of thermal and metallurgical coal with mines in the United States and Australia.

BTU $3B
Value Investors Club 2 clicks

Nike, Part Two: The Deep Dive

Nike’s second Latticework program examines the company and the global athletic footwear and apparel industry for professional investors.

NKE $51B
Latticework by MOI Global 1 click

Nike, Part One: The Story

Nike grew from a $1,000 shoe-distribution venture in 1964 into the largest sports brand, using athlete endorsements, product innovation and…

NKE $51B
Latticework by MOI Global 2 clicks

Publications we follow

Every publication on this site, hand-picked.

109 publications

Newsletters 92

YouTube 4

Blogs 12

Seeking Alpha 46 of 218

Nominate a publication

X accounts we follow

Every account on this site, hand-picked.

74 accounts
Nominate an account

Investor letters we follow

189 firms

Sectors

Ordered by how often our editor reaches for them.