Bullpen.News From Edwin Dorsey
Get Daily Recap Feedback

Thursday, November 5, 2026

Back to the front page

From X

@convequity

Convequity on X

Batch size sets the trade-off between speed and cost in AI inference. An AI server answers many users at once by bundling their requests into one batch. Our $CBRS note compares this to running a bus. There are two ways to run it, and each gives something up. 1. Fill the bus. Put as many passengers as possible on every run. More stops slow each passenger's trip, but the cost of the run is spread across more people, so the cost per passenger falls. Larger batches do the same: each user's answer is slower, and the cost per token falls because the system produces more tokens from the same hardware. 2. Carry fewer passengers and stop less. Each trip is faster, but fewer seats mean the cost of the run is spread less well, so the cost per passenger rises. Smaller batches are fast for one user and raise the cost per token. So in the analogy, speed for each user is how fast each passenger arrives. Cost per token is cost per passenger. A system set up for one gives up some of the other. When someone compares two inference systems, check the batch size behind each number. A speed figure or a cost-per-token figure quoted without it cannot be compared fairly.

Investor Letters

All letters

Problems at Twist Bioscience (TWST)

Twist Bioscience’s $200 rebound followed an Anthropic-linked short squeeze, yet its DNA and protein services face broad competition while…

TWST $8B
Hunterbrook 4 clicks

VSH Earnings Review

Vishay reported record Q3 revenue of $979 million, up 24%, and guided Q4 to about $990 million as rising backlog and margins contrast with…

VSH $3.6B
Cestrian Capital Research 3 clicks

Thursday Tailwinds #13: Nov 5, 2026

Florida marinas are 92% full as boat counts rise and permits constrain new supply, creating pricing power for existing operators such as…

SUI $14B
Trade Ideas Flow 6 clicks
CHWY · long

Chewy INC

Chewy (CHWY) is presented as a long opportunity after a prior 2022 short thesis played out.

CHWY $9.2B
Value Investors Club 5 clicks

New Ideas From The Road

Aurelion Research increased healthcare exposure and sees opportunities in banking and defense, alongside research on Alcoa, Nike, ONON and…

AA $10BNKE $60B
Aurelion Research 4 clicks

Site Centers (NYSE:SITC)

Site Centers' $3 per-share return-of-capital distribution and December delisting leave a discounted liquidation stub, with two properties…

CURB $3.6B
Real Assets, Real Value 5 clicks

Coupang: 3Q26 Business Recap

Coupang’s product-commerce growth rose 9% as data-leak effects fade, while management expects margins to return to pre-incident levels by…

CPNG $27B
Speedwell Memos 3 clicks

update on Gartner

Gartner’s growth has stalled after federal contract losses and cautious commercial spending, raising questions about its competitive…

IT $13B
scuttleblurb 1 click

Publications we follow

Every publication on this site, hand-picked.

129 publications

Newsletters 109

YouTube 4

Blogs 15

Seeking Alpha 74 of 278

Nominate a publication

X accounts we follow

Every account on this site, hand-picked.

91 accounts
Nominate an account

Investor letters we follow

359 firms

Sectors

Ordered by how often our editor reaches for them.