#measurement
6 posts tagged measurement. · All tags
- It Was Not AI That Came, It Was Only ChatGPT Memory and traffic jumped and analytics showed nothing. Counting the server log by User-Agent, 11,321 of 15,001 requests over three hours were one backlink-tool bot. After blocking seven bots I looked at analytics again, and the "AI Assistant, 53 sessions" bucket turned out to be one company
- The Replication Job Was Recording "No Upstream" as Success I asked for a cleanup of two months of data and found the price history had stopped on August 24. An upstream password rejection started it, and then one env var missing from the cutover turned a loud failure into a quiet success. Also, the safety guards passed 518 times in two months
- Failing to Reproduce It Locally Did Not Mean There Was No Bug After the move to Railway, the web frontend climbed from 226MB to 833MB in a straight line over 26 hours. It was not render load, and the sibling service on the same stack was fine. I hammered it with 3,000 requests on my Mac, could not reproduce it, and wrote down "not reproducible by request volume." Then I measured again inside a container and got 388KB per request. The platform had been hiding the signal
- I Opened Up Effort and Effort Was Empty I added per-job model and effort selection to the shared queue. When I had it do a self-review, the agent measured with 9 scratch sessions and found that the thinking I had turned off five days earlier was neutralizing effort. Why I split the requested value and the actual value into two columns, and how after deploy the docs and production disagreed in five places
- I Turned Thinking Off 85.8% of the summary job's output tokens were thinking. One environment variable turned it off: output −85%, 4.5x faster, schema 10/10, and the summaries actually had more numbers. And why the one line that turns it off could have killed auth for three projects at once
- I Rebuilt the Desktop Layout Five Times in Four Days A service that stayed mobile-only for four months turned out to get 96% of its search traffic from desktop. A record of measuring the dead whitespace, adding a rail, throwing away the two-column cards after 6 hours, and rewriting everything from a design handoff