Roni Kobrosly Ph.D.'s Website

To be totally honest with you, I have no fucking clue what is going on with the cost of AI inference. I hear partially-informed murmurs almost every day. Is it getting cheaper because of improvements in this new field of "Inference Engineering" or in GPUs? Something about TPUs? Or are our complex reasoning models and larger context windows resulting in greater costs? Maybe the improvements and greater token throughput balances out in the end? 😅 What does it mean, precisely, when we say "AI costs are subsidized"?

My father has an old picture of my grandfather that he loves. Unfortunately it's blurry and artifacted. For the last five years, at the end of each year, I've taken a few hours to see if cutting edge tech tools for digital image restoration could improve it. They failed miserably until EOY 2025...

Let's say you've fully instrumented your organization's applications with OpenTelemetry. You're capturing tons of useful metrics, trace data, and service attributes. Congratulations! Will incident time to recovery drop? Let's think through this before you celebrate too much...

I was invited to speak at the Prefect-sponsored PyAI DC event and had a wonderful time meeting DC's AI community. It was an honor to speak alongside both AWS and government data leaders. The highlight of the night was Prefect's leadership giving some details about the upcoming major update of FastMCP...