Benchmarking AI with Stanislav Khromov

In this episode, Stanislav Khromov joins the Svelte Radio team to discuss his work on Svelte Bench, a

benchmarking tool that scientifically measures how well different LLMs understand and write Svelte 5 code.

The conversation explores the challenges of AI-assisted coding with Svelte 5, the development of the official

Svelte MCP (Model Context Protocol) that provides LLMs with documentation and auto-fixing capabilities, and

the surprising performance differences between major AI providers. Stanislav also shares insights on working

with AI tools, the future of local models, and the economics of AI coding assistants.

Notes

  •  Stanislav Khromov (https://stanislav.garden) 
  •  Svelte Bench (https://khromov.github.io/svelte-benc...) 
       •  GitHub (https://github.com/khromov/svelte-bench) 
  •  Svelte MCP (https://svelte.dev/docs/mcp/overview) 
  •  Anthropic Spending VC Money (https://www.wheresyoured.at/costs/) 

Unpopular Opinions

  •  Kevin: Serverless is overrated
  •  Stanislav: OpenAI has the worst models of the big three
  •  Antony: Heat Pumps are bad
       •  Technology Connections (   / technologyconnections  ) 
       •  Tech Ingredients (https://www.youtube.com/@TechIngredie...) 

Picks

  •  Kevin: Kasai Hibachi Grill (https://eu.kasaigrills.com/)  (now tested, and can confirm, it is PENG!)
     Stanislav: Ball x Pit (https://store.steampowered.com/app/20...) 
     Antony: Saunas By the Sea

Benchmarking AI with Stanislav Khromov

미국 빅테크 복지는 얼마나 좋을까? #아마존

Vue.js Forge, Ep. 5: How to NOT Block Navigation in Nuxt ~ Mostafa Said

AWS Tutorial Course for Beginners | EC2, S3, RDS, VPC, Lambda, ECS, ECR & Fargate | Hands-On Guide

18-2강 - 실시간 투자 현황 모니터링(2) - 웹 사이트 대시보드 만들기

개발자가 알려주는 바이브 코딩이란

개발자 취업 어려운게 진짜 맞나?