Training a 4B model to produce 81% faster query plans than Postgres
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Training a 4B model to produce 81% faster query plans than Postgres
Unofficial Hacker News client; not affiliated with Y Combinator.
refibrillator · · focus · HN ↗
I would be cautious about over fitting, it’s tough to say if those query plans would really be more optimal than Postgres heuristics at scale and with a bit more realistic OLTP workloads.
In any case, such is life with profile guided optimization. Many of us appreciate how database workloads can drift over time and with scale.
Kudos to the author for getting their hands dirty and writing up their experiments.
sandeepkd · · focus · HN ↗
Couple things that I found interesting
1. Inefficiencies/limitations of the query planner in certain cases are known for a long time, its a trade off. This is the reason why hints exists and one can provide their own plan too. DBAs have been doing that for a while now.
2. A SQL database by design is a resilient unit in itself just dependent on CPU and memory/disk. The availability for the DB is heavily dependent on this factor. Everything built on the top derives their availability and reliability from this. Adding an LLM in between is more cost for sure, question is if its really brining the benefits which are worth the trade off
treebeard901 · · focus · HN ↗