Totus floreo

less than 1 minute read


A song from a time long since gone…

Thoughts on research so far

2 minute read


So I’ve been reading the field of machine learning for some time now, and I must say I’m disappointed. Survey any large conference such as NeurIPS, ICML, or ICLR, and 90% of the papers are backpropagation with some extra code sprinkles. Now I can understand that, it’s a powerful technique that is general enough to solve many tasks, and I like that too. But there is a serious lack of deep thought happening here, which is the typical technique when solving any problem. It’s like AI is already autonomising our problem solving technique by tempting researchers into a gold rush scenario, leaving everyone with heat stroke from the searing heat of our GPUs. On the other hand it’s quite nice, you only have to read 10% papers that might contain original ideas that aren’t fully crackpot.