Do you do AI?
Do you do AI and machine learning? I am an academic and get asked this question; but I am never sure how to answer and so perhaps answer rather hesitantly and mumble. I thought I'd write an answer here instead.
Besides physics, my interests for over a decade have included the foundations of statistics, the foundations of science, statistical computation and computing & technology. That started perhaps as early as my Ph.D - where I applied Bayesian methods to models in particle physics - or perhaps as early as my undergraduate degree - where I thought about applying crude Markov Chain Monte Carlo algorithms to a simplified supersymmetric model - or perhaps as early as high-school - where a maths teacher ran a Monte Carlo simulation over the course of an hour, in real-time, to demonstrate the central limit theorem - or maybe primary school - where I remember puzzling about the probability of outcomes of a football match (two teams; 50-50? but surely not. A paradox to me then.)
Yes, then, I am interested in AI and machine learning, and have many questions surrounding it. Regarding my more philosophical interests in the foundations of science and statistics, e.g., what are the foundational principles of AI and machine learning? Is it truly a novel way of learning from data? Why is it so focused on prediction versus inference? Is that what distinguishses it from other fields? Is it a new field or an intersection of existing ones?
On the computational side, can machine-learning methods improve on traditional methods of statistical computation? What should be their relationship to e.g. MCMC? Should they replace it? or operate as a subalgorithm for efficient proposals? Do machine learning methods for e.g., density estimation, truly evade the curse of dimensionality? If not how does it manifest?
On a more technical and personal level, e.g., do I understand modern neutral network architectures and attention transformers? Is there a simple statistical model that demonstrates double descent? Do I grok LLMs? (Do I grok how a calculator works!? If not why do I expect to grok LLMs?)
On a political or sociological level, e.g., are LLMs a 'good thing'? Do we have a choice about the way technology impacts society and our future? What do we want our relationship with AI to be?
Is this what anyone wanted to hear? No. I'm rather afraid that it isn't. I've found that the question really means, have you embraced AI and machine learning? Are you part of an AI maximalist future where we press buttons and boost productivity? Which is why I mumble.
Tags: AI