At some point in every optimist's life, we are going to be asked the age-old question: "How does your method compare with Adam?" or, even more annoyingly, "Does this analysis help understand Adam?" I mean, Adam is a nice method that works very well for a very unique set of optimization problems, and not, like, … Continue reading We need to talk about Adam
Tag: machine learning
Video time! Discretization methods on quadratic and logistic regression
Hi all, this is another "tiny project" that I've been wanting to do for a while. Lately, I've been somewhat obsessed with method flows and discretization methods. While we can sit here and write integrals until our faces turn blue, I think it's time to just simulate some stuff, and just see what happens. In … Continue reading Video time! Discretization methods on quadratic and logistic regression
Achievable online predictions
Hi all, it's been a while! I took a step back from this blog to focus on teaching and research and such, but now that the last class is over for the fall, time to get back to this! Today's topic is now focused more on learning theory, which is an area I'm trying to … Continue reading Achievable online predictions