Just a quick note, I find it disappointing that so many point-wise estimators are used in general. If we have a given metric for error, $d\left(y,\hat{y}\right)$, and a prior and likelihood, it seems intuitive that optimization should focus on solving:$$\underset{\hat{y}}{\mathrm{argmin}} \int d\left(y,\hat{y}\right) p\left(x|y\right)p\left(y\right)dy$$But usually you don't see it cast like this, which is a shame because you can end up with the wrong peak and bad overfit. Plus, you can put all sorts of fun regularizers in the prior, such as variation minimizers. Anyway, bad post, just was living on my mind.
Subscribe to:
Post Comments (Atom)
March thoughts
Lets start by taking any system of ordinary differential equations. We can of course convert this to a first order system by creating stand-...
-
Ok, here's the idea. Suppose I had a function $$f:X \to Y$$ and distance metrics $d_X:X \to \mathbb{R}$ and $d_Y:Y \to \mathbb{R}$. If ...
-
Here's some code to generate those basis functions from yesterday. As you might imagine, you need to increase the decay rate as you ask ...
-
Using the family of functions we defined a couple days ago of the form $f_n\left(x\right) = \sum^n_{k=0} c_{k,n} x^k e^{-\frac{x^2}{2}}$ we ...
No comments:
Post a Comment