this post was submitted on 08 Jul 2024
858 points (96.8% liked)

Science Memes

11081 readers
2672 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 53 points 4 months ago (6 children)

Bayesian purist cope and seeth.

Most machine learning is closer to universal function approximation via autodifferentiation. Backpropagation just lets you create numerical models with insane parameter dimensionality.

[–] [email protected] 43 points 4 months ago

I like your funny words, magic man.

[–] [email protected] 8 points 4 months ago (1 children)
[–] [email protected] 18 points 4 months ago* (last edited 4 months ago)

Universal function approximation - neural networks.

Auto-differentiation - algorithmic calculation of partial derivatives (aka gradients)

Backpropagation - when using a neural network (or most ML algorithms actually), you find the difference between model prediction and original labels. And the difference is sent back as gradients (of the loss function)

Parameter dimensionality - the “neurons” in the neural network, ie, the weight matrices.

If thats your argument, its worse than Statistics imo. Atleast statistics have solid theorems and proofs (albeit in very controlled distributions). All DL has right now is a bunch of papers published most often by large tech companies which may/may not work for the problem you’re working on.

Universal function approximation theorem is pretty dope tho. Im not saying ML isn’t interesting, some part of it is but most of it is meh. It’s fine.

[–] [email protected] 8 points 4 months ago (1 children)

A monad is just a monoid in the category of endofunctors, after all.

[–] [email protected] 3 points 4 months ago (1 children)

No, no, everyone knows that a monad is like a burrito.

(Joke is referencing this: https://blog.plover.com/prog/burritos.html )

[–] [email protected] 3 points 4 months ago (1 children)

So what you're saying is that if you put a burrito inside a burrito it's still a burrito?

[–] [email protected] 2 points 4 months ago

Any practical universal function approximation will go against entropy.

[–] [email protected] 1 points 4 months ago

pee pee poo poo wee wee