Brandon Rohrer on Nostr: Optimizing models with lots of hyperparameters or functions with many options is a ...

Optimizing models with lots of hyperparameters or functions with many options is a slog that usually requires a combination community wisdom, obscure blog posts, and tedious trial and error. Automated methods tend to either rely on strong assumptions of smoothness or brute force their way through every permutation. All of these options kind of suck.

I couldn't find a solution I liked to this problem so I built one: redsho, a robust evolutionary direction set hyperparameter optimizer.