Epistemic status: A lot of this is vibes and generally trying to express tacit knowledge from ML experience and training models. However there are a huge number of details here and the field of ML changes incredibly rapidly. This is an oversimplified, but hopefully still useful picture, and may well...
[Read More]
Maximum Entropy Morality, Metaplastic Constitutionalism, and the Dynamic Virtues
Author’s note: This is quite a long post. It is highly speculative, obviously, but I think it offers an interesting perspective on, and proposal for, outer alignment. The specific idea here is to move away from demanding a final lightcone-scale conception of ‘The Good’ as an outer alignment target, whether...
[Read More]
The Probe
so much depends
upon
[Read More]
How can LLM RL Work Despite Information-Theoretic Inefficiency
Epistemic Status: Obviously speculative and maybe obvious.
[Read More]
Is Endogenous Exploration Sufficient?
Epistemic Status: A short note which posits a question without necessarily arriving at a definitive answer.
[Read More]