Can a Linear Program Do Weight-Space Programming?

 (nathan.rs)

19 points | by emschwartz 41 minutes ago

2 comments

  • dansitu 4 minutes ago
    Nice analysis. The simplicity of this indicates that it should be happening during training via regularization.
  • FrustratedMonky 2 minutes ago
    Does this describe a very powerful LLM, like Astra, editing smaller models?

    Could Astra edit itself?