...

bearseascape

48

Karma

2023-04-05

Created

Recent Activity

  • The madlib like sentences approach is actually how masked token prediction works! It was one of the pretraining tasks for BERT, but nowadays I think all (?) LLMs are trained with next token prediction instead.

  • 13 points0 commentsarxiv.org

    The Finite Element Method (FEM) is widely used in engineering and scientific computing, but its pre-processing, solver configuration, and post-processing stages are often time-consuming and require…

HackerNews