Discussion in 'The Tavern' started by Paul Bellow, May 18, 2017.
@Yuli Ban !!
Turing-NLG: A 17-billion-parameter language model by Microsoft - Microsoft Research
I'd forgotten about that episode. It wasn't too bad, as I recall.
Yeah, I'm thinking of rewatching it.
Trust me, I'm aware. Even Turing-NLG is already unimpressive to me, that's how quickly things are moving.
The messy, secretive reality behind OpenAI’s bid to save the world
Ooooh hoo hoo, it's going to be a 100-billion parameter language model at least, mark my words.
Yeah, I saw that too. I think they're trying to combine everything they've learned into one tool. For example, I've been wanting to have GPT-2 generate then use BERT to pick the best from that output to put back in the dataset before going through and training again. It's a crazy time to be alive! Heh.
This tool is really cool too - Google Docs + GPT-2. You hit the TAB key and it gives you suggestions.
Write With Transformer
Our weird behavior during the pandemic is messing with AI models
What History Tells Us About the Accelerating AI Revolution
GPT-3: Language Models Are Few-Shot Learners | Hacker News
Generating literary style parodies of _Harry Potter_ using GPT-3 (if Stoker, H.P. Lovecraft, Yeats, Whitman wrote HP...)
Full text dump:
I haven't heard back if I can buy access to GPT-3 yet...
Welp. There goes my weekend. #AI #ROGUELIKE #NETHACK #ML Facebook researchers believe the game NetHack is well-tailored to training, testing, and evaluating AI models.
Facebook releases AI development tool based on NetHack
How Artificial Intelligence Could Help Video Gamers Create the Exact Games They Want to Play
Maybe the Aeolipile at least? Either way, it's absolutely astounding!
I'm still trying to get access to GPT-3 lol...
GPT-3 Creative Fiction · Gwern.net
Playing with a 50 meg pulp sci-fi dataset. I have a newer 140 meg version, but I wanted to fine-tune off the smaller one first. Screens are samples after 200 steps and 18k steps. The dataset is a lot dirtier than the smaller ones that I've worked on. #AI #NLG