DALLE

NATURAL LANGUAGE PROCESSING (NLP) WEEKLY NEWSLETTER

The NLP Cypher | 05.01.22

>>> curl -L http://git\.io/unix

Ricky Costa
5 min readMay 1, 2022

--

Hey Welcome back! Want to start off by giving a few shout outs!!!

  1. Hectiq.AI hosted the big-yaml — Neural Magic’s config to serve 19 BERT models simultaneously, all under 16GBs of RAM! 😍 Demo
  2. If you want to know more about the demo above, you can read about it here: Thank you KDnuggets and Towards AI! 🚀
  3. Scrape tweets with Twint and classify it with a Neural Magic Sparse Transformer: Code 🧙‍♂️

ICLR Happened:

Stanford

Google

Meta

Amazon

Apple

DeepMind

FormNet: A New Model for Document Understanding

Gets SOTA performance on the CORD, FUNSD, and Payment benchmarks.

CORD benchmark

WaNLI: Generate Your Own NLI dataset

Run Python in the Browser via HTML

The makers of Anaconda came out with this. 🍾❤️

Has only been tested on Chrome thus far.

Code:

DALL-E-2 | Performance and Limitations

Limitations of DALL-E-2 | a thread 🧵

DALL-E-2 PyTorch Implementation

Lucidrains for the win!

SEAL 🦭 Search Engines w/ Autoregressive LMs

Thread 🧵

Code

GPT-NeoX Annotated

Play

DiffCSE — Meta’s New Sentence Embeddings Library

Paper

OpenAIs New Clip Model

(a silent drop)

Get Stoic

Papers to Read 📚

https://arxiv.org/pdf/2204.13074.pdf
https://arxiv.org/pdf/2204.07705.pdf

NLP Index👨‍💻

A collection of recently released repos that caught our 👁

LitMind Dictionary

An open-source online generative dictionary that takes a word and context containing the word as input and automatically generates a definition as output.

Connected Papers 📈

--

--

Ricky Costa

Subscribe to the NLP Cypher newsletter for the latest in NLP & ML code/research. 🤟