How fast can BERT go with sparsity? — Here’s a Little Secret: If you want to analyze how fast 19 sparse BERT models perform inference, you’ll only need a YAML file and 16GB of RAM to find out. And spoiler alert: … they run on CPUs. … and they’re super fast!

Dark Mode —

A Preemptive Strike — Welcome back everyone👋!!!! I have good news… as I speak… the future is being built… … and the future is sparse !!!

NeoX — A Vendetta and 404s North Korea Hacked Him. So He Took Down Its Internet Disappointed with the lack of US response to the Hermit Kingdom's attacks against US security researchers, one hacker…www.wired.com Meanwhile Everything dropped this week… DeepMind’s AlphaCode AlphaCode Solutions were selected randomly, keeping at most one correct (passes all test cases in our dataset) and one incorrect…alphacode.deepmind.com

Desiderata — 🕵️‍♂️Has AI interest peaked? https://trends.google.com/trends/explore?date=all&q=deep%20learning,Artificial%20Intelligence If you’re bummed, you can always… 👇 Make Frontend Shit Again Make Frontend Shit Againmakefrontendshitagain.party Graph ML in 2022: Where Are We Now? Graph ML in 2022: Where Are We Now? Hot trends and major advancementstowardsdatascience.com The State of Web-Scraping 2022

AI Summer is Out Forever — Merry Christmas 🎄 for those celebrating. And Happy New Year! Even OpenAI is feeling the holiday spirit: they open sourced their photorealistic GLIDE model several days ago. GitHub - openai/glide-text2im: GLIDE: a diffusion-based text-conditional image synthesis model This is the official codebase for running the small, filtered-data GLIDE model from GLIDE: Towards Photorealistic Image…github.com

Magnus — Is Moore’s Law Finito? Moore's Law, AI, and the pace of progress - LessWrong It seems to be a minority view nowadays to believe in Moore's Law, the routine doubling of transistor density roughly…www.lesswrong.com NeurIPS Research Papers by Institution Here’s a collection of papers by your favorite big tech and educational institutions. Carnegie Mellon University at NeurIPS 2021 Carnegie Mellon University is proud to present 92 papers in the main conference and 9 papers in the datasets and…blog.ml.cmu.edu

Inference Prime — Hey … so have you ever deployed a state-of-the-art production level inference server? Don’t know how to do it? Well… last week, Michael Benesty dropped a bomb when he published one of the first ever detailed blogs on how to not only deploy a production level inference API but…

The Localization Problem, and the Pale Blue Dot — The Localization Problem (LP) is a glaring dark cloud hanging over the state of affairs in applied deep learning. And acknowledging this problem, I believe, will enable us to make better use of applied AI and expand our knowledge in how the business market will form. Defining LP: There is…