Hugging Face's Guide to Optimizing LLMs in Production
When it comes to deploying Large Language Models (LLMs) in production, the two major challenges originate from the huge amount of parameters they require and the necessity of handling very long input sequences to represent contextual information. Hugging Face has documented a list of techniques to tackle those hurdles based on their experience serving such models.
Generative AI Service AWS Bedrock Now Generally Available
After announcing Bedrock last April in preview, Amazon is now making its fully managed service for generative AI apps generally available.
AI Researchers Improve LLM-Based Reasoning by Mimicking Learning From Mistakes
Researchers from Microsoft, Peking University, and Xi’an Jiaotong University claim to have developed a technique to improve large language models (LLMs) ability to solve math problems by replicating how humans learn from their own mistakes.
OpenAI Launches GPTs to Enable Creating No-Code, Custom Versions of ChatGPT
At the recent OpenAI developer conference, OpenAI announced it is rolling out GPTs, custom versions of ChatGPT created for specific tasks. Developers will also be able to share their GPTs on the forthcoming ChatGPT Store and monetize them, the company says.
Google Announces New DeepMind Model, Lyria, to Generate High-Quality Music
Google has introduced Google DeepMind’s Lyria, an AI music generation model able to generate vocals, lyrics, and background tracks mimicking the style of popular artists. The model is experimentally available on YouTube through two distinct AI experiments.