Sunday, November 17, 2024

The limits of a popular AI technique

Sunday, November 17, 2024

Image Credits: Caiaimage/Rafal Rodzoch / Getty Images

Quantization is a widely used technique for making AI more efficient by lowering the number of bits needed to represent information. But Kyle Wiggers explores how this approach may be approaching its limits. Even if you're not building an AI model yourself, these limitations are important to understand as AI becomes more widespread.

For one thing, a study found that quantized models perform worse than the original models if they were trained on lots of data over a long period of time, which could be bad news for companies training large models. Indeed, there have been reports that quantizing Meta's Llama 3 is "more harmful" than doing the same thing to other models.

Keep reading to see what else TechCrunch is covering this weekend.

Weekend news and opinion

illustration of padlocks superimposed over US capitol

Image Credits: Bryce Durbin / TechCrunch

What a second Trump term means for ransomware: Carly Page speaks to cybersecurity experts about the Biden administration's efforts to crack down on ransomware and how a second Trump term might change things. Expect deregulation and reduced cybersecurity budgets — but it's worth noting that the federal cybersecurity agency CISA was created during Trump's first term. Read more

Tech for plant lovers: I like plants, but I need all the help I can get to stop murdering them. Thankfully, Brian Heater is rounding up some promising tech options — not just for me but also for genuine green thumbs — from planters to sensors to software subscriptions. Read more

Meet Botinkit's cooking robot: Botinkit's Omni looks less like a robot and more like a kitchen appliance, but it can cook anything you might normally cook in a wok, including stir-fries and stews. The Shenzhen-based startup says its technology can halve the human labor requirements of a commercial kitchen. Read more

The best gifts for frequent travelers: Frequent traveler Brian Heater (yes, him again) has thoughts about what to get friends and family who spend a lot of time on the road. Some of these gifts are extremely practical (AirTags), while others might bring a little joy and excitement to an interminable plane ride (Nintendo Switch Lite). Read more

What else we're reading 📗

Speaking of the limitations of AI, Platformer pulls together reports about OpenAI and other tech giants seeing diminishing returns as they develop their latest models. There are several possible explanations about why this might be the case, although OpenAI CEO Sam Altman recently posted, "There is no wall." Read more

Also, The New York Times profiles several startups looking to make fusion energy a reality. Read more