'Attention is all you need' coauthor says he's 'sick' of transformers

Hacker NewsFriday, October 24, 2025 at 4:40:31 AM
NegativeTechnology
The coauthor of the influential paper 'Attention is all you need' has expressed frustration with the current state of transformer models, stating he's 'sick' of them. This sentiment highlights a growing concern in the AI community about the limitations and challenges posed by these models, which have dominated the field for several years. His comments could spark discussions on the need for innovation and new approaches in AI research.
— Curated by the World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended Readings
Making a micro Linux distro (2023)
PositiveTechnology
A new micro Linux distribution has been making waves in the tech community in 2023. This lightweight version of Linux is designed to be efficient and user-friendly, catering to both developers and casual users. Its significance lies in its ability to run on older hardware, making technology more accessible and sustainable. As more people explore this micro distro, it could lead to a resurgence in interest for Linux-based systems, fostering innovation and collaboration in the open-source community.
Underdetermined Weaving with Machines (2021) [video]
NeutralTechnology
The video titled 'Underdetermined Weaving with Machines' from 2021 explores the innovative intersection of technology and traditional weaving techniques. It highlights how machines can enhance the weaving process, offering new possibilities for creativity and efficiency. This topic is significant as it reflects the ongoing evolution in textile production and the potential for machines to transform artisanal crafts.
What Is Intelligence?
NeutralTechnology
The article explores the concept of intelligence, inviting readers to engage in a discussion about its various definitions and implications. This topic is significant as it touches on how we understand human and artificial intelligence, shaping our perspectives on technology and education.
Carmack on Operating Systems (1997)
NeutralTechnology
In a 1997 discussion, John Carmack shared his insights on operating systems, highlighting their evolution and impact on software development. This conversation is significant as it reflects the technological landscape of the time and offers a glimpse into the foundational ideas that have shaped modern computing.
Vibe Coding in the 90s
NeutralTechnology
The article discusses the phenomenon of vibe coding in the 1990s, a unique approach to programming that emphasized creativity and personal expression over strict technical guidelines. This topic is significant as it highlights how the culture of coding has evolved, reflecting broader changes in technology and society. Understanding vibe coding can provide insights into the roots of modern programming practices and the importance of creativity in tech.
The Swift SDK for Android
PositiveTechnology
The introduction of the Swift SDK for Android is an exciting development for developers looking to integrate Swift's powerful features into Android applications. This SDK opens up new possibilities for cross-platform development, allowing for a more seamless user experience and potentially increasing the reach of apps built with Swift. As the tech community discusses its implications, this could mark a significant step in bridging the gap between iOS and Android development.
Disable AI in Firefox
NegativeTechnology
The recent decision to disable AI features in Firefox has sparked significant debate among users and tech enthusiasts. Many believe that this move could hinder the browser's competitiveness in an increasingly AI-driven market. As AI tools become more integrated into web experiences, the absence of such features in Firefox may lead to a decline in user engagement and satisfaction.
Men who mean just what they say
NeutralTechnology
The article discusses the importance of clear communication, particularly among men, and how it can impact relationships and understanding. It highlights that when individuals express their thoughts and feelings honestly, it fosters better connections and reduces misunderstandings. This topic is significant as effective communication is a cornerstone of healthy interactions in both personal and professional settings.
Latest from Technology
How to watch Mayor of Kingstown season 4 online from anywhere – stream Taylor Sheridan crime drama
PositiveTechnology
The highly anticipated fourth season of 'Mayor of Kingstown' is back, featuring Jeremy Renner in his gripping role as the Mayor, who is determined to quell the escalating gang violence. This season promises to deliver more intense drama and thrilling moments, and fans around the world can now easily stream it online, ensuring that no one misses out on the action. With Taylor Sheridan's masterful storytelling, this show continues to captivate audiences, making it a must-watch.
I love my Samsung Galaxy Z Fold 7, but I wish it had this Vivo X Fold 5 feature
PositiveTechnology
The author expresses a fondness for their Samsung Galaxy Z Fold 7 while highlighting a feature from the Vivo X Fold 5 that they wish was available on their device. The Vivo Workbench enhances the user experience on the Vivo phone, showcasing how innovative features can elevate the functionality of foldable smartphones. This comparison not only reflects personal preference but also emphasizes the competitive landscape in the smartphone market, where users are increasingly looking for unique functionalities.
How to cancel your Spotify subscription
NeutralTechnology
Cancelling your Spotify subscription is a straightforward process that can be done through the app or website. This is important for users who may want to manage their expenses or switch to a different service. Knowing how to cancel easily empowers users to make choices that best fit their needs.
Synadia and TigerBeetle Commit $512k USD to the Zig Software Foundation
PositiveTechnology
Synadia and TigerBeetle have announced a significant commitment of $512,000 to the Zig Software Foundation, a move that highlights their dedication to supporting the development of the Zig programming language. This funding is crucial as it will help enhance the language's capabilities and foster a stronger community around it, ultimately benefiting developers and tech companies that rely on Zig for their projects.
Making a micro Linux distro (2023)
PositiveTechnology
A new micro Linux distribution has been making waves in the tech community in 2023. This lightweight version of Linux is designed to be efficient and user-friendly, catering to both developers and casual users. Its significance lies in its ability to run on older hardware, making technology more accessible and sustainable. As more people explore this micro distro, it could lead to a resurgence in interest for Linux-based systems, fostering innovation and collaboration in the open-source community.
Payroll scam hits US universities as phishing wave tricks staff
NegativeTechnology
A recent wave of phishing attacks has targeted 25 universities in the U.S., with cybercriminals from the group Storm-2657 sending deceptive emails to around 6,000 staff members. This alarming trend aims to steal payroll credentials and redirect funds, posing a significant threat to the financial security of these institutions. It's crucial for universities to enhance their cybersecurity measures and educate staff about recognizing such scams to protect sensitive information.