Hacker News
- Go-attention: A full attention mechanism and transformer in pure Go https://github.com/takara-ai/go-attention 85 comments
- Understanding and coding the self-attention mechanism of large language models https://sebastianraschka.com/blog/2023/self-attention-from-scratch.html 37 comments
- Can you explain Transformers in one sentence? (attention mechanisms) [video] https://www.youtube.com/watch?v=qAb581l7lOc 3 comments
- New attention mechanisms that outperform standard multi-head attention https://arxiv.org/abs/2403.01643 49 comments
- Attention Mechanism in Deep Learning https://blog.floydhub.com/attention-mechanism/ 24 comments
- Linear Attention Mechanism: An Efficient Attention for Semantic Segmentation https://arxiv.org/abs/2007.14902 2 comments
- Show HN: A cartoon intro to how the attention mechanism works https://ai-explained.yoko.dev/1-attention-explained 12 comments
- Cognitive and Attentional Mechanisms in Delay of Gratification (1972) https://fermatslibrary.com/s/cognitive-and-attentional-mechanisms-in-delay-of-gratification#email-newsletter 6 comments
Lobsters
- go-attention: A full attention mechanism and transformer in pure Go https://github.com/takara-ai/go-attention 2 comments ai , go , release
- Understanding The Attention Mechanism In Transformers: A 5-minute visual guide. 🧠 https://open.substack.com/pub/codecompass00/p/visual-guide-attention-mechanism-transformers?r=rcorn 6 comments compsci
- In the attention mechanism, why don't we normalize after multiplying values? https://ai.stackexchange.com/questions/40244/in-attention-mechanism-why-dont-we-normalize-after-multiplying-values 2 comments mlquestions
- [P] Understanding & Coding the Self-Attention Mechanism of Large Language Models https://sebastianraschka.com/blog/2023/self-attention-from-scratch.html 4 comments machinelearning
- Attention as the Mechanism of Dissociation https://mad.science.blog/2021/09/16/attention-as-the-mechanism-of-dissociation/ 3 comments cogsci
- Neuroscientists have identified the brain’s synchronizing mechanism and have started work on therapies to strengthen attention. http://www.nytimes.com/2009/05/05/science/05tier.html?_r=1&em 32 comments cogsci
- Coding the Self-Attention Mechanism of Large Language Models in Python From Scratch https://sebastianraschka.com/blog/2023/self-attention-from-scratch.html 3 comments python
- Learn how you can simply create a Language Translator using Attention Mechanism! https://youtu.be/Qu81irGlR-0 2 comments learnmachinelearning
- "Attention mechanism" with Neural Machine Translation (Easily Explained!) https://www.youtube.com/watch?v=Qu81irGlR-0 2 comments learnmachinelearning
- ProTip: If you rely on a bike shop for maintenance, take it in now. Mechanics will give it extra attention and your bike will be ready to go in the spring. https://www.reddit.com/r/bicycling/comments/9unnvf/protip_if_you_rely_on_a_bike_shop_for_maintenance/ 14 comments bicycling
- [Motorsport week] Some Aston Martin mechanics have arrived on the scene to deal with Vettel's car, which nobody dares touch. Looks like it might be "live" and therefore requires special attention https://twitter.com/MotorsportWeek/status/1433732890748129280?s=19 40 comments formula1
- The Anatomy of Attention: "As we learn more about the detailed mechanisms in the brain, the question of ‘What is consciousness?’ will fade away into irrelevancy and abstraction..." http://www.newyorker.com/tech/elements/anatomy-attention 7 comments philosophy
- New study sheds light on the hidden attention struggle behind phobias | This indicates that phobic individuals exhibit poorer attentional control mechanisms and difficulty inhibiting irrelevant information. https://www.psypost.org/new-study-sheds-light-on-the-hidden-attention-struggle-behind-phobias/ 12 comments science
- Study links childhood adversity to stress, sleep loss, and later attention deficits. Early-life adversity in mice caused lasting attention issues in males, not females, revealing a brain mechanism underlying it: an imbalance in dopamine receptors https://answers.childrenshospital.org/attention-deficits-adversity-sleep/ 88 comments science
- A recent study found that a complete day without sleep significantly impairs both attentional and temporal integration mechanisms. This seriously hinders our ability to pay attention and process information quickly, which is crucial for reacting correctly to fast changes around us. https://www.psypost.org/new-research-highlights-the-alarming-impact-of-sleep-deprivation-on-cognitive-function/ 179 comments science
- Air pollution's distracting effect on attention, unveiling underlying neurocognitive mechanisms. The study's findings offer the first neuroscientific evidence of how air pollution distracts our attention, emphasizing the need for clean air initiatives to enhance cognitive wellbeing https://menafn.com/1107767402/New-Study-Reveals-Air-Pollutions-Distracting-Effect-On-Attention-Unveiling-Underlying-Neurocognitive-Mechanisms 3 comments science
- Neuroscientists identify brain mechanism that drives focus despite distractions: it's due to a pattern of “visual-movement” neurons in the front of the brain that act as “traffic control” to manage our attention to visual stimuli https://www.pennmedicine.org/news/news-releases/2023/august/neuroscientists-identify-brain-mechanism-that-drives-focus 21 comments science
- Psilocybin acutely alters the functional connectivity of the claustrum with brain networks that support perception, memory, and attention. “Our findings move us one step closer to understanding mechanisms underlying how psilocybin works in the brain,” said Frederick Barrett, PhD. https://www.sciencedirect.com/science/article/pii/s1053811920304663?via%3Dihub 47 comments science
- A study has found musical training produces lasting improvements to a cognitive mechanism that helps individuals be more attentive and less likely to be distracted by irrelevant stimuli while performing demanding tasks. https://eurekalert.org/pub_releases/2019-03/e-tmp032619.php 70 comments science
- Karl Marx was right "Income disparities have become a source of political and moral controversy, but their macroeconomic effects have attracted less attention. The mechanism whereby income inequality causes economic stagnation was recognized by Karl Marx and other 19th-century writers." http://blogs.reuters.com/anatole-kaletsky/2014/07/11/karl-marx-was-right-at-least-about-one-thing/ 226 comments politics