Profile avatar
damienteney.bsky.social
Research Scientist @ Idiap Research Institute. Adjunct lecturer @ Australian Institute for ML. Occasionally cycling across continents. https://www.damienteney.info
34 posts 396 followers 289 following
Getting Started
Active Commenter
Posts 7 Comments 28

This is as useful as telling us what the authors had for breakfast on the day of the experiments. 🤷

submitted 3 days ago • 2 comments

Une chose me marque au sujet de l'IA, notamment générative. Que penser d'une innovation technico-scientifique dont la promotion dans les médias est plutôt du fait d'entrepreneurs, éditorialistes et politiciens, tandis que les scientifiques du secteur sont bien plus mesurés ?

submitted 21 days ago • 21 comments

"Attention" in attention layers. How about sum-product layers? Key-query products? ... Neural attention has little to do with human attention. And the intuitive baggage of the name probably constrains our thinking about how transformers work. (1/2)

submitted 82 days ago • 4 comments

💡 Just learned about a useful short-hand notation for "expectation". Seems common for physicists but I can't remember coming across it before. With an example use-case below ⬇️

submitted 85 days ago • 1 comment

Reviewing ML papers? đź’ˇ If you feel that experiments are missing, ask yourself: are the additional results likely to affect the central message of the paper/nullify its main claims? If not, it's probably a nice suggestion (eg additional comparisons, datasets) but not a reason for rejection by itself.

submitted 98 days ago • 0 comments

PSA: Can we use more bar charts in ML papers? I can't recall the last time I wanted to compare dozens of numbers in a table to two decimal places. A visualization makes it much clearer whether claimed differences are significant.

submitted 99 days ago • 4 comments

Writing tips! This should be mandatory reading for every PhD student 👇 We'll all benefit from it as readers.

submitted 102 days ago • 0 comments