I'm fortunate to have collaborated with a team of brilliant researchers on this colossal project 🎊

Among the tasks i contributed, i'm most excited about the contextual web element retrieval task derived from weblinx, which i think is a crucial component for building web agents!
Reposted from Kenneth Enevoldsen
I am delighted to announce that we have released 🎊 MMTEB 🎊, a large-scale collaboration working on efficient multilingual evaluation of embedding models.

This work implements >500 evaluation tasks across >1000 languages and covers a wide range of use cases and domainsπŸ©ΊπŸ‘©β€πŸ’»βš–οΈ

Comments