Profile avatar
lerrelpinto.com
Assistant Professor of CS @nyuniversity. I like robots!
53 posts 2,803 followers 231 following
Regular Contributor
Active Commenter
Posts 24 Comments 26

This is important because the humble iPhone is one of the best accessories for embodied AI out there, if not actually the best. It's got a depth sensor, good camera, built-in internet, decent compute, and -- uniquely -- it has really good slam already built in.

submitted 19 hours ago • 1 comment

We just released AnySense, an iPhone app for effortless data acquisition and streaming for robotics. We leverage Apple’s development frameworks to record and stream: 1. RGBD + Pose data 2. Audio from the mic or custom contact microphones 3. Seamless Bluetooth integration for external sensors

submitted 20 hours ago • 2 comments

A useful “productivity” trick is to remind yourself that research should be fun and inspiring and if it’s not that something should change.

submitted 3 days ago • 2 comments

And I am an ally. If you are too, let the world know.

submitted 4 days ago • 1325 comments

Just found a new winner for the most hype-baiting, unscientific plot I have seen. (From the recent Figure AI release)

submitted 6 days ago • 1 comment

One reason to be intolerant of misleading hype in tech and science is that tolerating the small lies and deception is how you get tolerance of big lies

submitted 6 days ago • 4 comments

Thank you to @sloanfoundation.bsky.social for this generous award to our lab. Hopefully this will bring us closer to building truly general-purpose robots!

submitted 8 days ago • 3 comments

yoinked this image from Twitter, then ordered my copy join me

submitted 11 days ago • 57 comments

A fun, clever idea from @upiter.bsky.social : treat code generation as a sequential editing problem -- this gives you loads of training data from synthetically editing existing code And it works! Higher performance on HumanEval, MBPP, and CodeContests across small LMs like Gemma-2, Phi-3, Llama 3.1

submitted 13 days ago • 1 comment

We have been working a bunch on offline world models. Pre-trained features from DINOv2 seem really powerful for modeling. I hope this opens up a whole set of applications for decision making and robotics! Check out the thread from @gaoyuezhou.bsky.social for more details.

submitted 26 days ago • 0 comments

To help people understand the importance of NIH, share what you’ve used their funding for (in easily understandable terms). I’ll start: my NIH postdoc funding helped me develop and test AI tools that could identify skin cancer across diverse skin tones.

submitted 30 days ago • 43 comments

If you’re in grad school, finding a therapist can be really helpful. The thing you’re doing is hard and it’s harder if you don’t have help managing imposter syndrome, stress, self esteem, and a whole bunch of other things.

submitted 49 days ago • 5 comments

omg a student somehow accidentally wrote an email addressed to a faculty-wide NYU listserv and my inbox is now a master class on who understands the difference between a listserv and an email chain

submitted 59 days ago • 211 comments

Humans vs Ants: Problem-solving Skills

submitted 63 days ago • 9 comments

At NYU Abu Dhabi today and in love how cat friendly the campus is!

submitted 71 days ago • 2 comments

This holiday season, take a moment to visit your local bookstore. It’s about more than finding a great book—it’s about supporting the small businesses that keep our communities thriving.

submitted 74 days ago • 58 comments

HOT 🔥 fastest, most precise, and most capable hand control setup ever... Less than $450 and fully open-source 🤯 by @huggingface, @therobotstudio, @NepYope This tendon-driven technology will disrupt robotics! Retweet to accelerate its democratization 🚀 A thread 🧵

submitted 74 days ago • 4 comments

Outstanding presentation, finally! DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control @jeffacce.bsky.social @lerrelpinto.com

submitted 75 days ago • 0 comments

New paper! We show that by using keypoint-based image representation, robot policies become robust to different object types and background changes. We call this method Prescriptive Point Priors for robot Policies or P3-PO in short. Full project is here: point-priors.github.io

submitted 78 days ago • 1 comment

Modern policy architectures are unnecessarily complex. In our #NeurIPS2024 project called BAKU, we focus on what really matters for good policy learning. BAKU is modular, language-conditioned, compatible with multiple sensor streams & action multi-modality, and importantly fully open-source!

submitted 79 days ago • 1 comment

Robot utility models are not just among the first learned models that work zero-shot on a mobile manipulator, but also provide a nuanced discussion on what works and what doesn't in data-driven robot learning.

submitted 79 days ago • 0 comments

Since we are nearing the end of the year, I'll revisit some of our work I'm most excited about from the last year and maybe a sneak peek of what we are up to next. To start of, Robot Utility Models, which enables zero-shot deployment. In the video below, the robot hasnt seen these doors before.

submitted 81 days ago • 2 comments

I'd like to introduce what I've been working at @hellorobot.bsky.social: Stretch AI, a set of open-source tools for language-guided autonomy, exploration, navigation, and learning from demonstration. Check it out: github.com/hello-robot/... Thread ->

submitted 85 days ago • 7 comments

How to drive your research forward? “I tested the idea we discussed last time. Here are some results. It does not work. (… awkward silence)” Such conversations happen so many times when meetings with students. How do we move forward? You need …

submitted 87 days ago • 1 comment