Hi. Sorry it took me a bit. Just got back from a long trip.
No car necesary if you're downtown.
4 days is good. The Haven is nice. Villa Alejandro too. Great restaurants and eco-tours available.
Try to make time to go to Bocas del Toro too. Awesome island vibes/food/activity.