So the two CMS we have been developing sites on are Joomla and Drupal, specifically Joomla 1.5 and Drupal 6.2.
The first thing you will find if you search the net for comparisons of CMS is that they are dated. Any review you read comparing two content management systems is only marginally useful if it is more than 6 months old.
When new version of these puppies roll out it’s like rolling out a revamped model of a car and if you are not careful you will be reading a review comparing a 2006 Honda Accord and a 2005 Toyota Camry when you are in the market for a 2008. So take any old comparison with a grain of salt, they are useful only to a point.
So I’ll break down, from our ‘noob’ experience, a rating (1-5) of the two and the “winner” across the issue that you are probably most interested in. Whether you are more hands on or using a vendor to assist you these rating should help you get a feel for how hard you (or you vendor) will really have to work.