"Count what is countable. Measure what is measureable. What is not measureable, make measureable." -- Galileo

Friday, December 31, 2010

PloneMetrics Person of the Year

It's that time of year again when I peruse the events of the past year and unilaterally designate some lucky person "Plone Metrics Person of the Year."  This award comes with only the promise that if the winner and I are in the same town at the same time, I'll buy them a beer. 

Past winners have been:

2009 Nate Aune
2008 Joel Burton
2007 Alexander Limi

The competition has been particular stiff, with outstanding contributions from a wide number of Plonistas worldwide.  It's been a eventful year for Plone and that makes 2010's throwdown especially difficult.  Noteworthy contributions during 2010 that deserve a shout-out include, but are not limited to:
  • The 2010 Plone Conference people at Netsight, who did a great job with this year's event. Matt Hamilton's (general and host-specific) and Astra Fowden's summaries are worth their weight in gold. 
  • The release managers for Plone 4 (Eric Steele) and 5 (Hanno Schlichting) are also high on my list.  Of course, their job wouldn't be possible without the core developers and all the Plone contributors.  Hats off to them all. 
  • As always, the Foundation Board gets a great big nod of appreciation here.  Gier Baekholt (2009-10) and Calvin Hendryx-Parker (2010-11) deserve special mention for shepherding the Plone community.
  • There is also some local Albuquerque talent among this year's nominees:  Michael Bernstein (Code for America fellow) and Emily Lewis (Webuquerque sparkplug).
  • The Plone IRC Superstar Contest winner and runners up always deserve special praise.  The final determination has still not been announced as we go to press, but this is a reminder that the IRC community is a key part of the Plone ecosystem.   
  • In a similar vein, here's a thanks to all those blogging and microblogging about Plone.  I'm particularly pleased to see diversity highlighted with a successful year of PloneChix. 
  • Finally, Roberto Allende gets a big tip o' the hat as the champion of World Plone Day.  This year AndrĂ© Nogueira takes over the reins as we look forward to WPD 27 April.  
All that said, with this being a metrics-centric blog, I thought I'd run a few numbers and see what falls out.

As I mentioned Matt and Netsight are serious contenders.  Here's chart of World Plone Conference attendance since 2006.


Bristol turned out to be right in the middle of the range and probably would have done better had the world economy been brighter.  I regret missing the conference (yup, tight budget), but the high quality videos of the presentations has been a terrific resource that has softened the blow.  They have placed the bar high for future conferences. 

Another notable nominee for today's award is Eric Steele.  Here's the graphic that shows the impact of the Plone 4 release.  

Not only was there a huge spike in Plone.org visitors associated with the release, but a sustained increase of 15-20% that continues to this day.  (Green dashes show pre-release trend; red dotted line represents post-release trend.)

Based on that gi-normous spike, 130% above a typical Wednesday, plus the continued bump-up in Plone visitors, the Plone Metrics Person of the Year Award for 2010 goes to Eric.  By extension, this year's award goes out to all those who contributed to Plone 4 with code, testing, feedback, documentation, product upgrades, and all the myriad of details that make up a successful release. Well done, everyone!

In closing, let me paraphrase the immortal words of Bobby Flay: "So to all you awesome [Plonistas] out there, keep doing what you're doing, but ask yourself this... are you ready for a throwdown?"

Saturday, December 18, 2010

Plone Mobile

I've been putting together a presentation on various web metrics for the gang at my day-job.  In particular, people are asking about Google Analytics.  As part of that, I've been poking around in a few less frequented parts of the system and some of that has carried over to inquiries about Plone.org users.  Tonight I'm going to focus on the growing mobile community of visitors. 

Above is the graph of visitors using mobile devices since GA started tracking them in November 2009.  The most notable feature is the incredible peak that marks the release of Plone 4.0.  The aftershocks lasted two weeks. 

The other significant feature is the upward trend.  There is a perceptible upward slope to the number of mobile users.  In fact, if we remove the Plone 4.0 spike, the regression analysis still gives us a slope of 0.13 (a new mobile visitor every seven days).  The regression coefficient (R^2) is only 0.65, so there's lots of noise in the data, mostly from weekday-weekend fluctuations.

To really see the trend, compare the last month with the same period a year ago.  Clearly mobile use is on the upswing.


My final note is on the distribution of mobile users.  From the city-level global map of mobile visitors to Plone.org, it's pretty obvious that mobile users are world-wide.  Of course, it comes as no surprise that mobile use tracks Plone.org general use, heavy in North America and Europe.  But there are significant hotspots in South America, the Middle East, south and east Asia, as well as Australia and New Zealand.

Thursday, December 9, 2010

IdealWare CMS Report

Once again IdealWare has come out with their 2010 annual review of Plone, WordPress, Drupal, and Joomla. As last year, they are one of the few software comparisons of any type to have a completely transparent methodology. Not only is the body of the report well balanced and thought out, the detailed system-by-system accounting of the subtopics that make up their category scores makes for very worthwhile reading. Tip o' the hat again.

Also like last year, I'm taking the liberty of translating IdealWare's scoring of  None, Fair, Solid, Excellent into 0, 1, 2, 3.  The result is the following table.


WordPress Joomla 1.6 Drupal Plone
Ease of Hosting and Installation 3 3 3 1
Ease of Setup: Simple Site 3 2 2 1
Ease of Setup: Complex Site 3 3 2 2
Ease of Use: Content Editors 3 2 2 3
Ease of Use: Site Administrator 3 2 2 2
Graphical Flexibility 3 3 3 3
Accessibility and Search Engine Optimization 2 3 1 3
Structural Flexiblity 2 2 3 3
User Roles and Workflow 1 3 2 3
Community/Web 2.0 Functionality 3 2 3 2
Extending and Integrating 3 3 3 3
Security 1 2 2 3
Support/Community Strength 3 3 3 3
2010 33 33 31 32
2009* 29 27 30 29
* In 2009 only 12 categories (instead of 13) were used.

Once again there is only a small spread in the scores, about 6%, well below the 10% of 2009.  All CMS's here are improving quickly.  Reviewers still hold Plone's non-LAMP hosting model against it, giving it a Fair for hosting and installation.  I beg to differ with them about setting up a simple site.  Once the software is installed, Plone's out-of-the-box feature set solves a wide range of CMS use-cases with a minimum of fuss. 

What I stated last year still stands:

"Its always nice to see good scores and the fact that Idealware chose Plone along with only 3 other serious open source systems is high praise in and of itself. Idealware should be complimented for having a transparent methodology, a relatively neutral approach, and giving good press to four worthwhile systems.

"Still, I can't stress enough that your specific, unique requirements must drive your choice for a CMS. Don't let someone else's numbers blind you to what you and your community of users need to accomplish."
I urge those shopping for a CMS to weigh the scores according to your needs and requirements.  If ease of use for content contributors, SEO excellence, and security are key features, Plone clearly comes out ahead.  Go ahead and cut-and-paste my table into a spreadsheet, change the values, play with different weights, and then be sure to take a test drive** before you make a deep and lasting commitment.  Changing CMS in mid-stream is not a simple task--take the long view and get it right the first time. 
_______________
** Try a Plone demo site of your own at Six Feet Up or request a free Plone site at Objectis. 

Wednesday, December 8, 2010

CMS Comparison, expanded for Plone

Ashleigh Davis put together a nice table for comparing Drupal, Joomla, and WordPress.  It seems only fair that I take that format one step further and produce an equivalent listing for Plone.


Plone
Homepage plone.org
About Plone lets non-technical people create and maintain information for a public website or an intranet using only a web browser. Plone is easy to understand and use — allowing users to be productive in just half an hour — yet offers a wealth of community-developed add-ons and extensibility to keep meeting your needs for years to come.
Example Sites Online publication:
http://discovermagazine.com/

Charitable giving:
http://www.oxfamamerica.org/
http://www.globalhand.org/

Government:
https://www.cia.gov/
http://www.fbi.gov/
Installation http://plone.org/documentation/manual/installing-plone http://plone.org/support/forums/setup
Ease of use Plone requires technical expertise for advanced customization; however, it is very full featured out-of-the-box. Content contributors, editors, and readers will find Plone easy to understand and use.
Features Blending the creativity and speed of open source with a technologically advanced Python back-end, Plone offers superior security without sacrificing power or extensibility.
Caching Plug-Ins ZEO server (also works and plays well with CacheFu and Squid)
Best Use Cases For web content management, portals, content integration, collaboration, social software, and enterprise content management, especially where security is a premium.
I'd appreciate comments on how to improve this summary, especially on caching plug-ins, an area where I am weak.

Monday, November 29, 2010

Plone.org, as others see it

I've been working on a Google Analytics presentation for a January symposium at my day-job.  That has led me to poke around a little more at the Plone.org stats there.  
One relatively new feature is In-Page Analytics.  It gives you as close to a heat map as you can get for free.  Percentage clicks appear as small orange bubbles above each link.  Interestingly, the top links for Plone.org are Downloads (26%), New Features (19%), Documentation (16%), and Home (8%).  That's 69% of all clicks in just four areas.  


One cute trick (at least in Firefox) is to open the site in question in another tab.  The in-page bubbles are also applied in the new tab, which let's you get a better picture of the context of the statistics.  

Another statistic tucked away in Analytics is the frequency of screen resolutions used by site visitors.  Almost two thirds of Plone.org site visitors use one of just five screen resolutions:

1280x800 15.90%
1280x1024 14.79%
1440x900 11.75%
1680x1050 11.04%
1024x768 8.86%

62.34%

To my surprise, 1280x800 is the most frequently used screen size.  Here's a screen shot of Plone.org resized to that dimension. 

Plone


Almost all of the news and upcoming events are "below the fold" at this resolution, as is the "Plone is among the top 2%..." text block.  But the good news is that 69% of all visitor clicks are on screen at this resolution. 

Also below the fold is the quasi-mega-menu in the footer. As Jakob Nielson recently pointed out mega-menus can be done badly, but done well (see his original March 2009 piece), they can enhance user experience, reduce scrolling, and help users find what they are looking for more easily.  Just a thought...

Now let's take that same 1280x800 resolution for a stroll with some other CMS homepages. 

Drupal

Although it looks complete because the 800 px "fold" breaks in a clear area, a large bulk of material (and a jam-packed quasi-mega-menu at the bottom) needs scrolling before it can be seen.

Joomla!

In some ways like the Plone site, Announcements and Community News are truncated.  Curiously, there's almost 1 cm of blank background above the content header.  Perhaps that's to accommodate the snazzy "Support Joomla" diagonal banner. 

SharePoint

Not so bad at first glance, until you realize that the entire area in line with the lighter gray background band is a rotating set of images.  The only fixed content is the lengthy and hard to scan horizontal top menu and three highlighted but unclickable headings (What People are Saying, Capabilities & Benefits, SharePointSpotlight).  Download SharePoint is practically invisible in the lower right and I almost missed the little cropped thumbnails in the set of images.

The Moral of the Story
  I guess the take-away lesson from all this is to test any webpage design with a variety of screen resolutions before you lock in on something suboptimal for a large number of your site visitors.  Take advantage of In-Page Analytics and make sure that highly visited links are highly visible and don't require scrolling to locate.  The most important things in your page should be the most important things.

Sunday, November 21, 2010

Plone.org and Plone.net Tag Clouds

It's certainly easy enough to generate tag clouds these days, but two places I'd not seen it were the Plone sites.  So here you have it:  Plone.org and Plone.net word clouds. 

My method was to extract as CSV the top 500 titles from Google Analytics using their Content by Title option for each site.  That was cleaned up a bit in Open Office Calc.  Then it was simply a matter of copying-and-pasting all the rows into Wordle and looking for a pleasant and readable result.  I used Wordle's default ceiling of 150 most frequent words. 

From Plone.org:



From Plone.net:
From both of these, I'd have to say that the Plone sites are doing a very good job of covering their respective domains.  Neither site has just a few terms crushing the others into the background.  Frequency distribution of terms is well graded.  There's a wide and useful vocabulary displayed in each graphic, indicating that all the key topics are indeed key topics. 

Share and enjoy!

Thursday, October 28, 2010

For the Gang in Bristol

As the World Plone 2010 Conference moves into its final day (exclusive of the weekend sprints), I thought I'd type while the Plonistas in Bristol sleep.  OK, it's only midnight over there, so probably no one is really asleep.  You know what they say, "Sleep is for wusses." 

Here's a synopsis of some of the measures that I track over here at Plone Metrics, just for discussion starters. 

First off, here's the lastest Amazon Sales Rank stats.  Normally I do this quarterly, but grabbing the data a month or so early won't do any harm. 


Knox and Stahl continue to hold a good sales rank (low value) along with McKay and Redomino as well as McKay's Kindle version.  I'll post the raw data over at the Plone Marketing site later.

The LaunchPad stats are always fun.  Release 4.0.0 has already garnered 29,840 downloads of the Windows installer.  An additional 4,206 downloads of vers. 4.0.1 have taken place this month since its release on the 4th. That's 34,046 downloads for Windows. 

Hanno suggested adding PyPi numbers to the *nix installer numbers.  That turns out to be 6,388 plus 1,010 OS X downloads for 4.0.

As always, the one set of statistics sure to raise the ire of other communities is vulnerabilities reported at the National Vulnerability Database. 


3 mo 3 yr
Plone 0 9
WordPress 2 144
Drupal 10 282
Joomla 12 484

As usual, PHP-based systems fare much worse.  Over the past 3 years systems like WordPress, Drupal and Joomla have hundreds of vulnerabilities, many of them serious.  Even in the last few months all three of those CMS's have had vulnerabilities with high levels of CVSS severity.

It's no wonder that Federal agencies in the U.S like the CIA, FBI, DHS, and DOE turn to Plone.   Internationally, nearly 300 governmental Plone sites are listed at Plone.net.  Closer to home here in New Mexico, the City of Albuquerque, Albuquerque Public Schools, and Sandia National Laboratories all use Plone. 

Another qualitative way of looking at things is to look at the CMS subway map from Real Story Group (formerly CMS Reports).  This is the June 2010 version.  The main change is the addition of SharePoint Add-ons, which doesn't impact Plone's position at the intersection of web content management, portals & content integration, and collaboration & social software. 


The main change is the addition of SharePoint Add-ons, which doesn't impact Plone's position at the intersection of web content management, portals & content integration, and collaboration & social software. By their reckoning, Drupal should more properly be over by WordPress and Fatwire where web CMS and collaboration/social software run parallel.  Plone might be better served being compared with Open Text and IBM.