Posts Tagged ‘Measurement’

The Basics of Process Management

March 12, 2010

Another useful tool in any manager’s kit is process management—the art of setting up, measuring, and evaluating the processes you use to deliver products and services. In government communications we have dozens of processes, from preparing news releases to publishing magazines to running town hall meetings, each of which can benefit from reflecting on how we perform those tasks.

Each process we use involves people and other resources, and by understanding how things are actually happening, you can design your work to be as efficient and effective as possible.

There are about a dozen steps to review and improve the processes that you manager. They are:

  • Identify the products and services you deliver (each has its own process)
  • Prioritize them so you can work on the most resource-intensive first
  • Identify the process owner, who will be accountable for achieving the process goals
  • Document the process, using flow charts to show every step
  • Identify the customers (or audience)
  • Determine what the customer’s requirements are for the end product
  • Identify performance indicators
  • Develop targets for those indicators through research (such as benchmarking)
  • Make changes to the process to decrease hand-offs or other resource impacts
  • Develop process tracking to document indicators and results
  • Implement the process and monitor results
  • Periodically analyze results and make changes to improve the process

By taking the time to go through this for each process, you can reduce the inefficiencies that gradually accrete around the functions you provide. It gives you the opportunity to ask why you’re doing some things as well when you take a hard look at who the audience is and what their needs are for that product. It also overcomes “we’ve always done it that way” thinking by taking a hard look at the cost of doing it that way.

The key here is to focus on the end results you hope to achieve and design a process that delivers those results.

Bookmark and Share

You Are What You Measure

March 4, 2010

In managing an effective communications program, one of the most important tasks is in choosing performance measures to determine your success. The things that you measure are the things you and your staff will give the most energy to. By closely aligning your measures to your goal, you can increase the odds of actually achieving your goals.

Here are some suggested measures that you could evaluate for use in achieving your communication goals.

Reach & Penetration

A basic measure of the success of your communications program is the number of people who see the media you produce. There are a number of metrics to determine if you are actually reaching the audiences you are trying to communicate with. The following measures provide information on your audience to determine reach (how broad) and penetration (how deep):

  • Cable television subscribers (if you have a PEG channel),
  • Number of your channel’s viewers (using a survey),
  • Online video views (your website, YouTube analytics),
  • RSS subscribers (your website),
  • Blog/newsroom visits (your website),
  • Traffic source (location of visitors/viewers),
  • Raw author contribution to blogs (posts per month, characters per post, videos, photos),
  • Document downloads from your website or hosted locations like Docstoc.com,
  • Unique website visitors,
  • Duration of website visits,
  • Incoming links,
  • Website transaction volume,
  • Call center contact volumes, and
  • In-kind value of ad and PSA placements (ad equivalency).

Level of Engagement

One way to measure engagement is to measure the reach of particular messages about engagement opportunities though individual communication channels and measure the actual participation, and then compare the media and message mixes to the participation outcomes. Most of the time you won’t want to experiment with live issues or events, so the opportunity for a rigorous approach is limited.

So while you may not be able to isolate the most effective communications mix, you can describe the overall success by collecting the following data:

  • Attendance at events, forums, and meetings,
  • Participation on boards and committees,
  • Conversion or “click through” rates on opt-in email broadcasts,
  • Participation in online polls and voluntary surveys, and
  • “Citations” or shared web resources that you’ve produced.

Experience & Opinion

One of the more challenging aspects of the changes in media is that while there is now more subjective feedback available directly from constituents on issues, this flood of information is difficult to compile and analyze in a way that provides actionable data.

One way is to collect comments and feedback from various sources and conduct an affinity analysis to see what the general tone or direction those comments are taking.  To do that analysis, collect the following data:

  • Satisfaction with City communications (City survey),
  • User ratings (YouTube, Flickr, Etc.), both City-produced and user-content generated,
  • Blog/Facebook/MySpace/Twitter mentions,
  • Number of fans/subscribers/followers, and
  • Comment tone on other sites.

Another area that is evolving and will require some attention in the future is in the realm of online reputation management. This is a type of media tracking that is done through subjective analysis of user comments on blogs, social networking sites, and discussion groups.

Media Tracking

One of the ways to determine the effectiveness of campaigns and other communications programs is to measure the number of times messages appear in earned media.

In July 2008, Reno began using Vocus, an online media tracking program to assist us in determining the placement and tone of media mentions of City policies and programs.

We had several challenges in implementing this program. The first was in designing search terms and setting up media sources to make sure that Vocus captured relevant media mentions. Second has been in reviewing and “scrubbing” collected data. For example, most television news stories are captured through transcript postings that include multiple stories from a single broadcast. Staff must read, edit, and format the entry to make it useful. This is time consuming and with current budget constraints we have let go the part-time staff who formerly managed this process.

Another example is in syndicated stories. The Associated Press will occasionally pick up a Reno Gazette-Journal story related to Reno and it will be republished on websites across the Country, making it difficult to determine what the actual reach of the story was.

It’s also expensive, with most companies like Vocus, Cision, Meltwater, or Burrelles-Luce starting between $10,000 to $15,000 a year.

We also purchased a television monitoring server made by Snapstream that records all four local news broadcasts so that we can make news stories about Reno available on the internal network to City staff.

Data collected under this rubric could include:

  • Number of stories, both in general and on specific topics,
  • Number of stories generated by City staff efforts,
  • Tone of stories, and
  • Value of coverage.

While this list is certainly not exhaustive, I believe it covers the important concepts in determining if communications have been successful, and acknowledges the broad range of media used by most governments today.

Do you have any good measures to share?

Bookmark and Share

Follow

Get every new post delivered to your Inbox.