The Top Floor Flat

This is Part II of Challenges in Setting Up an Agile Marketing Team. Part I is available here.

Challenge: Measuring and assigning points to marketing stories

Agile is a great method for quantitatively measuring productivity because each story is assigned a point value. The sum of points from all stories completed during a sprint defines the team’s velocity. This velocity should be fairly consistent week on week and any sprint plans for the future shouldn’t include stories with a point value higher than the current velocity. Within a development environment, when, generally speaking, product developments are all created within the same framework (a programming language) with varying levels of complexity, the point values are relatively easy to define – a more complex project, requiring a greater knowledge of the coding language, is worth more points.

On the marketing side, however, assigning point to stories has been a real challenge. There is no consistent measurement of complexity across the very different types of projects we undertake – for example is designing a lead flow process for lead nurturing more or less complex than generating a detailed report analysing dead leads over the last six months? And if we can’t consistently evaluate complexity, should we use time to indicate point value – so should a very simple, repetitive task that takes an entire afternoon be worth more points than a task that only takes half an hour but requires a significant level of expertise? Should points indicate seniority – tasks that require executive sign off getting a higher value than those that do not?

Where We Are Now:

This particular issue hasn’t entirely been resolved. We’ve tried a number of different ways of measuring the point value of tasks but have resorted to ‘gut feel.’ We assign points as a team, during our sprint plan, so there is a check and balance but it’s not a particularly scientific process. This has been reflected in a somewhat inconsistent velocity – although we’re in the same ballpark week on week, our velocity doesn’t have the fixed value we’d like to see. Generally points are based on a combination of the perceived complexity of the task, the amount of time it will take and whether or not other resources are required from outside our department. Hopefully this process will become clearer.

As a side point, we used the same point values as our development team – 1, 2 or 3 points as the only options. Given the different variables we need to take into account and the inconsistency of measurement, we might find it easier to get a lock on our velocity with another scoring system.

Other Challenges:

A couple of other challenges that we considered before starting with Agile:

–        Abundance of ‘chores.’
Chores are stories that don’t deliver any real value but must be completed. Some examples are following up with the winner of a competition, cleaning email lists or unfollowing irrelevant accounts on Twitter. Chores in our sprint plan give the appearance of productivity without any value-add to the department, and makes it more difficult to accurately measure our velocity (chores don’t get any points). We tend to have a lot of these within marketing and are working to tie these in as tasks related to proper stories, rather than just stand alone stories without value.

–        Lack of resources and skills for partner work
Many Agile teams recommend having paired teams of workers complete stories together. While our challenge is based more on the siloed skills sets within our team, our small team size and general need for speed has deterred partner pairing as well. However, we’re lucky enough to have some fantastic interns working on the marketing team and although they are not generally part of the sprint plans or responsible for stories, their support helps us recognise some of the value of pair work.

–        Reliance on other company departments
Within the development team, much of their work is self-contained however in many cases, our marketing team requires support from other departments to complete a story – whether that’s a product release from dev or testimonials from support. Reliance on other departments makes planning stories incredibly difficult because if we don’t get what we need from the other parts of the company, the story can’t be completed. We haven’t found a great solution for this one yet, although we have tried to write fewer stories that require outside resources and if one is required, create a chore to request the resource, then a story only once we’ve received what we need.

So, as you can tell, numerous challenges although it’s been an important process to think about these because they affect the team’s output regardless of the methodology we’re using. Agile has helped to highlight some of the ways we can improve and given us a framework for doing so.

Next post will be about how we prioritise work, define projects and write stories.

So we had decided to commit to an Agile methodology for our marketing team based on the reasons I’ve written about already (quick overview; ability to prioritise work, to be more flexible in responding to campaign success or failure, to get more out of our small team and to better understand our actual productivity levels). However just because we had decided we wanted to go Agile doesn’t mean that the process happened over night. In fact even before we got started, I sat down and made a list of all of the challenges that would affect us in moving to this new methodology.

Some of these issues we were able to address before starting with Agile, some we needed to work through in the first few months of using Agile and some are still not satisfactorily resolved. There were, in fact, so many challenges to write about that I’ve broken this up into two blog posts.

Here are some of the challenges I expected we would face in using Agile for marketing:

Challenge: Individuals were already responsible for clearly delineated types of tasks within the team

We only have three full time members of the marketing team and although the size isn’t necessarily a deterrent to using Agile, the way we had organised the team was. Each of us were general responsible for diverse tasks – one of us for content and social, one for lead research, qualification and management and one for inbound lead campaigns. Although there was some overlap, we had siloed ourselves.

Tasks within Agile sprints, called stories, are generally meant to be relevant to anyone on the team – because stories are prioritised by importance and everything needs to be completed within a sprint, if a member of the team finishes their story, they should pick up the next story in the sprint, not just the next one relevant to their expertise. If we had a sprint with a dozen stories related to content, but only one or two related to inbound lead generation, what would that mean for our division of labour? Would we have to plan sprints based on equally allocated stories (thus letting our individual skills drive our sprint plans more than actual marketing department needs)? If we did try to create sprints with stories for each member of the team, how would that be different that just creating our own individual task lists?

Where We Are Now:

As it turned out, we did end up planning our sprints based on individuals within the team bringing their own tasks to the weekly sprint plan. However this had an unanticipated benefit. It meant that many of our projects were truly iterative – the person responsible for the story one week had a clear picture of how they wanted to bring that story to the next level, or add value to the ongoing project through work they had already accomplished, and were therefore better able to define a related story for an upcoming sprint. Had different individuals been responsible for different parts of a marketing campaign, a lead research project or a white paper, for example, then the overall vision of the project, despite being well articulated to the rest of the team, might have lost some of its clarity and focus.

Additionally, we have started to reach a point where certain stories are completed by someone who didn’t initially expect to do them. Usually this will happen towards the end of the week when we’re reaching the end of the sprint plan and there are just a few stories to go but it’s been a good experience and hopefully will lead to even more flexibility within the team in taking on, and successfully completing, stories outside their immediate comfort zone.

Challenge: Numerous ongoing or daily tasks without a clear end date

Within the marketing team, unlike what I’ve seen of the development team, we have numerous ongoing and daily tasks that I thought would prove difficult to fit into a sprint plan. In terms of daily tasks, our team generates a daily pipeline report for the sales reps, deduplicates the leads in the system, and produces daily stats reports. Ongoing tasks include the management of the company Twitter and Facebook accounts and qualifying leads for the sales reps.

How would these tasks fit into our sprint plan? How could we define a story within a sprint when the story never ends?

Where We Are Now:

When it came to daily tasks, we decided that we would not include these in any of our sprint plans. One of the benefits of Agile is the ability to quantitatively measure the productivity of the team – and this can be used to plan realistic sprints in the future. By taking out daily tasks, we knew that there would be an element of our work that we didn’t track but that this would be consistent – the same projects take the same amount of time every day so it wouldn’t affect our ability to plan sprints in the future. As a side point, the majority of these daily tasks are admin busy-work that will hopefully at some point be replaced by software services so it’s even less desirable to track them as part of our sprint plan.

In terms of ongoing tasks, however, we had a greater challenge. There was much less consistency in the amount devoted to these projects each week so it was important that we could measure how much time was spent and, more significantly, what we actually produced. With that in mind, we made it a goal to break down ongoing projects into individual tasks, sometimes even at the expense of the ongoing project as a whole. Take for example an ongoing project to manage our Twitter account. This might become one or two stories within a particular sprint, with one to schedule daily Twitter content at the beginning of the week and the other to follow everyone on a relevant Twitter list. While this may not deliver exactly the same value as sitting in front of Tweetdeck responding to all relevant comments, it’s a clear measureable that raises improves our Twitter presence and doesn’t do so at the expense of resources or other sprint stories.

I’ll leave it at that temporarily as there are numerous other challenges we’ve faced but with the aim of keeping this readable, I’ve split this into two posts. Part II will be available shortly.