My WAA wishlist


I started this post as another answer to Jim Novo in this long and interesting discussion around how I am disappointed by the WAA and its certification program. The debate centered on the value of proctoring the exams, the price of the exams and then evolved into a discussion on whether the WAA should also offer something else. I’m very interested to hear how this issue was raised in the WAA board meeting as Jim said it would be in one of the many comments the post received. More importantly what actions were taken? If anyone from the WAA would care to comment I am all ears.

Because this reply got so long and because it’s moved on from me being critical to me asking for something I decided the reply to Jim and the WAA warranted its own post.

Regards the current certification. Jim Novo convinced me that the certification as it stands with a proctored exam has its place.

So on that score I have been convinced to change my position.

I do however still have a couple of wishes and am still disappointed that the WAA have not addressed what I thought was the most obvious problem with the current WAA professional membership. And it’s not just me, I’m speaking for at least most of Finlands membership and have seen agreement in some way or another from members in Sweden, Belgium, France, the UK and Hungary.

Wish number 1)

I would still like a lighter certification as part of current membership fees (or a very small admin fee on top) that can be taken online.

The deeper meaning of this? A couple of things.

1) When do we get the certification in Japanese? or Finnish? or insert your non english language here? Petri Mertanen (WAA finnish country chair) pointed it out and being in Finland I can tell you that this is a problem for people when you’re asking for a sizable investment. Everyone would prefer to take a test in their mother tongue but it’s understandable that it’s not possible. We don’t expect the WAA to translate everything into 50 odd languages. But we do expect to be catered for as well as is possible in Finland or Japan or even the more remote states in the USA (as one US member pointed out to me – the US is a big country and not everyone can get to the big cities). A light version of the certification means you won’t have to spend a lot of money on the test itself and travel to an exam (even if it’s only  to a selected city in your country) to take it.

2) I believe there is a much bigger market need for this than a proctored exam and also believe it would strongly add value to the membership fee which for all the good intent of the WAA is right now worthless outside of the USA. In the US there is much more value, for a start there are Basecamp training programs, many events that are run and most importantly many more members. If we can double or triple worldwide memberships then the same kind of publicity, advocacy and interest can be brought about in smaller markets. We once got 300 people to a seminar in Helsinki and there are only 30 WAA members. What does that tell you? That interest is there but it’s not worth being a member of the WAA.

Jim has argued that a light version devalues the certification. I want to suggest a way of framing the light versus proctored versions of the certifications.

The Light Version (Web Analytics Association Certified Member)

This Individual has met the WAA requirements to attain recognition as a certified Web Analytics member of the WAA. The WAA certification means the individual has successfully passed an online unmoderated exam covering many web analytics proficiencies. Certification is not an endorsement by WAA, but only an indication that the certified individual has met the certification criteria.

The Proctored Version (Web Analytics Association Certified Professional)

This Individual has met the WAA requirements to attain recognition as a certified Web Analytics professional. The WAA professional certification means the individual has successfully passed a proctored exam covering many web analytics proficiencies. Certification is not an endorsement by WAA, but is a very strong indication that the certified individual has met the certification criteria.

I would argue that you could then do the exact same test for both versions but one of them is online. You could then add a further level, a web analytics certified company – a company that has invested enough in its people to get 5 certified professionals working for them.

Wish Number 2)
Give local markets the tools to grow.
The WAA is basically event driven. Aside from the standards, training and the certification the main product it has are its events.
I’ve explained this in part before in my open letter to the WAA but no action has ever been taken. There are basically 3 levels of market maturity the WAA needs to cater for.
  1. The Start Up. This is when there is very little awareness in the market about web analytics and maybe 1 or 2 country representatives trying to get something going. Example; Kalle Heinonen and I in Finland in 2005 discussing analytics with our clients and friends in the industry in a bar in Helsinki. About 10-15 people sitting around discussing, building up momentum and planning to do it again in a few months to continue discussing what we’d learned.
  2. The Locally Sponsored WAA. This is when momentum has been built to the point where events can be planned and because there is enough interest local sponsors get involved usually directly contributing to hotel seminar rooms or event spaces. This usually means local marketing is done and volunteer speakers come to the events which might mean 50-100 people. In Finland this was 2006-8.
  3. The Locally funded WAA. This doesn’t exist yet but it should in my opinion. It’s when the market identifies that it has 200+ individuals that are interested in web analytics enough to attend an event. It’s where the WAA are currently missing out on a massive opportunity because they’re not allowing local growth. The market has gone through the first 2 levels and it expects locally sponsored free events – you can’t suddenly now start charging because firstly you don’t have a mechanism (a bank account) nor should you because you’ll lose many of the interested individuals. This is the point where a local non-profit should be set-up and administered locally. The idea here is that membership fees go to the WAA in the USA (with some small percentage paid back to the local market – now it’s 25%) the market continues to be a part of the WAA but it can set-up local mechanisms for funding and local training. Going back to my original point this is also where a light version of the certification would help tremendously.
In the 1st two levels there is no need for much more than we currently have, it’s local members doing their thing.
In the third level we first need endorsement at a board level that we can do it and guidelines for training materials which can be localized.
My wishes are focused around growing the WAA membership because I see it as quite a low number right now especially outside of the USA.
In Finland I believe the more paying members we have the more successful we’re becoming as an organization. It’s the simplest KPI you could wish for. Right now in Finland I see it as 10% effective in that 30/300 are members. I’d say success is if we can get 33% (100 members) and  grow the market by 50% (450) because of it. If it can be done here in Finland (and I’m happy to help drive it) it can be done anywhere but it can’t be done with the current limitations.

Information and Links

Join the fray by commenting, tracking what others have to say, or linking to it from your blog.


Other Posts

Archives

Enter your email address:

Delivered by FeedBurner

Categories

Finnish blogs of note (In English)

Web Analytics Blogroll


Write a Comment

Take a moment to comment and tell us what you think. Some basic HTML is allowed for formatting.

Reader Comments

Hi Steve,

Greetings from Madrid.
I just wanted to comment on a couple of points as, following the previous Localized Globalization conference call, some topics have been discussed and additional information has been sent by Jim Novo to the attendees list, which includes Petri so I’m a bit surprised.

Also, I wasn’t aware that translation in Finish would be required as mainly the Spaniards came up with the topic but once we have the process rolling, I’ll surely put Petri in the loop so that he can coordinate from your side of the spectrum.
I’ll leave the discussion about the light certification to those in charge of that topic (Education Committee) but wanted to acknowledge that unlike stated in your post, this is not only and totally US centric and that support is slowly but surely building up outside of the US with some local initiatives.

Additionally, I would also like to remind you that Country & Regional Managers are in charge of 25% of members budgets and are asked to define what they would like to do with the money, on top of organizing events.

I regularly get mails in from other localized groups with ideas, questions and suggestions, which are then dealt with directly or passed onto the appropriate contact person within the WAA, in the US or elsewhere, in order to move ahead.

I would certainly welcome your support as there are several issues that need to be centralized through countries and there’s just so much a single person can do in 24 hours ;-)

Talk to you soon, be well & kind regards,
Aurélie

Hi Steve,
1) light certificate: I personally don’t think this would be a good thing. Either you know how to pilot a plane or you don’t. That being said, the Knowledge Requirement for Certification is a must read and there are already sample questions that are really representative of the actual exam. As for translation: in the spirit of “not being a US centric association” – it is expected to be largely handled by country managers/committee in each market where it makes sense to do it. Do you want to translate it? I would recommend you first get Certified and then participate in the Certification Committee to help out!
Proctored exams vs other methods: it will come, as already clearly stated by Jim Novo. And again, “you” can help!

2) I agree with your startup, locally sponsored and WAA sponsored idea.The first is usually very local and don’t need much WAA involvement – it is more spontaneous and doesn’t involve much coordination, logistics or money. The second is already happening under the form of WAA marketing and member discounts. Where I disagree is when you seem to expect the WAA (« head office ») to organize local events for 200+ people. eMetrics is the official conference of the WAA (coming to London & Paris) and I have personally participated in IMC and will be at the WebAnalytics Congress in Amsterdam (June 1-2). Event coordination and management is a huge task and there is no one better positionned then local people to organize it. Furthermore, at this scale, there are financial, profitability and lead generation considerations that are beyond the scope and control of the WAA. As Aurélie stated, when country managers come with clear goals and expectations of how the money will be used there is usually no problem (as the Treasurer of the WAA, I sometimes get to view/confirm those projects). You would like to get a conference in Finland? Talk to Lennart Svanberg from IMC, he is a professional conference organizer and the WAA will be happy to get involved! You would like member discounts? WAA keynote/speakers representatives? workshops? YOU can help make it happen!

Stéphane Hamel
WAA Board of Director/Treasurer
Speaker at eMetrics London & Paris
Speaker at Web Analytics Congress (Amsterdam)

Hi Aurelie,

Firstly thanks for the skype call, it cleared up a lot of points and we’ll act on your suggestion to propose the plan for Finland regards my second wish.

Just to answer your comments.

I also do actually say that we don’t expect the WAA to translate the certification into any language. I say that if you expect people to invest they have to completely understand the subject matter at hand and an expensive test in English is unlikely to be widely taken up in Europe. It’s one argument for doing it online where if you fail you just start again later.

I said value in the US for the professional membership is much higher than the rest of the world. I still believe that if I stopped paying WAA dues next year I would gain $200 and lose pretty much nothing in terms of what I currently get for free from my local web analytics community. Similarly our other members, who would not be turned away from seminars. I know due primarily to your efforts and more European representation on the board it’s getting better in Europe and elsewhere but it’s still less value for money I’d argue than the USA & to a lesser extent Canada. This is what I am hoping we can change.

I know and already mentioned in the post that local managers can claim 25% back. Another good result of the globalization initiative.

You’ll definitely get my support and Petri’s and other members if we can swing these changes. All we want is to be given the permission to do it for ourselves under the WAA brand.

I’ve always said I am not criticizing any one person. It’s no-ones fault that the WAA is in the position it is today other than our own. I am as much to blame for the faults of the WAA as anyone else. I’ve been an active member more than most after all and haven’t managed to get anything achieved that I am asking for now. I believe I have helped the Nordics achieve level 1 & 2 but have so far not managed to get Finland to level 3. That’s been my struggle and what I am trying to achieve now because I believe if increasing member value is successful in Finland it will be successful in other countries.

So I hear completely hear and sympathize with your challenges. I just think that if I continue to do what I did for the last 18 months when I tried to start “level 3″ as I call it I will continue to fail.

I am willing to try it your way though and hopefully we’ll see some action soon.

Best,
Steve

@Stephane;

On the light certification I simply disagree. I think it would be a very good thing and I think it warrants a vote. I am not arguing to translate the test rather I am saying it’s an argument to do the same test online free for all and a proctored version you pay for. Even if I could translate it in Finnish (which my Finnish friends will tell you I can’t! :) , it doesn’t solve the problem for the rest of the worlds languages.

On your second point I think I have misled you for which I apologize. I said in my original post that
a local non-profit should be set-up and administered locally, meaning that there would be no involvement from the WAA head office. The local market should identify that it is ready to move to the next level and I used 200 people as a benchmark for that. I didn’t mean that the global WAA should help the market run those events aside from offering finance as is already agreed at 25%.

I agree 100% that event coordination can only be done locally. No doubt about that, it’s also why a locally funded operation is needed. BTW, Lennart and I go back a long way and we are sponsoring the IMC in Helsinki in September which not only am I involved but the Finnish WAA will be. Also speaking for about the 10th time at eMetrics London, though I might not get invited back at this rate! :) I know all about the events, and Jim is the legend that set the whole thing up in the first place with Bryan E. I was involved right from the beginning.

It’s not that I don’t do anything (I refer to the way you keep saying YOU:) it’s just that I’ve done and have been doing for years and this is the only way that I find discussion gets raised. Social media huh? Got to love it. My wishes now are that the WAA will allow us to help ourselves (and help the organization).

Petri (WAA finland) and I have been asking for the locally funded organization for 18 months – since Petri became country manager and only now have I had a response from anyone that I believe may be acted upon.

This is the second time we’ve been asked for a proposal so I’ll dust off the last one which was sent a year ago and send it again. We actually spoke to Claire Madden about this a year ago and were refused on the grounds that we were trying to form a splinter group. Which of course we’re not.

Sitting here being polite and keeping quiet has got me nowhere for the last 18 months. In my opinion I am actually “doing” right now by writing this and spending considerable time and effort going through the thought process behind this.

Aurélie & Stephane, thanks for stepping in to the conversation. Steve, as far as the translation of the Certification Test project, I think Aurélie has provided the direction you were looking for; please see the ongoing discussions within the Global Group.

The “online, light version of Certification” idea conflicts with the International Certification Standards the WAA is following, as has been discussed previously on your blog. Perhaps the continued discussion on this topic is just a misunderstanding. We cannot put the Certification Test itself online; if the test was online, it would no longer be a Certification Test by definition!

Likewise, any other test that is online – no matter what someone calls it – does not comply with the requirements of a true Certification.

On the other hand, if what you mean by “online, light version of Certification” is you think the WAA / WAA members would benefit from a free, online test of member *knowledge* (which is different from Job Certification) as part of WAA membership, I agree.

As you know, the products created for the membership by the WAA rely on volunteers to get the job done. So all we need is WAA volunteers to create this online test of knowledge, which would be based on the Knowledge Required document, which was created through the efforts of the WAA Global membership.

Since you feel so strongly about this issue and have a vision for the project, would you like to chair the volunteer group that creates this online test? We’d welcome your participation.

@Jim

I can help with that. Will be in touch.

I shared my experience on Web Analytics Demystified, thought it relevent.

I took the test at the London eMetrics. It was very tough, especially the case studies which each felt like doing a whole day’s work in 15 minutes!

Honestly, after the exam I was extremely concerned that I had over exposed myself and was starting to regret taking it at all. The test really makes you push yourself, it worked me much harder than I expected. I challenge anyone to take the test and not be impressed with the breadth and depth of the way it interrogates your skills.

I have taken vendor exams and they are good tool testers but in terms of real problem solving they do not compare at all. The WAA exam is much much tougher.

Based on my experience, if you claim to be a web analytics professional then you should, once confident in your abilities, take this test. Be sure though, if you masquarade as an analytics ninja this test will floor you.

I took it and passed, but it was hard work – good work WAA and thanks for my certification!

Rob.

@Rob

I don’t doubt it. I have heard that from a couple of folks whom have taken it and was involved very early on with the process that went into developing the certification so I know the quality of the test is good.

Just looking at the knowledge document shows you need a wide range of disciplines to qualify and I’ve never disputed the quality of the test.