RSS
 

Archive for the ‘Web Analytics in Action’ Category

Keynote in eMetrics DC

17 Jul

I am humbled that I was invited to give a keynote presentation in the upcoming eMetrics Marketing Optimization Summit in Washing DC, Oct. 3-7, 2010.  I would guess this is a reward Jim Sterne gave to me, as a result of my best attendance record in the last two years :)

Yes indeed. I came to this “web analytics” thing about two years ago and have attended every eMetrics Conference since then. In each conference, I learn a lot, get to know many fine people in our field and come back with a bunch of ideas that I can implement at Dell. Each conference also marks a step forward in my personal growth. I shall say, without eMetrics Summit, I won’t be where I am today.

Let me reflect the journey…

Oct. 2008 in Washington DC. My first eMetrics Experience. I was shocked, overwhelmed, impressed and inspired. As a result of this conference, I decided this is what I want to focus for the rest of my life, as long as I am working. Here are the thoughts I wrote down at that time. eMetrics Summit 2008 Impressions and Reflections (Day 1), eMetrics Summit 2008 Impressions and Reflections (Day 2), eMetrics Summit 2008 Impressions and Reflections (Day 3) and Key Takeaways from eMetrics Summit 2008 in DC

May. 2009 in San Jose. I probably wouldn’t go to this conference if I wasn’t elected to the Board of Director of Web Analytics Association. Swine Flu was scary at that time. See my little story Here I am San Jose!

Oct. 2009 in Washington DC. In this conference, instead of just participating, I co-presented with my former manager, Gautam Madiman, now Director at AutoDesk, a topic many audience found interesting “Dell’s Evolution – Leveraging Analytics Globally as a Key Strategic Business Driver” I was also brave enough to take the WAA Certification “test the test” and was the second in place among 50 also participants. In this conference, I started the tradition to bring a Dell Adamo laptop as a give away prize.

May. 2010 in San Jose. In this conference, I was invited to the “Global Enterprise Management Panel” and sit down with Keith Boswell from Kaiser Permanente and Kim Stegner from IBM. To some extents, this panel helped me decide to focus on managing analytics in a global company as my future career goal. I also received the “WAA 2009 Championship” award together with my friend, Joel Wright. Again in this conference, I became one of the first 10 “WAA Certified Web Analyst”

And now it is the time for DC conference again. This time, I will try to do something different. Instead of just me standing there, I will share the stage with two managers in my team, Dave Nelson and Carol Goh. I will first share Dell’s vision to become the best in class in online analytics and testing. Dave will then talk about a very interesting topic “what a good test looks like”, drawing from his experience as the Global Testing Manager, managing the global testing roadmap. Carol will then talk about how to improve process to scale the testing program globally. I think this will be a great topic and interests to executives, managers and web analysts alike.

If you are coming to DC, please join us and you might be lucky to win a Dell Adamo XPS!

If you haven’t decided, I hope my experience in the last two years will help you make the case to yourself and to your management. Believe me, it worths the money.

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

Hosted WAW on Dell Campus

14 Jun

Last Wednesday, we hosted the Web Analytics Wednesday on our Round Rock campus. The day started with heavy rain fall, but to my surprise, there were 30+ fine people showed up. Together with about 15 Dell team members, we had a huge turnout!

We gave away five of my favorite books from leading authors such as Jim Sterne, Avanish Kaushik, Bryan Eisenberg,  Tim Ash & Jason Burby but I had to confess to the group that I haven’t finished all of them.

I did a short presentation on Dell’s vision to become the best in class organization of online analytics and testing followed by a really interesting and engaging panel discussion with five key members from our team. The group asked a lot of questions on our implementation strategy, difference in Consumer and Commercial online business and the panelists’ experience etc. My favorite part is what Kane Burns said, “(my job) is a happy medium between analytics and ability to influence business” Well done, Kane!

Here are some photos

Here is the presentation if you’d like to download WAW at Dell

Finally, below are all job positions still open in CSMB Online, Global Online and Public Online. Apply now if you are still interested in joining Dell!

  • 1003T2QG -Senior Analytics Manager, CSMB Online, 1 position available
  • 1004FPJS – Senior Online Analytics Program Manager, supporting Interactive Content, 1 position available
  • 1004FPX4 –Senior Online Analytics Program Manager, supporting Shopping Experience, 1 position available
  • 1004FQAG – Online Program Analyst, supporting various programs, 4 positions available
  • 100135JS – Web Analyst, Global Online
  • 1001CI7S – Web Analyst, Global Online
  • 1003GJZS – Web Analytics Regional Lead (Public sector – Americas), 1 position available
  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

My eMetrics Summit Speech

17 May

Thanks to Jim Sterne and the Web Analytics Association who kindly gave me five minutes to talk about Dell’s ambition to become the best in class in online analytics & testing and what kinds of talents we are looking for.

This is probably by far the shortest presentation I have delivered. But the message is simple and clear: as Dell is building our online analytics & testing capability and really focus on investing in people, process and technology, NOW is the best time to join Dell and really make a big impact.

Are you fired up by this? Let me know if you are.

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

WAA announced 2009 Championship Winner

04 Mar

and who is on the first place? Joel Wright and myself!

When Daniel Waisberg, the WAA marketing chair told me about this, I simply couldn’t believe it. But here is the official announcement as the prove.

Special thanks for the volunteers who made this annual event possible:

•Judges: Jennifer Veesenmeyer, Judah Phillips, Stéphane Hamel and “Wandering” Dave Rhee.
•Logistic & Organization: Daniel Waisberg, June Dershewitz, Clare Madden, Shannon Taylor, Suzanne Carter-Jackson.

I want to make our paper available on my blog as well and welcome any of your inputs. Enjoy reading!

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

Ecommerce is sad. How to get it right?

08 Feb

Valentine is coming, so maybe I should get something for my wife, before it is too late.

I stumbled upon www.limogesjewelry.com and like the “My Beloved Top-Engraved Message Stainless Steel Band”.

The product looks great at that price. What attracted me is the beautiful verse inscribed on the inside of the band, “I am My Beloved’s and My Beloved is Mine”. The big red “Add to Cart” button is easy to find, so I clicked.

Nothing happened. Click again. Same thing.

Is there a problem with Chrome browser I am using?

Switched to IE, the same problem.

After a few minutes, I saw a little error message on top of the page “Please type in your Personalized Message”.

Hmm? I thought I had chosen the personalized message?

Then I realized that it actually allows me to put in a personalized message for outside of band, up to 25 letters and spaces. This is written as part of the product decription but just completely skip from my eyes.

Ok, I put in “The Lord is my shepherd”

Click “Add to Cart” again.

A simple yet good shopping cart with candy aisle on the left. It also got some good security messages there such as “Verisign”, “McAfee Secure” and “BBB Online”.

So I continued with “Proceed to checkout”

First page is simple, kind of like Amazon’s which I am very familiar with. I am not a returning customer so choose “new customer”

Oh wow, this is a one page checkout layout. I have heard that before but haven’t got much chance actually using it (I do most of my shopping on Amazon which is one click).

Page layout is clean and simple with clear indication of step 1, step 2, step 3 and a big “Place MY ORDER” button.

It’s nice that it provides different payment options including paypal and bill me later.

With extreme delight, I fill in my shipping and billing information and click the big “Place my order” button.

What? Why I have to create a password?

Check the page again. It clearly states only the field with “*” is required and there is no “*” for password creation. So why I have to create a password?

Tried again, same problem.

Now I realized although the site adopted the “guest checkout” concept but it still requires of creating a password.

For what?

What a shame that a delightful checkout experience was ruined by a simple problem like this!

Since I like the product very much, I was willing to create a password to finish my order. Imagine the sales the site could lose for those users who might just bail in such situation. I didn’t bother to Google but I am pretty sure there are other websites can provide similar services, possibly at lower cost.

So what’s my evaluation of shopping experience on Limogesjewelry.com?

It could be perfect, but now I am disappointed.

Good news is both errors could be fixed pretty easily.

All it takes is somebody deeply cares about customers and know how to use usability and testing tools to identify issues and fix them.

But in reality, there are tons of problems like this everywhere on the internet. While the HIPPOs are bragging about their social media strategies and media are busy predicting what’s the next big thing, there are millions of customers are bothered by such problems and billions of dollars are lost due to less satisfied customers.

It’s sad. Ecommerce is sad. As a web analyst working in ecommerce industry, I am deeply sad.

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

What’s your analytical framework? (part two)

28 Jul

Last time, I talked about “Analyze” and what you need be careful about.

In this post, I am going to talk about the first “M”, Monetization. In web marketing, when people talk about monetization, they usually refer to one of the two activities: the first is about how to utilize the real estate on a website and sell the space to other companies who might be interested in showing ads there. For example, if you look at www.dell.com/home you’ll find there is Nokia and Vizio sitelets at the bottom of the page.

The second is actually what I want to address here: “monetization” in web analytics’ sense, refers to the process and methodology to quantify the possible financial impact of an optimization effort based on certain facts and assumptions.

Monetization is a great tool to sell an optimization project. Obviously agencies use it a lot in their fancy presentations. Shane Atchison and Jason Burby from Zaaz wrote a whole chapter “Monetizing Site Behaviors” in their book “Actionable Web Analytics” (You can preview most pages at Google Books They built a simple yet nice template. You can view the sample here.

Of course, the same concept and similar template can be used by practitioners to prioritize the optimization roadmap.

At Dell, we have a site optimization meeting on the weekly basis. One critical item always on the agenda is to review the testing & targeting roadmap. When we first started with testing, we feared that we didn’t have enough testing ideas. But once the ball is rolling, we often find ourselves faces the problem of too many ideas. Almost everybody from HIPPO’s to sales agents has something in their minds that they are curious about and want us to test. Of course, only less than 20% of those ideas are truly valuable. Spending any time on 80% of the rubbish, your testing program is at risk to fail. How do we get to identify the 20%? We do monetization-we estimate potential impact from each test and prioritize based on dollars amount as well as ease of implementation. Using data instead of emotion to argue with those who are passionate about their testing ideas is such a life saver.

In addition to help prioritize test roadmap, it can also help us prioritize the analytics roadmap. Does analytics need a roadmap? Yes, of course! As a web analyst, I always find myself swim in the sea of tons of different requests from executives I support. The only way for me not to drown in the sea is to prioritize by monetizing all requests. The question I always ask myself is “how much more revenue or margin I can bring to the company if I spend this many hours on this request?” Astonishingly, many times I found the answer is “none, not really”. So I move on. I am lucky to have an alignment with my direct management on this process. He and I often sit down, during our weekly meeting, to review the projects I am working on and prioritize it based on monetized values. Of course, we both realize that we still have to do some monkey works nobody wants to do, such as clean up data etc. That is just part of our lives and we all have to live with it. But if you are spending most of your time in the monkey works, I am pretty sure soon you will either burn out, or find yourself replaceable.

Our time is VERY precious. In fact, I believe the most valuable asset a company has to drive site optimization is not any of the tools, either free ones or the ones they pay millions of dollars, but the time of its web analysts. We can either protect this valuable asset or let it be ruined. We shouldn’t do any analytics just for the sake of analytics. Nor we should do any analytics only to satisfy somebody’s curiosities. The end result of analytics should be either concrete recommendations to the business that some parts of the website needs to be changed, or some test ideas that the testing team can take over to execute.

Monetization is a great friend of web analysts and we all should wholeheartedly embrace it. Sadly I find often we rush from “Analyze” to “Optimize”, without really “monetizing” the efforts. Do it now, and it will help you live longer and happier.

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

What’s your analytical framework?

23 Jul

There is no lack of talking about analytical framework. Each of them has its pros and cons. The one we created is called “A.M.M.O”. Let me explain this to you and see if you like it or not.

First, let me explain what the acronym really means:

“A” stands for “Analyze”; First “M”, stands for “Monetize”; Second “M”, stands for “Mobilize”; “O”, stands for “Optimize” .

See, I managed to find four words all end with “ze”.

“Analyze” is straight forward. That’s what we, as web analysts do every day, so no need to explain, right?

One thing I want to caution is though, we need make sure that the data we are looking at is correct. If the raw data is not even correct, then that’s “garbage in, garbage out”, regardless how sound your analytical framework is. The analysis results might be misleading and hurting the business, rather than helping the business.

In the web analytics world, we usually are dealing with two sets of data. The first set of data is either the overall metrics at the site level or the most granular data at page level. For this type of data, it will be hard to make mistake. And if you ever made a mistake, even your HIPPO will quickly point it out for you!

The second set of data is at “segment” level. At this point, all web analysts should know that “segmentation” is at the core of any web analytics project. If you don’t know how to segment your visitors or traffic and analyze visitor behavior accordingly, then you should really go back to the training camp.

But the risk is also with “segmentation”. Anybody has experience with Omniture Discover on Demand or Omniture Insights (previously Discover on Premise and prior to that Visual Sciences) or similar tools, probably understand what I mean. There are two major factors could screw the data. First, the exact way to build the segments: in Discover or Insights, you have many different ways to build a segment and not all of them give you the same data. Second, the sampling issue: due to huge amount of data, a lot of web analytics applications can only give you a sample rather than the complete data set, depends on how much data you are asking for.

With this understanding in mind, it is imperative for any web analyst to have a healthy amount of suspicion of the data accuracy. Not only the data pulled by somebody else, but also the data we pull. Yes, we make mistakes too!

There are ways to mitigate the issue of course. (we have hope-it’s not the end of world!). What I usually do is to make sure that I can get the data from two different data sources and compare them side by side. If you are using Omniture, you should always try to compare the data you get from Discover vs. the data from SiteCatalyst. For example, if you are building a segment for a group of pages, you should at least compare the total visits for that group of pages from Discover with the sum of all visits of those pages. These two numbers will never match but they shouldn’t be way off. If I see a huge difference between them, that’s a red flag to me. [Bonus tip: if I have to bet $10 on either one, I will definitely bet on SiteCatalyst and go back to review the data I got from Discover]

Ok, that’s all I want to say about “Analyze”, assuming you’ve got the rest. In my next few posts, I’ll touch upon the other letters one by one and round up with a final summary. Stay tuned!

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

Web Analytics 101 & Career Advice by Alex

27 May

Alex Cohen did a wonderful job in this presentation to give his advices on how to start a web analytics career. Thought this is a good one to share with visitors to my blog.

Although his presentation is geared more toward beginners, yet the same principle are applicable for those who want to take their web analytics understanding and practice to the next level: learning (books, blogs, eMetrics Summit etc.), sharing (blogging, speaking etc.), networking (web analytics wedesday, eMetrics Summit etc.) and participating (WAA committees, WAA yahoo forum etc.)

I can’t think of any other way to improve myself and this is an ever evolving, life time process too. The moment you start to think that you know everything, that’s when you probably need find another job.

Now let’s enjoy what Alex brought to us:

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

Seth Godin Saying “No”

26 May

I’m sure this is purely coincident. Yesterday I blogged about the first tip I shared with my fellow web analysts, titled “Tell me why you need this data before I give it to you!” Today I read a brief post by Seth Godin, “Saying no”.

Essentially we are talking about the same thing. Maybe I am not as bold as Seth but a little more polite by asking “why” question than straightly saying “no”. The end goal is the same: by asking “why” question or saying “no”, we allow ourselves focus on critical few things, rather than millions of ad hoc requests.

That’s the choice we all have to make. Like Seth put it so simply, “you can dissipate your gift by making the people with the loudest requests temporarily happy, or you can change the world by saying ‘no’ often. ”

I´m change-challenged

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark
 

Super Web Analyst Tip 1: Tell me why you need this data before I give it to you!

25 May

I plan to share some tips I have learned at work in a series of blog posts and here is the first one.

One common problem we, as web analysts are facing, is people tend to think that we are reporting or data people. And as a result of that, they often come to us and ask for all kinds of data without even telling us why they need it and how they plan to use it. Like it or not, that’s a reality we all have to deal with but that’s not saying that we don’t have any choice.

Actually two choices at least:

Choice number one, give them anything they are looking for, as long as you have it. Result of this? One, you will become a favorite person in the department and people will actually complement on your work and attitude etc. Sometimes if you are lucky, you might also get a team award or something like that. Two, you will be downgraded from a “super web analyst” to a “reporting squirrel”.

Hello World...

Yes, you hear me right. You will be downgraded. Your value will be diminished. You will not be considered as a “thought leader”. At the end of year, when you are doing performance review with your manager, he is going to ask you, “what significant changes you have made to the business?” and your answer, is sadly “no, nothing”.

You can’t make significant contribution to the business by simply providing data or even nice looking reports to people. You have to go beyond that.

So here is the choice number two. Ask smart questions before you give them the data.

Questions

Here is a typically scenario: let’s just say that John is doing some projects and heard from Mary that Ed might have some customer information he is looking for. So he sent me an email like this:

“Ed, can you send me whatever information you have about customers’ feedback on our site performance? Thanks very much, John.”

If you didn’t read this blog, you might just spend hours trying to find out the customers’ feedback and send to John. You might end up working late, missing dinner with your family, and hating the company you are working for.

But I don’t like that.

So I sent an email back, trying to be nice, “Hey John, can you give me more context about what exactly you are looking for?”

[more than 50% of time, people will just forget what they were asking for and don't bother to respond again. But John is persistent.]

About a week later, John sent me another email “well, I was just trying to understand what customers’ pain points are…”

[that's interesting. It didn't help me understand all I need know but a step toward right direction]

So I wrote back again, “John, can you give me some examples regarding what customers’ pain points you are looking for and how you want to use this information?”

[more than 90% of time, people will stop asking for data when I ask twice for clarification. But...John is persisitent]

So he sent me an email again “For example, if customers tell us that they can’t make purchase online because some site errors, then my team might be able to solve the issues with our BPI (business process improvement, similiar to 6 sigma) methodology.”

[that's becoming more interesting. He was actually talking about some potential actions there!]

For the third time, (sorry to be pain on the butt), I sent him another email “John, l’d like to meet with you to discuss this. I want to understand more about your methodology / process and make sure I give you right information and data to help you with your project.”

If John is serious enough, we will meet, discuss and formulate a plan. And I’ll find out right information / data and do the analysis for him so that he can really solve customer issues. But if he is not serious enough or has other priorities, we will never meet and he will never ask for the information / data again.

At that time, I am pretty excited and willing to give him help whatever I can. The sad thing is, 95% of time, John never comes back to me again. But that’s ok. The remaining 5% of people still survived are the ones you should really care.

Ok, so this is my “super web analyst” tip one. Is this helpful? How do you deal with similar situation? Kindly share your thoughts here.

  • Twitter
  • Facebook
  • Delicious
  • Yahoo Bookmarks
  • Plaxo Pulse
  • Google Bookmarks
  • Digg
  • Windows Live Favorites
  • FriendFeed
  • Hotmail
  • Yahoo Mail
  • Share/Bookmark