Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (19)
Destacado
Destacado (13)
Similar a Measuring Social Change and Media: Beyond BS
Similar a Measuring Social Change and Media: Beyond BS (20)
Más de Beth Kanter
Más de Beth Kanter (20)
Último
Último (20)
Measuring Social Change and Media: Beyond BS
- 1. Measuring Social Change & Media: Beyond BS SXSW 2013: Beth Kanter, KD Paine, David J. Neff, Carie Lewis
- 2. Beth Kanter: Master Trainer, Author, and Blogger @kanter
- 3. Katie Delahaye Paine Publisher The Measurement Standard News Group International kdpaine@kdpaine.com www.themeasurementstandard.com http:/kdpaine.blogs.com Fellow and Board Member: Society for New Communications Research IPR Measurement Commission 3/7/2013 www.themeaasurementstandard.com
- 4. David J. Neff, Author and creator Lights. Camera. Help. / SXSW 2013 @daveiam @npfilm
- 5. [Carie Lewis, Deputy Director, Online Communications]
- 7. Who are you? Raise your hand if ……. - Social Media Manager for Nonprofit - Social Media Manager for For-Profit - Other Nonprofit Staff - Consultant/Social Media - Consultant/Measurement or Evaluation - Other
- 8. And your Org? Raise your hand if organization is budget is .. -Less than $1 million -$1-$5 million -Over $5 million Type .. -Social Service -Environment -Arts -Education -Animal Welfare -Community Services -Health Care -Other
- 9. Workshop Agenda AGENDA OUTCOMES Introduction Understand how to get started with a measurement Data Informed program for your Organization organization’s social media Case Studies FRAMING 7 Steps of Measurement Interactive Case Studies Fun Wrap Up #NETNON
- 10. Raise Your Hand If Your Strategy Goal Is …. Improve relationships Change behavior Increase awareness Increase engagement Increase dollars Increase action
- 11. Stand Up If ….. Photo by net_efekt
- 12. Stay standing if your organization is using social media and getting measurable results given your goals?
- 13. Share Pair: What is your burning question about measurement?
- 14. The Data Informed Organization
- 15. The Five Stages of Measurement Acceptance in the Nonprofit Sector Data Delight Informed Confusion Fear Denial
- 16. Denial I don’t have the time to measure.
- 17. Fear What if my strategy or program doesn’t show success?
- 18. Confusion I know I should measure our social media and network, but not sure what or how?
- 19. Delight Hey check out these cool charts and graphics!
- 20. Data Informed Successful networks and social media start with measurement
- 21. Data-Informed Culture: It starts from the top! Do Something.org
- 23. Tear down those silos and walls around data …
- 24. More time think about that the data, then collect it
- 26. Video
- 28. Why did it fail? What did we learn? What insights can use next time around? DoSomething.Org’s Fail Fest
- 29. CWRF: Becoming Data Informed: What Does It look like? Crawl Walk Run Fly Lacks consistent data Data collection Data from multiple Org Wide KPIs collection consistent but not sources shared No reporting or Data not linked to System and structure Organizational synthesis results, could be for data collection Dashboard with wrong data different views, sharing Decisions based on gut Rarely makes decisions Discussed at staff Data visualization, to improve meetings, decisions reporting, formal made using it reflection process Analysis Tools Sense-Making
- 30. Living Case Studies Data Informed
- 31. [HSUS Is Data Informed] HSUS is the nation’s largest and most effective animal welfare organization. Most Important KPI’s: • Amount raised • # of action takers • # names new to file • Growth rate • Customer service wins
- 32. [Not Every Department Is Data-Informed] 2011: FEAR stage Web: 1% of donations 2013: DATA INFORMED stage Web: 33% of donations
- 33. THE DATA INFORMED ARTS ORGANIZATION By David J. Neff, Author and creator Lights. Camera. Help. / SXSW 2013 @daveiam @npfilm
- 34. KPI: DRIVE TICKET SALES
- 35. Measurement Indicators: Analysis CRAWL WALK RUN FLY Lacks consistent data Data collection is Data is from multiple Establishes organizational collection or formal consistent, but not sources and shared KPIs and tracks in reporting. Draws shared between across departments organizational dashboard conclusions from departments. Not all through a dashboard. with different views for incomplete data or data is linked to Does not collect data it departments or levels. “drive by” analysis. decision-making for doesn’t use. May have data analyst on better results. Measurable objectives staff. are based on benchmarking. LCH HSUS
- 36. [ 2 = WALK Stage for Analysis] (Some people are still not all about it and resist the change in process ) Our Analysis Process: Our Challenges: • Everyone gathers their data • Reports aren’t distributed org-wide yet • We sit in a room and analyze it • Still making some decisions based on what • The project manager develops a report of we think, not supported by data “what we did/what we learned/what we • Upper management still not on board, just recommend for next time “+ data wants things to get done
- 37. [ 2.5 = WALK STAGE FOR ANALYSIS]
- 38. Maturity of Practice: CWRF - Tools CRAWL WALK RUN FLY Not using or not Using free or low Using free/low cost Uses professional using fully. cost analytics tools analytics tools to measurement and to collect metrics collect metrics and analytics tools. and analyze further analyze further in Provides training or in spreadsheets if spreadsheets if uses expert required for required for consultants to assist actionable insights. actionable insights. in data/analysis. Uses social media management/metric s professional tool to collect data. HSUS LCH
- 39. [ 3- RUN Stage for Tools ] • We have the tools in place • We’ve trained people on how to pull the data • We’re using several different tools • We’re keeping a running spreadsheet of data
- 40. [3.5 =TOOLS] +
- 41. Maturity of Practice: CWRF – Adjustment CRAWL WALK RUN FLY Does not use Uses data for Reports are Formal process data to make decision-making discussed at for analyzing, planning but not a formal staff meetings discussing, and decisions. organizational and used to applying results. process. make decisions Data that improve visualization and results. formal reflection processes. LCH HSUS
- 42. [ 3 – RUN Stage for Adjustment ] How we’ve adjusted: • Reports are discussed • Reports are revisited before making campaign plans the next year • Decisions are based on previous reports Example: Hurricane Sandy • Sharing fundraising worked really well, will continue to optimize this technology • Text to give featured as prominent giving vehicle in social media for the first time • Did very well working in conjunction with donation link on Facebook photo album • Will use again – in disaster planning will set up social media text to give code immediately
- 43. ADJUSTMENT : WE REPEAT THE MISTAKES OF THE PAST + = 2
- 45. [ Some Advice… ] 1. Patience. It was so hard to get everyone on board that “data matters.” Be patient. 2. Baby steps. We tried to do too much and ended up right back where we started. 3. Put together a digestible, ONE PAGE report on your findings. 4. Figure out the technical stuff. It may take forever, but you’ll be glad you did. 5. Campaign. Teach others why data and analysis is so important. 6. Develop a tracking system. Create a naming convention for your tracking links, and hold people accountable 7. Narrow it down. Again, don’t try to do too much. Figure out what matters. 8. Share your successes! Give stakeholders the report, don’t hoard it!
- 46. TOP FIVE PIECES OF ADVICE 1) Make it a priority – It’s not just your team in the process 2) Organize – Call an all staff meeting or get it part of a future all staff meeting 3) Plan using a tool – Find a framework you want to use. Such as the OGST format 4) Involve your volunteers/board – What data driven professional can help you solve this issue? Think mgmt consultants, Programmers, Data designers. 5) Experiment with the tech – Don’t end with Excel. Fail forward with the best tool for your level of data collection. Pivot Tables 101 anyone?
- 47. Share Pair: Where is Your Organization? Crawl, Walk, Run or Fly?
- 48. KD Paine’s 7 Steps of Measurement Framework Goal Insight Audience Tool Investment KPI Benchmark
- 49. It’s not about you, so get over it Conversations Member Development Research Volunteers Funders HR Recipients Service Savings, shorter cycles, more renewals, better ideas, research 3/7/2013 www.themeaasurementstandard.com
- 50. The 7 steps to Social Media Measurement Step 1: Define your goal(s). What outcomes is this strategy or tactic going to achieve? What are your measurable objectives? Step 2: Define your audiences. Who are you are trying to reach? How do your efforts connect with those audiences to achieve the goal. Step 3: Define your investments. What is it really costing you to achieve this outcome? Step 4: Define your benchmarks. Who or what are you going to compare your results to? Step 5: Define your metrics. What are the indicators to judge your progress? Step 6: Select your data collection tool(s). Step 7: Analyze your data, turn it into action, measure again 3/7/2013 www.themeaasurementstandard.com
- 51. Step 1: Define the goals: Why Social Media? What return is expected? – Define in terms of the mission. What problems is Social Media supposed to solve? What were you hired to do? What difference are you expected to make? If you are celebrating complete 100% success a year from now, what is different about the organization? If your Social Media is eliminated, what would be different? 51 3/7/2013 www.themeaasurementstandard.com
- 52. Goals, Actions and Metrics Goal Action Activity Metric Outcome Metric Increased Conduct a Number of likes & % increase in donations Donations photo contest share of contest Cost per new donor link acquired Increase Modify % increase in traffic % increase in membership content, add to web site membership as share of interactivity income functions 3/7/2013 www.themeaasurementstandard.com
- 53. Step 2: Don’t ask me, ask your stakeholders What you need to listen for: – What keeps them up at night? – What are they currently seeing? – Where do they go for information? – What influences their decisions? – What’s important to them? – What makes them act? 53 3/7/2013 www.themeaasurementstandard.com
- 54. Step 3: Establish benchmarks Past Performance Think 3 – Peer – Underdog competing for share of wallet – Stretch goal Whatever keeps the Board suite up at night 3/7/2013 www.themeaasurementstandard.com
- 55. Step 4: Why you need a Kick-Butt Index The Perfect KPI Is actionable Is there when you need it Specific to your priority Continuously improves your processes Gets you where you want to go You become what you measure, so pick your KPI carefully 55 3/7/2013 www.themeaasurementstandard.com
- 56. Step 5: Define your investment Be honest – Social Media is not “free” Be transparent Don’t forget opportunity costs The CFAC example 3/7/2013 www.themeaasurementstandard.com
- 57. Step 6: Pick the right measurement tools If you want to measure messaging, positioning, themes, sentiment: Content analysis If you want to measure awareness, perception, relationships, preference: Survey research If you want to measure engagement, action, purchase: Web analytics If you want predictions and correlations you need two out of three 57 3/7/2013 www.themeaasurementstandard.com
- 58. Step 6: Selecting a measurement tool Objective KPI Tool Increase inquiries, web traffic, % increase in traffic Web Analytics: Google Analytics, recruitment #s of clickthrus or downloads Omniture, Web trends Increase awareness/preference % of audience preferring your brand Survey: Phone Calls, SurveyMonkey, to the competition or Mail Engage marketplace Conversation index greater than .8 Web analytics or Content Analysis: Rankings Facebook Insights, Convio, Omniture, % increase in engagement Google Analytics Communicate messages % of articles containing key Media content analysis, Survey messages Research Total opportunities to see key messages Cost per opportunity to see key messages 58 3/7/2013 www.themeaasurementstandard.com
- 59. The ROI of Emily 59 3/7/2013 www.themeaasurementstandard.com
- 60. So What = Revenue 35,152,789 OTS Red line indicates media 6,253,852 OTS impressions 60 3/7/2013 www.themeaasurementstandard.com
- 61. Thank You! For more information on measurement, read my blog: http://kdpaine.blogs.com or subscribe to The Measurement Standard: www.themeasurementstandard.com For a copy of this presentation go to: http://www.kdpaine.com Follow me on Twitter: KDPaine Friend me on Facebook: Katie Paine 3/7/2013 www.themeaasurementstandard.com
- 62. How HSUS Applied 7 Steps Goal Insight Audience Tool Investment KPI Benchmark
- 63. [ 7 Steps of Measurement – Hurricane Sandy ] Goal: Audience: Investment: Raise $x million to people who love staff time, support animal animals and want technology hosting relief efforts to help Metrics: Tools: Benchmarks: amt. of donations, Convio, Tweetdeck, last hurricane donations by Facebook Insights, (Isaac) we raised $x source, Twitter ad platform thousand sentiment % Insights: text to give fundraising in social media works really well so we need to do more of it, we raised a significant amount of money via sharing so we need to continue to optimize that medium, Facebook photo album tied to donations worked because people are so visual so we need to use photos more to tell our story.
- 64. [ The Evolution of Our Data ]
- 65. How LCH Applied 7 Steps Goal Insight Audience Tool Investment KPI Benchmark
- 66. GOAL
- 67. AUDIENCE
- 68. INVESTMENT Staff Time Consultant Time Volunteer time Technology costs (App, VWALL, Web Site, Hosting)
- 69. BENCHMARK Adoption is hard to track (multiple shelters/locations/city vs nonprofit) Varied programs that have varied results across the United States. No previous adoption program that contained all the metrics and goals that we would be experimenting with.
- 70. METRICS Once again, adoption is hard to track What can we track to get people to think about adoption? - Pledges to Adopt - Pledges to visit a shelter - Pledges to walk a dog at a shelter - Pledges to tell their friends about adoption on social channels - Pledges to take a photo of a dog at a shelter - Join a fundraising event in your area
- 71. TOOLS HTML/CSS for Site iPhone = C++ Android = Java Vwalls = Java Social Channels = FB, Twitter, YouTube, Later Foursquare Meetup.com. Wait? People still use that? YES. Measuring with TweetReach and SproutSocial
- 72. INSIGHT 1) Should of defined a tighter audience with personas. 2) Undertaking dual app development in concurrent work streams is a GIANT PAIN IN THE ASS. 3) Working with Apple to get an app in the app store is a GIANT PAIN. 4) People loved sharing user generated content. We even had people create meme’s around invisible dogs. Community for BFAS is inspiring. 5) App market is crowded. Needed to spend more budget towards marketing the adoption app.
- 73. It is your turn to apply the 7 steps! Step 1: Pick A Result Improve relationships Change behavior Increase awareness Increase engagement Increase dollars Increase action
- 74. KEEP CALM
- 75. Share Pair: What is your personal metric or department’s “Kick Butt Indicator”?
- 76. Who wants to share? We have prizes!
- 77. Takeaways: Share Pairs and Full Group • What’s one tip or technique that you can put into practice next week?
Notas del editor
- Measuring Social Change & Media: Beyond BS This workshop will dramatically demonstrate how the practice of measurement, social media, social change, and networks have evolved over the past 5 years. In 2009, the "Social Media ROI Poetry Slam" SXSW lead to a book "Measuring the Networked Nonprofit." The thesis: For nonprofit organizations there are two key processes that lead to social change: To become networked, and to use measurement. The book's co-authors, Beth Kanter and KD Paine will facilitate an updated of the original poetry-slam session with the same four nonprofit leaders about they have used networked strategies and measurement to improve results and transform failure into success. http://www.flickr.com/photos/e06158/6953185456/
- http://www.flickr.com/photos/socialgoodbrasil/8179199091/sizes/l/in/photostream/
- Overview of what Lights. Camera. Help. is. How It was founded why it’s important. A little about the book and that it’s for sale after the session.
- Measuring Social Change & Media: Beyond BSMonday March 1111am-1:30pmAT&T Conference CenterClassroom 2041900 University Avenue Learning ObjectivesWalk away with a basic understanding of what it means to be data-informed and the 7 steps of measurementLearn about how leading nonprofits are using measurement to improve results of their social media and have a data-informed cultureHow to apply the first step of the 7 steps of measurement – linking your organization’s success to your department’s KPI
- http://www.flickr.com/photos/tom-poes/505598151/in/photostreamI’ve been watching you ….Some of you already know that ….
- The c-suite has just approved your strategy to leverage networks and social media for your mission. But, if your internal culture is not a social one how can you possibly expect to be successful? This workshop will share strategies and techniques for changing your nonprofits culture to be more agile, training other staff to be social to scale, and managing your nonprofit's c-suite and board. The workshop will share tips and techniques for culture change, training, and adoption. Best of all, there's nothing like peer to peer support in this effort to keep inspired. Designed as a peer learning session with Internationally acclaimed Master Trainer Beth Kanter and leading social media nonprofit practitioners like NWF's Danielle Bridiga, Rachel Weidinger from Upwell, and Laura Fitton from Hubspot. Walk away with a basic understanding of what it means to be data-informed and the 7 steps of measurementLearn about how leading nonprofits are using measurement to improve results of their social media and have a data-informed cultureHow to apply the first step of the 7 steps of measurement – linking your organization’s success to your department’s KPI
- http://www.flickr.com/photos/tallmariah/185557867/sizes/z/in/faves-cambodia4kidsorg/
- http://www.flickr.com/photos/firecloak/6774418629/sizes/l/in/photostream/
- http://www.flickr.com/photos/hockeyshooter/4132732687/
- http://www.flickr.com/photos/theimagegroup/369893824/
- There’s another important organizational skill - data-informed this describes agile, responsive, and intelligent nonprofitsthat are better able to succeed in a rapidly changing environment and can fuel networks of networks. DoSomething.org has a big hairy social change goal: To harnesses teenage energy and unleash it on causes teens care about by launching a national campaign per week. The call to action is always something that has a real impact and does not require money, an adult, or a car. Their measurable goal is to get 5 million active teen members engaged in social change campaigns by 2015. Their use of social media, mobile, and data all strategically selected and use to reach that goal.They are a networked nonprofit with a data informed culture – and it started at the top with their board and advisors ..Reid Hoffman and DjPatil – “A Data Scientist” – have advised the CEO – Nancy Lublin – not only what infrastructure is needed to collect and make sense of data, but how she as the leader can’t rely on hunches – decisions – have to be informed by data.
- http://www.flickr.com/photos/mkrigsman/3428179614/DoSomething has two data analyst positions on staff .. And they aren’t sitting in the corner playing with their spreadsheetsWhile a big part of their job is to become the stewards of the dashboard, they work with staff – so that making sense of data Is not an adhoc process, but one of continous improvement of the programs. The data analysts work collaboratively with staff to help them apply and understand their data.
- One of their organizational mantra is “Spend More Time Thinking About The Data, Less On Collecting ItPregnancy Text” Campaign featured on their quarterly dashboard. This clever sex education campaign is an updated version of the teen pregnancy education program where young people carried eggs around and pretend they are babies. It was a text campaign where teens opted in to receive texts on their mobile phones from the “baby.” Once they joined (and they could share it with their friends). they received regular annoying text messages at all hours from the “baby” that poops, cries, and needs their immediate attention.The team at DoSomething.org uses data to base the program design, key performance indicators and a hypothesis to be tested. They looked at survey data from the National Campaign: nearly 9 in 10 (87%) young people surveyed also say that it would be much easier for teens to delay sexual activity and avoid teen pregnancy if they were able to have more open, honest conversations about these topics with their parents and/or friends. So, success of this campaign would be mean that participants talk with their family or friends about the issue and delay sexual activity.The basic design had those who signed up challenge their friends to take care of a text baby either by (1) going to DoSomething website and selecting 5 friends to challenge or (2) after receiving a text from DoSomething (sent to DoSomething’s 300k mobile subscribers) would opt to challenge friends after reading a quick stat on US teen pregnancy. Participants that accepted the challenge would then start receiving texts the following morning from the text-baby. After completing the challenge user were prompted to send it to their own friends.DoSomething.org also followed up with 5k of the users with a text-based survey to measure impact.Once defining success and identifying the right data collect, here’s some of the insights they gleaned according to Nancy Lublin, CEO of DoSomething and Jeffrey Bladt:SMS as a platform: They are monitoring engagement per communication channel and it has revealed SMS to be 30xs more powerful for getting their users to take action as compared to emailChallenging 5 friends: we’ve tested various group sizes for SMS experience and have found the a group of 6 (1 alpha inviting friends) leads to the highest overall engagementResearch Based Messaging: The general messaging for the campaign was based on survey findings that found (1) big scare tactics (e.g. getting pregnant = not going to college) we not as effective as highlighting who being a teen parent changes daily life (e.g can’t go to the movies because baby sitter cancelled); (2) a CDC report that found: “The impact of strong pregnancy prevention messages directed to teenagers has been credited with the [recent] teen birth rates decline.A/B Testing: They pre-tested different messages and frequency of sending the messages to smaller test groups of teens to optimize the number of messages the baby would send during the day, as well as the content. They ended up doubling the frequency and rewording several interactions as well as building in a response system (so the baby would respond if teen texted an unsolicited response). The insights from these tests pushed up engagement and likelihood of forwarding at the end.Impact: They did a survey to measure this. 1 in 2 teens said that taking the Pregnancy Text made it more likely that they would talk about the issue of teen pregnancy with their family and friends.As you can see from the above insights, DoSomething just not gather and analyze topline data:101,444 people took part in the campaign with 100,000 text-babies delivered171,000 unsolicited incoming messages, or 1 every 20 seconds for the duration of the campaign. During the initial launch period (first 2 weeks), a new text message was received every 10 seconds.For every 1 direct sign-up, DoSomething gained 2.3 additional sign-ups from forward to a friend functionality. The viral coefficient was between 0.60 and 0.70 for the campaign.1 in 4 (24%) of teens could not finish a day with their text-baby (texted a stop word to the baby)DoSomething.org uses its data to continuously improve programs, develop content, and shape campaign strategies. So DoSomething.org wants its staff to spend more of its brainpower thinking about the data, rather than collecting it. To ensure that this happens, DoSomething.org’s Data Analyst Bob Filbin’s job is more than programming formulas in Excel spreadsheets. Says Filbin, “One of the biggest barriers in nonprofits is finding the time to collect data, the time to analyze, and the time to act on it. Unless someone is put in charge of data, and it’s a key part of their job description, accelerating along the path towards empowered data-informed culture is going to be hard, if not impossible.”
- No addhttp://www.youtube.com/watch?v=QhgsJjNVbu0http://gawker.com/5950941/kathie-lee-dropped-a-puppy-on-his-head-on-live-tv-todayhttp://www.youtube.com/watch?v=sQzo_3yIc8M
- Back in the office, the data scientists were looking at the data in real time to figure out what was driving people to their landing page and getting them to sign up.
- Fail Fest And Pink Boas: Don’t Be Afraid To FailDoSomething.org doesn’t use its data to pat itself on the back or make the staff feel good. Lublin notes that they’re not afraid of failure. They hold regular “Fail Fest” meetings, where each person on staff has to present a campaign or program failure. They share three things they learned about themselves and three things the organization learned. To remove the stigma from failure, Lublin says, “We have to wear pink boas when we present.” http://www.flickr.com/photos/ruminatrix/2734602916/in/faves-cambodia4kidsorg/
- The “Crawl, Walk, Run, Fly” Maturity of Social Media practice framework is in Beth’s next book, Measuring the Networked Nonprofit. We used to help us design the program, determine process outcomes, and help us evaluate our progress.Explain modelPhotos: Runhttp://www.flickr.com/photos/clover_1/2647983567/Flyhttp://www.flickr.com/photos/micahtaylor/5018789937/
- Slide 1: Organizational Elevator Speech and Key Results for Social Media – What is an example of your KPI metric linked to your department or personal goal/definition of successNotes: My favorite is the customer service wins. These are the intangible benefits of social media, which we showcase via screenshots in a weekly Social Media Mentions Report. This way, executives can see when we turn people around one-by-one, even though there is no numerical way to measure this.
- Notes:It was hard to get the web team to buy into source coding. It was a change in their daily routines of publishing content: now they had to get a source code for each hyperlink they inserted. But when they saw the change from the disaster campaign last year to this year, and web got much more credit for fundraising, they were really excited. They felt accomplished. That was what it took to get them to accept.
- Overview of what Lights. Camera. Help. is. How It was founded why it’s important. A little about the book and that it’s for sale after the session.
- This is great – you could link this to KD Paines “Think about a key performance indicators as a “kicking butt index” – and what would result if you could say, “Boy are we kicking butt” – also to ask what would it look like if “Wow, we’re getting butt kicked” More on selling tickets and how we measure that.
- For your action learning projects, it will be important for crawlers – to set up a regular system and discipline – don’t take on too big a project .. Make it small winFor those walking, important to get everyone’s input …. I know this can be tricky – but we are here to support you.
- Slide 2: Where are you on the CWRF scale for the measurement indicator: analysis? Why? Share a screen capture, photo, or something that you can explain why. Walk-2Data collection is consistent, but not shared between departments. Not all data is linked to decision-making for better results.(I will insert audience poll – and depending on the results ask you for your advice to walkers to get to running, etc)
- Analysis. Organization data collection is consistent, but not shared between departments. Not all data is linked to decision-making for better results.Data is from multiple sources and shared across departments through meetings. No dashboard, no staff to collect, just volunteers and board members helping get it all up and running.
- Slide 3: Where are you on the CWRF scale for the measurement indicator for tools? Why? Screen shot, photo, or something. You can talk about your organization’s favorite metrics/analysis tool and why?ToolsUsing free/low cost analytics tools to collect metrics and analyze further in spreadsheets if required for actionable insights. Uses social media management/metrics professional tool to collect data. Notes: my favorite is Google Analytics because I can create reports based on what I’m looking for. I do like SmallAct too, because it can drill down data on specific users, and there’s something very cool and big brother about that.
- We are executing great on our tools and collection of information through those tools. Using free/low cost analytics tools to collect metrics and analyze further in spreadsheets if required for actionable insights. Uses social media management/metrics professional tool to collect data. Uses professional measurement and analytics tools. However not training people or other volunteers. No outside experts helping us.
- Slide 4: Where are you on the CWRF scale for the measurement indicator adjustment? This is about how you use your data for decision-making. It would be great to have an example of a data point that you collected – an KPI related to your goals – what the data said and how you applied to getting results or adjusting what you’re doing. Any formal processes for data visualization, learning from failure, etc would be great to cover. AdjustmentReports are discussed at staff meetings and used to make decisions that improve results.
- We are not identifying our data correctly. And not sourcing it correctly. Hence the Taxonomy fail. And since we are an all run volunteer organization it’s hard for us take action on the adjustments. Much like mindless zombies we repeat the mistakes of the past. We are big believers in failing fast and learning from our mistakes. As an all volunteer org this can be a hard thing to keep inYour DNA. So how are we planning to fix this in 2013?
- Slide 5: Your wisdom or advice to audience about becoming data informed.Notes:We created a “source jar” where if you did the sourcing convention wrong (lazy) you had to put a quarter in the source jar. When we got enough money, we’d all go out for ice cream. We haven’t gotten enough money yet!From NTEN:Change, a quarterly journal for nonprofit leadersTech Across Your Org: Internal Communications Carie Lewis, HSUS How to Talk About the Right Data in the Right Way Within Your OrgThe Humane Society of the United States has a well-established and successful online communications program. But here’s one thing we’re not so great at: the world of data. And we know it. But we decided to turn that around this year, and so far it’s been successful for us.Our online team is 30 staffers strong, broken up by channel: email, website, social, mobile, and online advertising. There is no specific role for reporting; we all are pretty much on our own to evaluate our work. We’re always winning campaigns and creating real change for animals, but what if we could do that in a way that was – smarter?So we made a commitment to move towards a more data-driven culture. We wanted to know: how can we use statistical data to work smarter and make better decisions about how to be more effective in our work? Not having any existing structure, we made the mistake of getting in too deep to start. Each channel manager came to a meeting where we’d fill out this huge excel spreadsheet full of numbers, as well as a word document filled with explanations and screenshots. It seemed brilliant – every data point we could possibly get in one place! Until we had to do it again. It was such a huge task (not to mention exhausting) that we just gave up on it. We couldn’t even make meaning of the data anyway because there was too much of it. So we stopped meeting. And tracking. And we failed.Then, we realized our problem. We were trying to do too much. We decided we had to narrow down the stats to what meant the most to us (which for us is usually advocacy and fundraising-focused). We then had to determine what really mattered for the whole process -- why were we doing these reports? For us, it was to evaluate what we did, what worked (and what didn’t), and determine how we could do things differently next time. And from that was born our new reporting system which has worked very well for us so far in 2012.The New Reporting Process:Each time an online campaign is over, the channel managers meet to discuss how the campaign performed. We all have our own metrics and data, depending on what’s important to our channel, and have only 10 minutes to share with the rest of the group. (We’re all about reducing meeting time here at HSUS as well.) The discussion is usually very productive and eye-opening. We’ve found that metrics change from campaign to campaign, so it’s helpful NOT to have a standard template with every metric available. But the most important metric to focus on across all campaigns is conversions – in the end, did people do what you wanted them to do?After the initial meeting, each channel manager sends the campaign’s project manager a summary of the most relevant information, and the project manager compiles it into a one-pager. It’s easy for everyone (including executives!) to digest, and breaks the campaign down into what we did, what we learned, and what we recommend for next time. In the end, that’s exactly what we want the data to tell us.The Lessons We Learned:- Data matters. Do track – even if it’s exhausting.- Educate others on the importance of tracking and how to do it consistently.- Don’t try to do too much – it’s better to track a few key metrics consistently than to track a lot of data inconsistently or to the point that you give up.- Narrow down the stats that matter most to your bottom line.- Present data in a way that is easily digestible by anyone at your organization.As I mentioned, our biggest “ah-ha” moment was when we realized we were trying to do too much, and we lost focus and interest and just gave up. Figure out what really matters and how you can get that data. It was essential that we educate others about the importance of using trackable links and come up with a naming convention for those links so that when we pulled the data, we’d know where conversions were coming from. There’s a huge cross-organization education task here. We had to teach colleagues that don’t work in Online Communications why a page view wasn’t an acceptable success metric (it’s about conversions!)So, how is it going? I’ll let you know next year when we pull out the one-pager during the campaign planning process! The goal is for these one-pagers to help us make informed campaign planning decisions. Each one-pager represents the key take-aways from this year’s campaigns so we can see what worked and what didn’t. We can replicate the tactics that worked and improve or eliminate the tactics that failed.I can tell you that since we instituted this new tracking system we’ve garnered over 100,000 action takers from social media so far this year, which is double our goal for the year! That’s really great information as I work to prove the impact that social media has on our bottom line here at HSUS. And that’s really what it’s all about – meeting your goals and working smarter.
- See slide and will add color.
- Where do I start? Is a question I get frequently, and my response always is “Don’t ask me, ask your stakeholders.” You may need to do some research before you jump in. That’s what listening really is, isn’t it? You need to know what keeps them up at night, where they go for information, what ELSE they’re seeing out there and what makes them act.
- Measurement is a comparative tool. You don’t know if your results are good or bad unless you can put them into context, either looking at them over time, or in comparison to a peer group. The most important entity to measure against is whatever keeps your bosses up at night.
- There really are only three times of tools in social media measurement If you want to measure messaging, positioning, themes, sentiment you need Content analysisIf you want to measure awareness, perception, preference you need Survey researchIf you want to measure engagement, action, purchase: you need Web analyticsIf you want predictions and correlations you need two out of three
- David and Carrie presentations on how their organizations applied 7 steps for a campaign or project or something – 12 minutes each – w/ 3 minutes of questions from KDGoal > Audience > Cost > Benchmark > Metrics > Tool > InsightStep 1: Define your goal(s). What outcomes is this strategyor tactic going to achieve? What are your measurableobjectives?Step 2: Define your audiences. Who are you are trying toreach? How do your efforts connect with those audiences toachieve the goal.Step 3: Define your investments. What is it really costing youto achieve this outcome?Step 4: Define your benchmarks. Who or what are you goingto compare your results to?Step 5: Define your metrics. What are the indicators to judgeyour progress?Step 6: Select your data collection tool(s).Step 7: Analyze your data, turn it into action, measure again
- Launch the campaignRun a donations by source report in Convio, export to ExcelFill in reporting templateMeet with other channel managers to discuss dataFill out What we did/what we learned/what we recommend for next time reportSend report to stakeholdersLook at report before the next campaign and make decisions based on content of the report
- Move people some simple awareness up the “Adoption” ladder to REAL ADOPTION. Shocking but true. You can watch the Sarah McLaughlin commmericals and donate all you want. But how do you get people to take action?
- The problem with this project is that our audience was a littefuzZY. Just like this photo. And as our project involved User Generated Content (both from the app and the from the VWALL) we had a couple of weirdos pop up from the audience. Much like this guy in the front row. : )
- Talk about costs and app development and user generated content
- See slide and will add color
- See slide and David will add color.
- Overall numbers were very good for moving a tough subject into the public’s eye. As we talked about in the book on page 88 we had over 40k people visit the first month and got over 2,000 of them to take the pledge at one level of the engagement ladder or another. However Best Friends learned that the app was popular but not enough to keep it in the store. As part of this we launched the National Shelter Check-in Day. That program still takes places. It was initally a small part of this overall project. However it’s popularity was sustained and it’s remained a viable program for BFAS into 2013 and beyond.
- http://www.flickr.com/photos/boellstiftung/5447787551/
- http://www.flickr.com/photos/tracyhunter/144845928/sizes/l/
- http://bit.ly/network-leadership