SlideShare una empresa de Scribd logo
1 de 29
Descargar para leer sin conexión
LESSONS LEARNED
           Andres Glusman
  VP, Strategy & Community Meetup
Co-organizer: NYC Lean Startup Meetup

       AGILEUXNY - FEB 2012




                                        @glusman
Accidental Lean Startup

1)  Agile development with multiple pushes per day

2)  Extensive customer development
Customer Development
3)  Experiment then double down




                                                     @glusman
     2
On pace to do 600-800 usability sessions this year

             Will cost around $30,000
    (less than 1 outsourced usability project)




                                                     @glusman
Test 2-3 days a week (t, w, th)

    Setup tests prior to knowing what will be tested

Recruit participants from community and through recruiter
                (compensate for their time)

  Use gotomeeting to broadcast sessions to developers

                Use silverback to record

   Follow each session with discussion & notes/video


                                                        @glusman
MALKOVICH BIAS:
THE TENDENCY TO BELIEVE THAT EVERYONE
     USES TECHNOLOGY LIKE YOU DO


                                   @glusman
                                @glusman
Watching people use the stuff you
build, is the best way to confront
the Malkovich Bias




                                 @glusman
Shifts the conversation from
how I would use the website to
how this user uses the website



                             @glusman
“This Group
                                            meets the first
                                             Saturday of
“This Group                                 every month “
meets the first
 Saturday of
every month “




        “This Group
        meets the first   “This Group
         Saturday of      meets the first
        every month “      Saturday of
                          every month “




                                                              @glusman
Testing on our DIY iPhone Rig

                     Similar approach to
                     iPhone testing




                                      @glusman
Lean Startup

1)  Agile development with multiple pushes per day

2)  Extensive customer development

3)  Experiment then double down
Experiment then double down



                                                     @glusman
     10
11
     @glusman
12
     @glusman
13
     @glusman
Experimenting is more
than A/B Testing



                    @glusman
Long term experiments

     Community Coaching
     Every new Organizer on Meetup has a
     coach on the community team & gets
     personalized emails from their coach with
     advice they need based on their situation




15
                                                 @glusman
How’s work?




16
              @glusman
How’d we get here?



                     Only greeted
                     80% of new
                     Organizers




17
                                    @glusman
Results


     No change!

          Except….




18
                     @glusman
Implemented across the board




19
                               @glusman
Customer Development lessons learned
1.  Give team direct access to customers
2.  Look for boulders in the road
3.  Substitute frequency for precision
4.  Strip out costs wherever possible
     …but be willing to trade money for time
5.  Have discussions
6.  Launch & learn
7.  Accept that failure is most likely outcome
8.  Experiment then double down
                                                 @glusman
21
     @glusman
22
     @glusman
PROCESS



23
               @glusman
Just started doing it




                        @glusman
Snuggle up with failure




                          @glusman
WHAT WOULD YOU
DO IF YOU ASSUMED
YOU WOULD FAIL?




               @glusman
RUN INTO A BUZZ SAW AS FAST AS WE CAN




                                  @glusman
GO AFTER THE THINGS THAT
WILL CAUSE US TO FAIL AS
FAST AND OFTEN AS WE CAN




                           @glusman
Drop me a note


Andres Glusman
andres@meetup.com
@glusman




29
                    @glusman

Más contenido relacionado

Destacado

Skill Building For Design Innovators
Skill Building For Design InnovatorsSkill Building For Design Innovators
Skill Building For Design InnovatorsSteve Portigal
 
Framing Behavior Design
Framing Behavior DesignFraming Behavior Design
Framing Behavior DesignChris Risdon
 
Lean Usability
Lean UsabilityLean Usability
Lean Usabilityglusman
 
Inspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - LextantInspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - LextantLextant
 
Introducing design thinking
Introducing design thinkingIntroducing design thinking
Introducing design thinkingZaana Jaclyn
 

Destacado (8)

Lean Usability
Lean UsabilityLean Usability
Lean Usability
 
Skill Building For Design Innovators
Skill Building For Design InnovatorsSkill Building For Design Innovators
Skill Building For Design Innovators
 
Framing Behavior Design
Framing Behavior DesignFraming Behavior Design
Framing Behavior Design
 
The UX of Social Media
The UX of Social MediaThe UX of Social Media
The UX of Social Media
 
Lean Usability
Lean UsabilityLean Usability
Lean Usability
 
Inspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - LextantInspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - Lextant
 
Introducing design thinking
Introducing design thinkingIntroducing design thinking
Introducing design thinking
 
Parcours
ParcoursParcours
Parcours
 

Último

Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 

Último (20)

Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 

AGILE UX NYC - Lessons Learn

  • 1. LESSONS LEARNED Andres Glusman VP, Strategy & Community Meetup Co-organizer: NYC Lean Startup Meetup AGILEUXNY - FEB 2012 @glusman
  • 2. Accidental Lean Startup 1)  Agile development with multiple pushes per day 2)  Extensive customer development Customer Development 3)  Experiment then double down @glusman 2
  • 3. On pace to do 600-800 usability sessions this year Will cost around $30,000 (less than 1 outsourced usability project) @glusman
  • 4. Test 2-3 days a week (t, w, th) Setup tests prior to knowing what will be tested Recruit participants from community and through recruiter (compensate for their time) Use gotomeeting to broadcast sessions to developers Use silverback to record Follow each session with discussion & notes/video @glusman
  • 5. MALKOVICH BIAS: THE TENDENCY TO BELIEVE THAT EVERYONE USES TECHNOLOGY LIKE YOU DO @glusman @glusman
  • 6. Watching people use the stuff you build, is the best way to confront the Malkovich Bias @glusman
  • 7. Shifts the conversation from how I would use the website to how this user uses the website @glusman
  • 8. “This Group meets the first Saturday of “This Group every month “ meets the first Saturday of every month “ “This Group meets the first “This Group Saturday of meets the first every month “ Saturday of every month “ @glusman
  • 9. Testing on our DIY iPhone Rig Similar approach to iPhone testing @glusman
  • 10. Lean Startup 1)  Agile development with multiple pushes per day 2)  Extensive customer development 3)  Experiment then double down Experiment then double down @glusman 10
  • 11. 11 @glusman
  • 12. 12 @glusman
  • 13. 13 @glusman
  • 14. Experimenting is more than A/B Testing @glusman
  • 15. Long term experiments Community Coaching Every new Organizer on Meetup has a coach on the community team & gets personalized emails from their coach with advice they need based on their situation 15 @glusman
  • 16. How’s work? 16 @glusman
  • 17. How’d we get here? Only greeted 80% of new Organizers 17 @glusman
  • 18. Results No change! Except…. 18 @glusman
  • 19. Implemented across the board 19 @glusman
  • 20. Customer Development lessons learned 1.  Give team direct access to customers 2.  Look for boulders in the road 3.  Substitute frequency for precision 4.  Strip out costs wherever possible …but be willing to trade money for time 5.  Have discussions 6.  Launch & learn 7.  Accept that failure is most likely outcome 8.  Experiment then double down @glusman
  • 21. 21 @glusman
  • 22. 22 @glusman
  • 23. PROCESS 23 @glusman
  • 24. Just started doing it @glusman
  • 25. Snuggle up with failure @glusman
  • 26. WHAT WOULD YOU DO IF YOU ASSUMED YOU WOULD FAIL? @glusman
  • 27. RUN INTO A BUZZ SAW AS FAST AS WE CAN @glusman
  • 28. GO AFTER THE THINGS THAT WILL CAUSE US TO FAIL AS FAST AND OFTEN AS WE CAN @glusman
  • 29. Drop me a note Andres Glusman andres@meetup.com @glusman 29 @glusman