VN IPP - Week 1 - Session 04 - Experiment Design Basics & The Real Book
Bạn đang xem bản rút gọn của tài liệu. Xem và tải ngay bản đầy đủ của tài liệu tại đây (3.93 MB, 56 trang )
Experiment Design Basics
&
The Real Book
Learning goal:
Which value prop is better? Faster
download time or obfuscated IP address.
Hypothesis:
Using VP of Faster download time instead
of obfuscated IP address will increase
conversion rate on home page above 15%.
Plan:
Use optimizely to change VP on home page
for 2000 visits.
Time box: 7 days
Learning goal:
Which value prop is better? Faster
download time or obfuscated IP address.
Hypothesis:
Using VP of Faster download time instead
of obfuscated IP address will increase
conversion rate on home page above 15%.
Plan:
Use optimizely to change VP on home page
for 2000 visits.
Time box: 7 days
Result: 16%, Win!
Experiment Templates*
1.
2.
3.
4.
5.
6.
7.
8.
9.
Learning Goal
Hypothesis
Metric
Fail Condition
Plan
Time Box
Results
Next Step
wtf,s!
Experiment Templates*
1.
2.
3.
4.
5.
6.
7.
8.
9.
Learning Goal
Hypothesis
Metric
Fail Condition
Plan
Time Box
Results
Next Step
wtf,s!
Retrospectives
Experiment Templates*
1.
2.
3.
4.
5.
6.
7.
8.
9.
Learning Goal
Hypothesis
Metric
Fail Condition
Plan
Time Box
Results
Next Step
wtf,s!
G: Do customers want our VP?
H: 50% of people we interview
will say they want it!
M: % of people who want it.
F: <50%
P: Go interview people on Market
street
T: 1 day
R: Success, 7 people said yes.
N: Do a landing page test.
s! No one will talk to us.
The
Unofficial Startup
Real Book
