How many experiments should we run?

Run as many experiments as your team can manage, because more tests mean faster insight. That is the short answer Joni Lindgren and Jasmin Yaya give to a listener question on Datadrivet.

A team in its infant phase runs somewhere between 1 and 5 experiments a month. A more advanced team can reach up to 1,000 experiments a year.

Only about 10 to 20 percent of ideas succeed. Run a few tests and you may go a long stretch without a winner.

The hosts spell out the team you need to sustain the volume:

• An analyst to set up and analyze the tests
• Developers to build the experiments
• UX designers to design them
• A team leader
• Cross-functional expertise that can move quickly together

Once an experiment wins, who builds the finished version? The hosts weigh the experimentation team against the department that owns the area.

Listen to the full episode of Datadrivet for the discussion on pace and team setup.