I'd love to share specific challenges relating to this for a session. It's easy to get caught up with the systemic process of everything, however if your testing & iterating everything without context of the longterm product vision it can corrupt everything. The idea is to basically not be totally driven by data, but be inspired instead.

Let's share some specific challenges here to see how this session can be framed.

With Leancamp, I've been interested in measuring retention to gauge the quality of the experience, but I find that hard with this type of ad-hoc event. We've been using the Sean Ellis Test (simiilar to Net Promoter Score) as a proxy as well, but that's not giving us the same insight as we'd have with a proper way to analyse retention, such as a cohort analysis.

Another challenge: last year, we took a shot at a type of conference (rather than unconference) tour. We started with a few events, iterating as we went. But it wasn't until I sat down to work the numbers, and to brain-dump alternative models, that it clicked we were on a much harder path than we needed to be.

Alexis, what inspired you to suggest this? Anyone else have challenges to share here?

In addition to User Experience aspects, we might want to connect this to discussions on actionable metrics and business models too.