This conference is an incredible few days of entrepreneurship educators and folks planning entrepreneurship programs sharing their work and ideas.
If you’re going, we’ll see you there!
Friday Night Party
Let’s get the important stuff out of the way first. We’re hoping to host our second-annual happy hour party Friday night after the conference activities. We’ve got room for 100 USASBE Conference attendees to join us, so register here if you’d like to attend.
3 Talks + A Competition
We’ll be leading a handful of sessions during the conference:
Mechanical Pencil Challenge: Defining “Early Adopters” And Where To Find Them (Fri. @9:30 am in the Banyan room & again Sun. @9:30 am in Blue Heron).
This exercise uses mechanical pencils, and a 10-minute competition between attendees, to introduce Early Adopters. We contrast them with Early Majority and Late Majority customers, and demonstrate where and how to find a business model’s Early Adopters.
A Better Toothbrush: Testing Assumptions Via Customer Observations (Fri. @9:30 am in the Banyan room & again Sun. @ 9:30 am in Blue Heron).
This fun and high energy exercise utilizes children’s toothbrushes to help attendees see how easily they can make hidden assumptions that hinder the success of a project. We introduce attendees to customer observations, a tool to mitigate the consequences of hidden assumptions. Overall, this is an engaging Design Thinking exercise that encourages attendees to assume less, and observe more.
Rigorously Assessing Experiential Courses: Transparent Grading Using Check-Ins, Mini-Cases, And Reflections (Sat. @ 9:30 am in Snowy Egret).
During this session, attendees feel how frustrating it is to be evaluated by vague/subjective criteria. Attendees learn five tools for transparently evaluating experiential courses and then brainstorm ways they can incorporate these techniques in their course. Attendees leave with session with a set of detailed sample rubrics that will enable them to both teach more experientially and assess more objectively.
The Mechanical Pencil Challenge and the Better Toothbrush exercise
…are finalists for the 3E Experiential Entrepreneurial Exercises Competition!
Come cheer us on at 9:30am on Friday in Banyan!
Hope to see you there!
Justin, Doan and Federico
Want More Student Engagement?
The Updated Experiential Entrepreneurship Curriculum (ExEC)
At least that’s what we’re trying to do. The feedback from our pilot professors tells us we are doing pretty well. There have been hiccups, and learning moments, but our agile team and processes have allowed us to respond promptly and create an engaging user experience for both professors and students.
Now in Over 40 Universities
At this point last year, our the Experiential Entrepreneurship Curriculum (ExEC) was in roughly 20 schools. Strong demand for a structured, experiential, 15-week entrepreneurship curriculum has doubled the number of universities we’re in.
Of course, being a new venture determined to help students learn how to create new ventures, we’re adamant that we…
Practice what we preach!
We gather feedback from professors and students after each lesson. Through this, we focus on how they felt teaching the lesson (professors) or completing the lesson (students):
We interview professors multiple times during the semester. Our team invites students to talk with us so we can learn more about how they feel living the curriculum, what we are missing, and what we are doing well.
We work tremendously hard to gather, analyze, and constantly make updates for next semester, not “next revisions” like traditional textbooks. The ExEC you see today is a result of our vision and assumptions, continuously tested with students and professors around the world.
While we gather a ton of feedback from our professors, but perhaps the best way to sum up their perspective is what Dr. Chris Welter had to say:
“It’s the software I’ve been looking for for 3 or 4 years . . . I really appreciate the ability for students to get their hands dirty”
New Professor Platform
After practicing what we preach and talking extensively with our professors, it was clear we needed to make some changes to our Professor Portal. We practice what we preach in building our product.
Our original professor-facing version was Google Docs, Slides, and PDFs:
It worked as an MVP and allowed us to test a variety of our assumptions, but ultimately our professors told us Google Docs was too cumbersome to use, and to print from.
So we built a brand new professor platform for our entrepreneurship curriculum! We are currently beta-testing this platform and will roll it out in Fall 2019:
We deliver each of our 31 lessons in a standard format, that includes six core elements for easy navigation and execution for our professors:
1. The Goals and objectives of that lesson. We frame each lesson in practical terms for our professors so they quickly understand why the lesson is important, and what their students will learn.
2. An overview showing where that lesson fits into the scheme and flow of the overall curriculum. We understand it is useful to always understand the big picture – where we’ve been, where we are, and where we are going. We also map our entrepreneurship curriculum flow onto the Business Model Canvas to highlight what lessons are applicable for particular boxes on the Canvas.
3. An overview video explaining the lesson, and Google Slides for classroom use. Our goal is for our professors to succeed, and that means providing information and tools. Some use slides and some do not, but we offer them just in case. We know some prefer videos to long text, so we offer both, just in case.
4. Instructions for how to prepare before class, including all the necessary resources. Experiential education is really difficult to execute. We provide our professors with a ton of direction to prepare for each lesson. We want them to succeed, and we want their students to remember each and every learning experience throughout the entrepreneurship curriculum.
5. A minute-by-minute exhaustive outline for delivering the lesson during class. What can we say, we are a but obsessive at times. But we figured more detail was better than less detail.
6. Instructions for what students could and should be doing after class. Let’s be honest – what happens after the class is just as important to a student’s learning experience as what happens within the confines of the particular class period.
While testing our first version, one need we heard consistently from professors was guidance on how to assess their students. They loved the experiential nature of the exercises, but they were not always clear on how they could help students understand their progression through the understanding and application of that content. So we built an Assessment Guide into our updated entrepreneurship curriculum to help our professors provide quality feedback to students throughout the process.
During the semester, students progress through 5 Validation Check-Ins. These are basically progressive pitches that act as the main opportunity for assessment. We give our professors rubrics and detailed guidance on how to assess the students’ documents and pitches.
Our goal with assessment is not just to help professors provide a grade, but to help professors provide meaningful and timely feedback to students.
One of the other pieces of feedback we got early on was that professors wanted to use us as the sole resource for their class. To do that though, we needed to add some breadth, in addition to our depth.
We feel confident we cover idea generation, customer interviewing, business modeling, and prototyping comprehensively, but what about finance, legal issues, branding, etc.?
So we conducted an extensive analysis of entrepreneurship curriculum, textbooks and syllabi, and interviewed dozens of the most respected entrepreneurship professors and entrepreneurs. Our goal was to understand what information would be most useful for students beyond our core offering. From that research, we developed an extensive Resource Guide that currently includes 17 modules.
These modules are by no means an complete exploration of the particular topic. Instead we offer an overview of the topic, a deep dive into some of the basics and the critical components of the topic, and then recommend an extensive list of curated resources and readings of that particular topic.
We want our professors to feel comfortable knowing if they recommend their students go through one of our Resource Guides, they will emerge with a solid understanding of the topic and how to apply that content to their context.
We are not the experts all of these topics, but have done considerable research to better inform our professors around these topics of interest. What we offer within each resource guide is an evolving list of additional resources (articles, books, videos, etc.) for students to continue their learning of a particular topic, or for professors to use as additional resources.
This Resource Guide is an evolving offering. As we hear from professors using our ExEC curriculum, or the community of 3,200+ professors reading our blog, that a certain topic is critical in entrepreneurship education, we will build a Resource Guide ourselves, or invite subject-matter experts to help us build one.
Our last major update is integrating with Canvas, D2L, Moodle and Blackboard. In our first version, students and professors had to download and upload documents, assignments, slides, and other materials. We heard loud and clear that this was not a great user experience.
We now offer the capability of uploading all our content neatly into the four learning management systems mentioned above. This will greatly reduce the setup time for our professors, and will provide a more comfortable learning process for the students.
As you can see, we have been hard at work learning what works and what doesn’t with ExEC. We constantly gather feedback from students and from professors. With this feedback, we strive to provide the ultimate experiential learning opportunity to entrepreneurship educators.
Now’s Your Chance!
We’ve been updating our curriculum and platform based on feedback from hundreds of professors and thousands of students. If you are looking for a fully structured, experiential entrepreneurship curriculum, with 15 weeks of lesson plans that students love, an in-depth complementary Resource Guide, and a comprehensive Assessment Guide, you should check out ExEC.
Get our Next Free Lesson Plan
We email new experiential entrepreneurship lesson plans regularly.
Subscribe here to get our next lesson plan in your inbox!
With the new academic year upon us, we wanted to share our strategies in time for you to incorporate them.
ExEC’s Assessment Philosophy
Assess Process. Not Progress.
What that Means
Ensuring students understand how to create businesses that fulfill customers’ emotional needs (e.g. solve problems, achieve desires, etc.) via an iterative process consisting of devising and executing experiments to validate assumptions.
As teachers, we have very limited time with students – one, maybe two terms. The businesses they build during their time in school are not going to be their best/last chance at success. Students’ time with us is best spent developing a mindset that prepares them for creating future ventures.
Why We Believe it
A focus on process encourages:
Skill development (not syllabus gaming)
Meaningful learning about the market, customers, problems, etc. (not inflating/falsifying numbers/results)
An experimental entrepreneurial/intrapreneurial mindset they can leverage regardless of where their career takes them
How We Achieve it
Evaluating students’ understanding and implementation of the business model validation process through:
Small-group meetings with instructors
What Not To Assess:
Achieving “Product-Market Fit” or “Problem Validation.” Often times the best outcomes for business model experiments is determining the model isn’t worth pursuing in its current design. Students should be rewarded, not penalized, for invalidating their assumptions, even if it means they don’t validate a problem during their interviews, or generate revenue during their demand tests.
Number of interviews conducted. While students conducting very few interviews (e.g. < 5) aren’t demonstrating an understanding of the business model validation process, a high number of interviews doesn’t correlate to high comprehension of the process. In fact, in many cases, not being able to find customers to interview is a great way to invalidate assumptions. Avoid assessing students on the number of interviews they conduct, and instead, focus on the process they used to try to acquire their interviews, what they learned during their interviews, and how that informed their future hypotheses.
Number of paying customers or revenue generated. Putting emphasis here will incentivize students to alter the results of their experiments. Instead, we want to encourage students to run objective experiments, and report out on their actual results, even, and especially, if that means their experiments “fail.” Emphasizing their process, over their progress, will decrease students’ fear of failure, and encourage a more risk-tolerant and innovative mindset.
The originality or innovativeness of the idea. Assessing originality and innovativeness can be extremely subjective. Moreover, the focus of ExEC is to show students a process they can use to create successful businesses that solve problems. The solutions do not necessarily have to be original or innovative to solve a problem or teach students a process.
What To Assess:
Student’s ability to:
Effectively recruit prospective customers for business model validation experiments.
Design and execute business model validation experiments like demand testing, customer interviewing, etc.
Conduct interviews to understand the emotional perspective of their customers.
Use information from business validation experiments to devise and iterate possible solutions to their customer’s problems.
Assess the financial viability of their solution.
Describe their validation journey and understanding of the process.
An overview on how we implement our philosophy is below.
Assignments and Rubrics
There are four steps to the ExEC assessment model, all of which are graded on the following scale:
Full Credit: means the student demonstrates a consistent and complete understanding of, and ability to apply, the validation principles underlying the assignment.
Partial Credit: is given when students demonstrate an incomplete or inaccurate understanding of the underlying principles, or difficulty applying the principles.
No Credit: is given when students demonstrate a lack of willingness to learn, or apply, the underlying principles of the exercise.
Instructors are given the freedom to implement this scale as they see fit (e.g. a points system, A-F grades, etc.). Details on the specific steps of ExEC’s assessment model below:
Step 1: Exercises
Written assignments students complete outside of class that help them design and execute their business model validation experiments.
There are 29 exercises students do outside of class during a typical 15-week ExEC course. So as to not overwhelm our instructors, we recommend they assess most exercises with a simple complete/incomplete scale, based on good faith effort. We do however call out four exercises that are worth assessing thoroughly:
Business Plans vs Business Experiments: A written, or recorded, reflection on their Tower Building Challenge, where students educate a fictitious friend about the dangers of hidden assumptions and the power of experimentation and iteration. Why we grade this thoroughly:
First exercise of the class.
Demonstrates students’ understanding of the pros and cons of business planning versus business model validation.
Underscores the importance of experimentation, which they will be assessed on repeatedly throughout the class.
Your Early Adopters: This exercise demonstrates the difference between Early Adopters, Early Majority, et al., and helps students identify who they should conduct problem interviews to increase the efficacy of their outreach. Why grade this thoroughly:
Basis for student interviews. If they don’t get this right, much of the rest of their exercises will falter.
Will highlight the importance of empathizing with customers, which they will be assessed over and over throughout the course.
Key principle of entrepreneurship.
Customer Interview Analysis & Interview Transcripts: In these exercises, students record and transcribe (via automated transcription tools) each of their customer interviews, and build affinity maps to highlight the patterns in their qualitative data. Why we grade this thoroughly:
Demonstrates students’ ability to conduct customer interviews.
Demonstrates students’ ability to empathize with customers.
Demonstrates students’ ability to do qualitative analysis.
Will determine future experiments.
Experiment Design Template: This exercise asks students to design an experiment to test their Business Model’s riskiest assumption, including how they’ll execute the experiment, how long it will take to execute, what the success and failure metrics are, and what their next steps are based on the potential outcomes of the experiment. Why we grade this thoroughly:
Demonstrates students’ ability to identify the riskiest assumptions of their business model.
Demonstrates students’ understanding of effective success metric definition.
Demonstrates students’ ability to design and execute experiments that test falsifiable hypotheses.
Step 2: Validation Check-Ins
Short, 10 minute meetings between our instructors and individual teams where instructors assess a team’s understanding and application of the validation process, and help them overcome specific challenges they’re facing designing/executing their experiments.
Each check-in’s assessment focuses on four elements:
Preparedness: students completed and brought all required materials.
Empathy: students were able to understand the emotions driving their customers’ pains/gains, and utilize that understanding to effectively resolve their customers’ needs.
Experimentation: students effectively hypothesized falsifiable assumption and design, and implement experiments to test those assumptions.
Overall Process Execution: students effectively demonstrates an awareness of why they are taking a given step in the validation process, understand how it will lead to their next validation step, and execute those steps effectively
Step 3: Business Model Journal
A collection of Business Model Canvas iterations, and written reflections, detailing each student’s business model assumptions, experiments, and learnings throughout the course.
Unlike courses that produce a single Business Model Canvas at the end, ExEC students iterate their canvas upwards of 10 times throughout a course based on the experiments they run. Each iteration of their canvas is accompanied by a short reflection describing:
What hypothesis the students tested this week
The experiment they ran to test the hypothesis
The results of that experiment
How those results influence the experiment they’ll run next
Instructors can use this written history of each student’s validation journey, to assess how well the student understands and applies the validation process individually – independently of the contributions of their teammates.
Step 4: Process Pitch
A presentation of each team’s validation journey during the course, including all of their (in)validated assumptions, emphasizing their ability to execute the validation process, more than the final outcome of the business.
Students wrap up the ExEC course with a pitch, but not a traditional product-centric, Shark Tank-style pitch; this pitch is process-centric.
More important than the outcome of any single experiment, or grade on any one assignment, is helping students learn an entrepreneurial mindset – a process they can use to repeatedly use to solve problems of the people they want to serve.
This pitch not only helps instructors assess how well students understand the validation process, it will reinforcement one more time, the most important principles of that process:
ExEC does not include any exams, choosing instead to focus student efforts on out-of-class projects. ExEC is however compatible with exams when appropriate or required by an institution.
For midterm or final exams, we recommend presenting students with a scenario and asking them to describe what should be done next. For example:
Illustrate the focal venture’s business model using the BMC. Students can also be asked to create different version of the BMC based on changes in a key aspect of the business model (e.g., customer segment).
Creating an interview guide (who to interview, where to find them, what to ask)
Identify the riskiest assumption of the focal venture’s business model and design an experiment to test it (what assumption to test, specifics of the experiment design, metric to track success)
For possible scenarios/cases that can be used for an exam, consider the following:
An episode of the podcast “The Pitch.” In each episode of this podcast, real entrepreneurs are pitching their ventures to real investors.
A news article about a newly-opened venture started by a local entrepreneur. (As an illustration, here is an article about an entrepreneur who started a shoe cleaning service). The business page of the local newspaper is a great source for possible scenarios.
That is the overview of the ExEC experiential assessment model. If you have any feedback, or suggestions on how to improve it, we’re all ears. Please leave a comment below.
We’d love to hear how you structure assessment in your experiential class.
On the other hand, if you…
Want Structured Assessment in your Class?
If you like the engaging of power of experiential teaching, and are looking for a structured approach to assessment, request your preview of ExEC today.
It only takes a couple days to get a feel for the material, and get your course set up to use it. If you’d like to try ExEC for your upcoming term, take a look today.