Policy-area application
How different policy areas apply to the SIF's standards and criteria.
Run a Pilot
Designing and running pilots for the Lab. A pilot takes one or more elements of the Lab and tests it with participants - meaningfully simulating, at some proportion, what the full National Conversation could be.
the basics
What is a pilot?
A pilot is any engagement that takes one or more elements of the Lab to be tested with participants, in an interaction that meaningfully simulates - at some proportion - what the full National Conversation could be.
Pilots can take many forms: in-person or digital, a single session or a series, a survey question embedded in a broader instrument, or a facilitated deliberative workshop. What makes something a pilot is not its format but its purpose - a pilot tests something in order to determine whether and how it should be included in the Lab's final model and Shared Inquiry Framework (SIF).
what pilots test
A pilot may test any of these.
Technology & methods
Tools and methods for reaching and engaging participants.
Exact questions
Specific question wording, phrasing or sequencing from the SIF.
In-person design
Facilitation approaches and the structure of face-to-face engagement.
Framing & narrative
The language and context provided to participants.
Complexity & accessibility
Whether questions are pitched at the right level for the audience.
Session format
The structure and shape of the session itself.
We strongly recommend limiting the number of things being tested at once - the more variables tested simultaneously, the harder it is to isolate what is working.
what is not a pilot
A conversation purely about the Lab itself - its design, governance or purpose - is a valuable touchpoint, but it is not a pilot. A pilot requires that an element of the Lab's methodology, questions, framing, format or technology is being tested with participants in a way that simulates the National Conversation experience.
who can run a pilot
Pilots can be run by…
A student can test questions with peers; a community organisation can embed a pilot in an existing program; a group or individual can initiate an entirely new event; a researcher can include a pilot within an approved survey instrument.
Core Partners
As part of their contribution to the Lab's design process.
Expert Advisory Network
Where piloting is within the scope of their engagement.
Community Network
In alignment with their local implementation work.
Other trusted collaborators
As approved by the Secretariat.
the shared rules
All pilots must be run in accordance with the Lab's Terms of Reference and Code of Conduct. By agreeing to the Terms of Reference, pilot runners commit to the Lab's operating principles, its assumptions of participation, and its code of conduct.
conditions, not guidelines
Core requirements for all pilots
Alignment with Lab principles
Pilots demonstrate a focus on quality of engagement over volume of participation, with transparent and visible feedback loops. Inclusion of community members is designed from the outset.
Secretariat approval & alignment
All pilots must be approved by the Secretariat before they run, designed in alignment with the principles of the Lab, and reported fully upon completion.
Process insights, not recommendations
Pilots may surface perspectives across policy areas - but must not represent outcomes as a final policy conclusion or position of the Lab or the National Conversation.
Non-partisanship
Pilots are a space to practice how we make decisions, not to reach and then advocate for particular positions. Care must be taken to stay within the Lab's non-partisan guidelines.
Conflict of interest
If a runner holds an advocacy position on the policy area being tested, it must be disclosed at registration. Failure to disclose may result in a pilot's findings being excluded.
Transparent & accountable
Pilots must be reported honestly, including what did not work. All pilots must provide raw data to the Secretariat within four weeks of completion. Your own analysis is encouraged, but must accompany - not replace - the raw data.
design your pilot
Seven steps to a strong pilot
Work through each step before submitting your pilot for approval. You should have a clear answer to every question - the Secretariat will review your responses as part of the approval process.
what are you testing?
Choose your variables
Policy-area application
How different policy areas interact with the SIF's standards.
Technology & methods
Digital platforms, tools, or trade-off dynamics.
Exact questions
Specific wording, phrasing or sequencing from the SIF.
In-person design
Facilitation, room design, structure of engagement.
Framing & narrative
How questions or sessions are framed and contextualised.
Level of complexity
Whether questions suit the audience and format.
You may select more than one - but keep variables manageable so findings can be clearly attributed.
how will you test effectiveness?
Build in comparison or feedback
All pilots must consider output quality and usability, assessed against the Lab’s output quality criteria (under development).
A/B or comparative testing
Run two or more sessions with variations and compare responses. Iteration is encouraged.
Session plus structured debrief
Run the engagement, then facilitate a structured debrief using the provided online tool.
scale & duration
Set the size and the window
Remote · one to many
One to many - open
Social media or open online. Broad reach, limited sample control.
One to many - closed
Designed survey to a defined population. Preferred for digital.
In person
Large group (35+)
Only with adequate resourcing and fit-for-scale design.
Medium (20–35)
Facilitated workshop, well suited to deliberative formats.
Small (up to 20, ideally 12+)
The preferred format. Depth, nuance and quality experience (min. 5).
Match length to depth - set the duration to suit the format, and always leave time for a debrief.
level of inquiry complexity
Pitch the right level
Level 1 - Civic Imagination
"What matters most?" Highest scale, lowest context. Surveys, community touchpoints, schools.
Level 2 - Design Calibration
"What trade-offs can I live with?" Moderate scale, requires facilitation. Suited to workshops and forums.
Level 3 - Tool Development
"How should governments listen and respond?" Smallest scale, highest context. For specialists - discuss with the Secretariat first.
framing or policy area
Choose your context
Policy-area neutral
No specific domain. Most portable, consistent testing.
Intergenerational fairness
Framed through fairness across generations and economic dignity.
Health & wellbeing
Health systems, prevention and long-term wellbeing.
Climate & environment
Ecological thresholds, energy transition, responsibility.
Housing
Access, affordability and generational equity.
Emerging technology
AI, digital infrastructure and technology governance.
Choosing a policy area does not change the underlying inquiry standards being tested - it changes the context through which they are explored.
how will you implement?
Name the people and the support
Who will design it?
The person or team adapting questions and producing facilitation materials.
Who will deliver it?
Who leads the session or manages distribution, and their experience.
What support do you need?
The Secretariat can advise on question design, SIF alignment and reporting format - identify what you're seeking at registration.
how will you report back?
Commit to the data
All pilots must provide raw data to the Secretariat within four weeks of completion. This is a firm requirement - holding raw data across pilots lets the Secretariat compare and synthesise findings in a methodologically consistent way.
Survey-based pilots
Unprocessed response data for the questions being tested.
In-person or facilitated sessions
A detailed runsheet outlining the prompts provided to participants, plus detailed outputs that clearly identify whether they are organiser or participant-written.
Digital engagements
Response data in its unprocessed or minimally processed form.
Your own analysis
Warmly encouraged and will be read - but it must accompany, not replace, the raw data.
Step 1 of 7
submitting for approval
How approval works
All pilots must be approved by the Secretariat before they run.
Do not begin participant recruitment, distribute any materials, or make commitments to participants until written approval has been received.
Express interest
Get in touch via our contact form with a short outline of the pilot you have in mind, and confirmation that you've read this guide and agree to the Lab's Terms of Reference.
Consultation & review
The Secretariat works through it with you and reviews it against the requirements in this guide, including alignment with the Lab's principles and the RECIG standards.
Decision
The Secretariat confirms approval, conditional approval with required changes, or a decline with reasons, in writing.
Run your pilot
Once approval is confirmed in writing, you may proceed. Do not run your pilot before written approval is received.
Report back
Share your raw data and any accompanying analysis with the Secretariat.
To get started, get in touch via our contact form with a short outline of your pilot. The Secretariat will work through the design, alignment and reporting with you from there.
get in touch via our contact form →accountability
Every pilot has a responsible person.
Every pilot must have a responsible person and an organisation. The responsible person is accountable for:
- The design and delivery of the pilot in accordance with this guide
- The safeguarding, health and wellbeing of participants
- The accuracy and completeness of data reported back to the Secretariat
- Compliance with all applicable legal, ethical, consent and cultural integrity requirements
By submitting a pilot for approval, the responsible person confirms they have read this guide, agree to its requirements, and accept responsibility for the pilot's conduct and reporting.
register your pilot
Ready to put a pilot forward?
There’s no form to fill in. Get in touch via our contact form with a short outline of your pilot — what you’re testing, the format and scale, how you’ll test effectiveness, and the support you’re seeking. The Secretariat will be in touch to work through design, SIF alignment and reporting. All pilots are reviewed and approved before they run.
get in touch to register a pilot