
Tool Evaluation
Evaluating marketing software
Evaluate marketing software against real tasks, shortlist plausible options, compare supplier evidence and record what remains unproven.
Evaluate marketing software against the work your team must complete, the conditions it must work under and the evidence each supplier can provide. Start with a defined task, build a shortlist, compare demonstrations and record what remains unproven. A long feature list does not establish that a product fits the job.
Define the decision before viewing products
Name the problem, who is affected and the result that would justify a change. A campaign team, for example, may need to pass enquiries to sales with an agreed source label and see which enquiries progressed. That is more useful than asking for “better automation”.
Check whether the obstacle is software, a missing definition, an unclear hand-off or a constraint in the current setup. If an existing system might support the task, investigate its actual plan, permissions and configuration before treating a replacement as necessary. Record what remains unknown.
Set boundaries for the evaluation: the workflows and teams in scope, connected systems, decision owner and timing. The decision should answer whether a software change solves the defined problem.
Before preparing an evaluation brief, identify user and stakeholder needs, available market information, risks and the criteria that will guide the decision.
Victorian Government specification guidance also advises considering relevant government policy, international and Australian standards, supplier charters or codes, and opportunities for innovation or social procurement.
Turn tasks into evidence requests
Choose a small set of ordinary tasks and consequential exceptions. For each, describe the starting information, the user’s action, the expected result and what should happen when something goes wrong. Include conditions that affect daily use, such as who may approve a campaign, what an ordinary user can see and how a corrected record reaches another team.
Separate a requirement from a proposed design. “A sales colleague can identify the agreed campaign source on an enquiry” describes an outcome. Requiring a particular dashboard layout may rule out workable approaches without helping the decision.
Mark conditions that must be met before further consideration. Compare others as trade-offs.
Ask the people doing the work to check the task descriptions, and involve owners of connected systems and information where their input matters. A requirement is ready for suppliers when they can show how they would meet it and the team can recognise a failure.
A clear specification is the basis of supplier offers, so state expected outputs or functional and performance requirements accurately. The Victorian Government describes it as an essential contract-management document that can be used to check whether the chosen supplier provides what was specified. Keep the requirements simple and avoid onerous or unnecessary conditions.
Key Considerations When Evaluating Marketing Software
- Requirement (Outcome)
- A sales colleague can identify the agreed campaign source on an enquiry.
- Proposed Design (Implementation)
- Dashboard must display campaign source with a custom label layout.
- Risk of Over-Constraint
- Specifying a design may exclude viable solutions and limit innovation.
Build a shortlist you can explain
Look for candidates through more than one route: products already available to the organisation, supplier documentation, relevant market research and responses to the same short brief. For each candidate, record why it belongs on the list. A plausible fit for the principal task is a better reason than a broad category label.
Use an early screen to identify clear mismatches. Can the proposed product address the essential task? Is the necessary capability included in the proposed edition, or is that still unconfirmed? Can the team get the access and information needed for an assessment?
Keep unanswered questions visible. A website claim does not establish that a particular subscription and configuration will meet the requirement.
Avoid turning the screen into a contest of ticked boxes. One missing control in a critical hand-off can matter more than many extra features. Equally, a candidate may solve the task in an unfamiliar way. Ask every supplier to address the same outcome.
For a complex evaluation, refine the brief in stages rather than trying to settle every detail at the outset. Victorian Government guidance describes setting requirements at a high level for an Expression of Interest, then making them more detailed as the process moves towards shortlisting or a limited-market approach.
Australian Market Insights for Marketing Software Evaluation
- Top CRM Tools in Australia
- HubSpot, Salesforce, Zendesk, Microsoft Dynamics
- Popular Automation Features
- Email workflows, lead scoring, multi-channel campaigns
- Government Procurement Guidance Source
- Buying for Victoria – Specification & Evaluation Guides
Compare what suppliers actually show
Give shortlisted suppliers the same scenario and roles in advance. Ask them to show the normal path and one exception in the edition they propose, where possible. Note whether an action happens in the product, needs an administrator, depends on another system or is only described as possible. Record the edition, account and configuration shown, including any difference from the offer.
A prepared presentation can explain the supplier’s approach and implementation assumptions. A live product demonstration offers observable evidence about actions in the account shown. Neither establishes that a connection to your systems works or that staff can operate the product in production. If those uncertainties matter, arrange a later validation step through the organisation’s purchasing process.
Question / Record during evaluation
- Did the task reach the expected result?
- What was shown, by whom and in which environment
- What work sat outside the product?
- Manual steps, administrator actions and other systems
- What is conditional?
- Edition, configuration, permissions or proposed future work
- What remains unproven?
- The evidence needed and who will obtain it
Keep flexibility in how suppliers meet the outcomes where the decision does not depend on a particular design. Victorian Government guidance recommends requirements focused on outputs or performance: these can let suppliers propose different ways to meet the need and encourage innovation.
Pros and Cons of Using Supplier Demonstrations in Evaluations
- ProsProvides observable evidence of how the software behaves in real-time under controlled conditions.
- ConsDoes not prove integration with existing systems or long-term usability by end users.
Make a decision with its limits attached
Bring the task owner, likely users and relevant technical or information-handling contacts together to review the evidence. Describe each viable option’s fit and unresolved dependencies in plain language. Compare the effort to adopt and operate it as well as what the demonstration showed. Review pricing, contract terms and purchasing approvals before making a commitment.
Suppose two hypothetical candidates can display enquiry sources. One shows the source only after a manual import; the other shows it in the proposed workflow but has not demonstrated how corrected labels reach sales. Neither observation supports an unqualified winner. Record the different gaps and seek the evidence that would change the decision.
Finish with a short decision record: task and expected outcome, candidates considered, evidence observed, material limitations, open checks, decision owner and reason for the next step. The result may be to proceed with one candidate, validate a remaining risk, improve the current process or stop the purchase. Colleagues should be able to see why.
Use the brief consistently when reviewing the evidence, and keep any departure from it visible in the decision record. The Victorian Government advises standardising specification formats where possible; uniformity can reduce the cost of market engagement. For evaluations that need expertise beyond the team, its guidance says to obtain specialist evaluation skills as needed.
In this guide
- Writing a requirements list from real marketing tasksTurn real marketing work into requirements suppliers can demonstrate, including outcomes, exceptions, essential conditions and evidence requests.
- Building a vendor shortlist without relying on feature countsShortlist marketing software suppliers by essential tasks, proposed edition limits and unresolved questions rather than advertised feature totals.
- Comparing a live product demo with a prepared sales presentationLearn what a marketing software presentation and live demo can each establish, how to set a common scenario and what still needs validation.


