No items found.
July 8, 2020
read-time

Testing in no-code

The Problem with No-Code Testing: How to Ensure Workflow Efficiency and Error-Handling in Multi-Tool Workflows

I'd like to posit a new law that is as you include more no-code tools in your tweet, the odds of me receiving it increase proportionally. Case in point, someone shared this fantastic tweet with me from the founder of Actiondesk (note: haven't used the tool) and it sparked all kinds of thinking

This is absolutely an issue.

I've found myself in so many workflows thinking, am I going to break something if I click here? Or is this stitch of tools going to output what I expect it to? How do I 'test' whether it does without risking a run?

More personally, if you've been an Automate All the Things subscriber for long enough, you may remember the time where I sent you and everyone on the mailing list a 'test' email. Every day. For a week. I still cringe thinking about it.

As no-code tools multiply, the problem is only getting worst.

Here's folks showing off their 'complex' Integromat workflows, most with 100+ steps.

Testing in no-code?

Testing in no-code seems to mean broadly three things:

1- Can these tools support the desired workflow? Can I do what I want to do?

2- How will the workflow handle errors?

3- How do we provide visibility to folks in our tools that they may be triggering workflows?

#1 - Can I do what I want to do?

When it comes to whether something is possible without code, we have to check whether our glue -- Zapier, Integromat etc. -- supports the different actions & triggers we need. Zapier probably does the best job of this with their app directory.

There really is no other way than being intimately familiar with the tools you're using to know whether a workflow is possible using no-code.

I'd love for an entrepreneur to create a draw.io type diagram creator that depending on the tools you want to connect and the expected workflow, tells you whether it's possible. That said, like many of you I'm sure, my workflows are rarely so complex from the get go that I can't just give it a try.

#2 - How will the workflow handle errors?

Out of the three, I think mainstream no-code tools perform best here. Zapier will automatically notify you when Zap breaks and offers granular settings for when to be notified.

Beyond that, Integromat has error handling built in so you can fork your workflow based on the error itself.

Parabola isn't great and breaks when any API it's working with throws an error. They're aware that it's an issue and I'll definitely keep annoying them until they have better error handling!

Just like #1, handling errors more gracefully is an opportunity for entrepreneurs! Take Chris Spags from Jetboost which builds add-on features (Boosts) to Webflow. Their next Boost will replicate something you could do with Zapier (with a lot of difficulty) but at a much cheaper price point (why pay for Zapier if all you need is one flow?). And his Boost will handle Webflow specific errors gracefully! The effort for Zapier to handle Webflow errors gracefully in every case isn't important enough for them to prioritize which means an opportunity for folks like Chris.

[tweet https://twitter.com/c_spags/status/1278097758415515648]

#3 - How do we provide visibility in our tools that they're  triggering automations?

Personally, I think this is the biggest issue!

I've become more and more reliant on multiple tools working together to get my workflow done. For me, it's usually a change in Airtable being synced with multiple 3rd party. As I update information in my Airtable base, Zapier's new record in view trigger will cascade that change into multiple third parties automatically (set to publish in Airtable -> send to Webflow).

If a new collaborator comes into my Airtable base, they have absolutely no visibility into what workflows are triggered when. Hell, I sometimes inadvertently trigger workflows from my own base without realizing it!

The only available remedy is good documentation. It could be emojis in view descriptions or field descriptions letting collaborators know that changing information could trigger a workflow. There is no visibility of tools into each other. Every no-code today stands on its own.

I'm no developer but I would love to see folks build tools that increase visibility across no-code tools. A few ideas to get you started:

  • An Airtable block that automatically surfaces recent Zapier runs or generally shows the different automations connected to a base (could even look like schema block but with Zaps).
  • A way to see third party data directly from Airtable/Webflow. Select a record or CMS item and see additional information about that user/item in 3rd parties (e.g. see this user's conversations in Zendesk or this item's shipping status) directly in my interface without having to sync between the systems.

In all cases, although we've integrated many tools, we're not quite at the point where we can understand what's going on outside of the tool we're in.

That said, the only thing stopping us from being better at testing is building the tools we need!

Best

Aron

Want to improve your workflows?
Join 2,000+ others who get the 10% better newsletter in their inbox every two weeks
One more step: check your inbox to verify your email!
Oops! Something went wrong while submitting the form.
Written by
Giovanni Segar
Share article
Written by
Aron Korenblit
Share article
Related posts
May 14, 2023
How To Get Paid Online Without Code
No-code
Automation
May 14, 2023
Stripe Launches Apps: Every Tool Has Automations Now Part 4
No-code
Thoughts
May 14, 2023
Data, Logic, UI and (a bit of) code—the future of no-code
No-code

Automate all the things

A weekly no-code automation delivered to your inbox (with thoughts on no-code every now and then)
Subscribe
Jul 08, 2020 by Aron Korenblit

Testing in no-code

I'd like to posit a new law that is as you include more no-code tools in your tweet, the odds of me receiving it increase proportionally. Case in point, someone shared this fantastic tweet with me from the founder of Actiondesk (note: haven't used the tool) and it sparked all kinds of thinking

This is absolutely an issue.

I've found myself in so many workflows thinking, am I going to break something if I click here? Or is this stitch of tools going to output what I expect it to? How do I 'test' whether it does without risking a run?

More personally, if you've been an Automate All the Things subscriber for long enough, you may remember the time where I sent you and everyone on the mailing list a 'test' email. Every day. For a week. I still cringe thinking about it.

As no-code tools multiply, the problem is only getting worst.

Here's folks showing off their 'complex' Integromat workflows, most with 100+ steps.

Testing in no-code?

Testing in no-code seems to mean broadly three things:

1- Can these tools support the desired workflow? Can I do what I want to do?

2- How will the workflow handle errors?

3- How do we provide visibility to folks in our tools that they may be triggering workflows?

#1 - Can I do what I want to do?

When it comes to whether something is possible without code, we have to check whether our glue -- Zapier, Integromat etc. -- supports the different actions & triggers we need. Zapier probably does the best job of this with their app directory.

There really is no other way than being intimately familiar with the tools you're using to know whether a workflow is possible using no-code.

I'd love for an entrepreneur to create a draw.io type diagram creator that depending on the tools you want to connect and the expected workflow, tells you whether it's possible. That said, like many of you I'm sure, my workflows are rarely so complex from the get go that I can't just give it a try.

#2 - How will the workflow handle errors?

Out of the three, I think mainstream no-code tools perform best here. Zapier will automatically notify you when Zap breaks and offers granular settings for when to be notified.

Beyond that, Integromat has error handling built in so you can fork your workflow based on the error itself.

Parabola isn't great and breaks when any API it's working with throws an error. They're aware that it's an issue and I'll definitely keep annoying them until they have better error handling!

Just like #1, handling errors more gracefully is an opportunity for entrepreneurs! Take Chris Spags from Jetboost which builds add-on features (Boosts) to Webflow. Their next Boost will replicate something you could do with Zapier (with a lot of difficulty) but at a much cheaper price point (why pay for Zapier if all you need is one flow?). And his Boost will handle Webflow specific errors gracefully! The effort for Zapier to handle Webflow errors gracefully in every case isn't important enough for them to prioritize which means an opportunity for folks like Chris.

[tweet https://twitter.com/c_spags/status/1278097758415515648]

#3 - How do we provide visibility in our tools that they're  triggering automations?

Personally, I think this is the biggest issue!

I've become more and more reliant on multiple tools working together to get my workflow done. For me, it's usually a change in Airtable being synced with multiple 3rd party. As I update information in my Airtable base, Zapier's new record in view trigger will cascade that change into multiple third parties automatically (set to publish in Airtable -> send to Webflow).

If a new collaborator comes into my Airtable base, they have absolutely no visibility into what workflows are triggered when. Hell, I sometimes inadvertently trigger workflows from my own base without realizing it!

The only available remedy is good documentation. It could be emojis in view descriptions or field descriptions letting collaborators know that changing information could trigger a workflow. There is no visibility of tools into each other. Every no-code today stands on its own.

I'm no developer but I would love to see folks build tools that increase visibility across no-code tools. A few ideas to get you started:

  • An Airtable block that automatically surfaces recent Zapier runs or generally shows the different automations connected to a base (could even look like schema block but with Zaps).
  • A way to see third party data directly from Airtable/Webflow. Select a record or CMS item and see additional information about that user/item in 3rd parties (e.g. see this user's conversations in Zendesk or this item's shipping status) directly in my interface without having to sync between the systems.

In all cases, although we've integrated many tools, we're not quite at the point where we can understand what's going on outside of the tool we're in.

That said, the only thing stopping us from being better at testing is building the tools we need!

Best

Aron

Automate All the Things
3K+
Subscribers
88
Issues
Enjoying the post? Get it in your inbox every Thursday
Last step: confirm your email!
Oops! Something went wrong while submitting the form.

Related streams

See all streams
No items found.