Integrate Data with Zapier and Amazon AppFlow

Topic

Zapier and Amazon AppFlow make it easy to set up workflows that move data bi-directionally between Honeycode and hundreds of applications (e.g. Salesforce, Marketo, Amazon S3, etc.). Users can set Honeycode or other applications as either the sources or destinations for data movement.

Users can trigger these workflows based on events in Honeycode (e.g. row added, row deleted, column changed, app button clicked etc.), based on events in external applications, or based on schedules.

Example: Let's say that each time a certain change happens in Salesforce, you want a new row of data to be added to one of your Honeycode tables. Or each time a user adds a new item to a Honeycode table through a Honeycode app, that data also gets written to Salesforce.

The possibilities are endless with these two-way integrations, and in this article, we will break down three methods (Zapier, AppFlow, and Webhooks) that can help you connect Honeycode with your other work tools.

:hammer_and_wrench: Builder tip: We've built a training course for more robust content on this topic. Also included in the course are the Honeycode APIs, which are another method to connect Honeycode with other applications and services. For more information about the Honeycode APIs, you can also go to this article.


Determining which one to use

You might be wondering which integration method is best for your use case. Here are some things to consider:

  1. Consider whether the application or service that you want to connect Honeycode to is supported by Amazon AppFlow or Zapier. If Zapier or AppFlow supports the integration, they are recommended and don't require coding skills.

  2. If both AppFlow and Zapier are supported, think about your use case:

    • Zapier can only move one row of data at a time.
    • Zapier supports Honeycode as both a data source (using the webhooks found in this article) and a data destination
    • Zapier supports many operations such as update, update or insert, delete and read in addition to append (append is also supported by AppFlow)
    • AppFlow can move multiple rows of data at a time
    • AppFlow only supports Honeycode as a data destination
  3. If Zapier or AppFlow do not support the integration (e.g. you have a special use case or maybe the application you are trying to connect to is custom/internal) consider using the Honeycode APIs (these might require some technical resources if you don't have coding experience) or the Webhooks found in this article.


Zapier

What is Zapier?

Zapier is an online automation tool that connects two or more apps to automate tasks and data movement without needing a developer to build the integration. It's easy enough that anyone can build workflows with just a few clicks.

Zapier image

What are the benefits of using Zapier?

With Zapier, you can connect to over two thousand services. No programming is necessary and in just a few clicks, you can set up a fully functional integration between Honeycode and your target service. There are many different types of workflows that you can implement with Honeycode and Zapier. Below are a few ideas:

  • Add new leads from Salesforce into Honeycode

  • Sync expense data from Quickbooks or Xero into Honeycode

  • Enter issues from Jira into a Honeycode workbook that tracks to-do items

  • Enroll customers that you track in Honeycode in an online learning course

Zapier terminology

Zap

A Zap is an automated workflow between your apps. For example, you may have a Zap that writes Salesforce data to a Honeycode table. Zaps consist of at least two parts: a trigger and one or more actions.

Trigger

A trigger is the event in an app that starts the Zap. Once you set up a Zap, Zapier will monitor the app for that event. For example, new data is written to Salesforce each time a new record is added, and this could serve as a trigger. Zapier will monitor this for you in Salesforce.

Action

An action is the event that completes the Zap. For example, with the aforementioned Salesforce trigger, a new row of data is written to a Honeycode table, which would be the action.

Task

Each piece of data you run through your Zap counts as a task. That means if your Zap adds 100 rows of data to a Honeycode table, that would count as 100 tasks.

Getting started with Zapier

While we do provide high level steps in this article, we recommend Zapier's documentation if you prefer something more thorough:

Zapier's Getting Started Guide
Zapier's Learning Center

To use Zapier, you will need an account with an email address for:

  1. Honeycode
  2. Zapier
  3. The application or service you want to connect to

Check out popular integrations for Honeycode on Zapier or try one of the following zap templates, to get started!

Creating a Zap with Honeycode as the trigger

  1. Honeycode set up: Create a Honeycode workbook. Set up the table from which you want to access data. Then, create a webhook automation for the item that you want to use to start the Zap. The webhook can be either a workbook or builder automation. You can leave the URL field blank for the time being.

:bulb: Webhook definition: A webhook is an automated message sent between apps. When you use a webhook with Zapier and Honeycode, the webhook sends a message from Honeycode telling Zapier that the trigger event has occurred, and to start running the automation.

  1. Create the Zap: Go to Zapier and click on the button that says Create a Zap. Give your Zap a name.

  2. Set up the Trigger in Zapier: In the search bar for Choose App & Event, enter "Webhooks" and then select Webhooks by Zapier (requires premium Zapier account). For the trigger event, choose Catch Hook. Copy the URL found in the box called Custom Webhook URL.

  3. Add the webhook URL to Honeycode: Go back to Honeycode, and paste the URL from Zapier into the URL field in the webhook automation. If you are using a workbook automation, make sure to publish your automation. Then perform the action that triggers the automation. Go back to Zapier and select Test trigger to verify that the webhook connection is working.

  4. Set up the action: Select the application and follow the steps to configure the actions.

  5. Mapping data fields: You have to set the payload key to a key that can be used in the zap. The payload value should be a value from the automation's context (e.g. a table column or a variable) that you want to zap.

  6. Test and run: Test your Zap to make sure it runs the way you expect. If everything looks good, you can turn on the Zap.

:movie_camera: Video of the steps


Creating a Zap with Honeycode as the action

  1. Honeycode set up: Create a Honeycode workbook. Set up the table where you want the data to go.

  2. Create the Zap: Go to Zapier and click on the button that says Create a Zap . Give your Zap a name.

  3. Set up the trigger: Select the application and follow the steps to configure the trigger.

  4. Set up the action: Select Honeycode as the application and follow the steps to configure the actions.

  5. Test and run: Test your Zap to make sure it runs the way you expect. If everything looks good, you can turn on the Zap.

:movie_camera: Video of the steps


Amazon AppFlow

What is Amazon AppFlow?

Amazon AppFlow is a fully-managed integration service that enables you to securely exchange data between software as a service (SaaS) applications (e.g. Salesforce) and AWS services (e.g. Amazon Simple Storage Service (Amazon S3) and Amazon Redshift).

Amazon AppFlow source integrations include: Amazon S3, Amplitude, Datadog, Dynatrace, Google Analytics, Infor Nexus, Marketo, Salesforce, ServiceNow, Singular, Slack, Trend Micro, Veeva, and Zendesk.

What are the benefits of using Amazon AppFlow?

In just a few clicks, you can run data flows at nearly any scale and at the frequency you want: on a schedule, in response to a business event, or on demand. Here are few additional use cases:

  • Keep data in sync: Transfer data from Amazon S3 into Honeycode.

  • Bring data together: Build solutions across multiple applications, such as visualization or analytics.

  • Transfer at scale: AppFlow lets you transfer hundreds of rows at a time into Honeycode.

  • Integrate securely: With Amazon AppFlow, data is encrypted at rest and in transit, or use AWS PrivateLink for a private data transfer.

Getting started

To see if a service can be used as a source, destination, both, go to the Amazon AppFlow requirements page, select the service, and look at the note at the top. Please note that Honeycode can only be used as a destination.

To use Amazon AppFlow, you will need a few things:

  1. Honeycode account
  2. Amazon Web Services (AWS) account

Check out the Amazon AppFlow User Guide for more information.

Create a flow

This example covers a flow using Amazon AppFlow to send data from Amazon S3 to Amazon Honeycode.

  1. Check the source configuration requirements: Requirements specify that the source file must be in a csv format with a header row that includes the field names in each file. Requirements for using Amazon S3 as a source.

  2. Upload your source file to Amazon S3: Log into your AWS account and upload your file to Amazon S3. Make sure that your file is in csv format with a header row that includes the field names in each file.

  1. Create your flow in Amazon AppFlow: Go to the Amazon AppFlow homepage in the AWS console and choose the button that says Create Flow . Give your flow a name and then click Next .

  1. Enter source and destination details: When you select Amazon S3, you will be prompted to select a bucket. Make sure that your csv file is already uploaded to this bucket.

  1. Choose the flow trigger: Amazon AppFlow provides you with the following three options:

    • Run on demand: You manually run the flow each time you want to transfer data. You do this by pressing the Run Flow button on the Flow Details page.
    • Run flow on schedule: You provide a date and time, and specify a repeat frequency, if applicable.
    • Run flow on event: You configure an event that will initiate the flow. This option is available for source applications that provide change events.

For this example, select Run on demand and click Next.

  1. Map data fields: In this step, you match the fields from your source file to specific columns in your Honeycode table. Amazon AppFlow provides you with several options for mapping:

    • Mapping method: You can do this manually or by uploading a csv file.
    • Source to destination field mapping: Mapping fields directly means that the source data transfers directly to the destination with no modification. You can also choose to map fields with formulas.
    • You also have options for validating data, and applying filters.

For this step, select Manually map fields and then select Map fields directly . You will then be prompted to add filters. You can skip the filter step and proceed to review and create.

  1. Run the flow: Navigate through the remaining screens until you reach the review and create screen. Click the button that says Create Flow . In next screen, you see the details of the flow that you just created. Click the Run Flow button on the top right of the screen to see your flow in action.

  1. Check the results: Now go back to Honeycode, and check out your table. You can see that the data from the csv file is now added to your Honeycode table.

Webhooks

:hammer_and_wrench: Builder tip: We showed a webhook example above using Zapier, and we do recommend using Zapier for webhooks if possible. However, Honeycode's webhooks don't require Zapier as an intermediary, and they can be used with any URL that is equipped to handle receiving webhook calls, which is why we have this separate section.

What is a webhook?

A webhook is a way to make online services and applications communicate with each other. They can be used to automatically move data from one place to another when something happens.

You can also think of webhooks like messages that are sent between applications. And in Honeycode, whenever an automation occurs (e.g. something in an app or a table changes), you can add a webhook to move the data from Honeycode to another online service.

For example, let's say you have a Honeycode workbook automation that records new customer orders for gardening supplies. This automation writes a new row of data to one of your Honeycode tables for every new order. Each time this happens, you want two things to automatically send to another online application:

  1. The column data that contains the gardening supply that was ordered.
  2. The column data that contains the employee at your company that placed the order.

In this example, the application you want to send the Honeycode data to isn't supported by Zapier because it was built internally by your IT department; it does, however, have the ability to receive webhook calls.

In order to move the data from Honeycode to your internal application each time this automation occurs, there are a few things you will need to set this webhook up:

  • Webhook URL: The destination that you want to send the Honeycode data to (i.e. the URL of the internal application built by your IT department).

  • Payload value: The payload value is the message or data (i.e. the column data in our example) that is being sent from Honeycode to the destination. For our example we will use:

    • =[Order detail] This is the column containing the gardening supply that was ordered (e.g. fertlizer or a shovel)
    • =$[Sys_User] This is the name of the employee at your company who submitted the new order using the Honeycode app

:hammer_and_wrench: Builder tip: You can get creative with payload values and write expressions for more complex data and use functions like FindRow (to look up something and send to the destination) or Filter (to send a count of something to the destination).

  • Payload key: This can be any word. Keep in mind that this is what will appear in the destination URL. Think of it like the column name for the payload value that you are sending to your internal application. Going off the example above, the following could serve as two corresponding payload keys:

    • Gardening supply ordered
    • Employee name
  • HTTP headers (optional): HTTP headers can be used for different things. For example, you can use them for authentication, or maybe you have only one destination and several applications sending webhooks to the destination, and you want to specify a custom HTTP header to know the application this webhook was sent to.

Steps

  1. Webhooks require a Honeycode automation as a trigger. Select an existing automation or create a new automation. These can be either table automations (accessed by clicking the :zap: on the left navigation bar) or builder automations (accessed by clicking on an app object and accessing the automation modal in the properties panel). Note: the Creating a Zap with Honeycode as a trigger video showcases this.

  2. In the automation modal, click [+] Add actions.

  3. Select Webhook.

  4. Enter the Webhook URL.

  5. Enter the payload value and payload key.

  1. (Optional) Enter Run options and/or HTTP headers.

  2. Check your destination after the automation runs to see if the webhook works.


FAQ

  1. Are there limits for Zapier, AppFlow, and APIs?

    Currently, these are the limits (subject to change):

    • Throttling will be per user who has authenticated with Zapier or AppFlow; for the APIs it's per AWS Account.
    • StartTableDataImportJob: 1 tps rate/5 tps burst
    • DescribeTableDataImportJob: 5 tps rate/25 tps burst
    • ListWorkbooks, ListTables, QueryTableRows and ListTableRows: 25 tps rate/50 tps burst
    • CreateTableRows, UpdateTableRows, DeleteTableRows, UpsertTableRows: 5 tps rate/25 tps burst
  2. I am getting a Zapier error message. What do I do?

    There are two common error messages in Zapier:

If you see this error, make sure that you are passing a row id. You can get a row id by using an action that creates a row like Append row or the Find row action.

Whenever using formulas in Zapier, they must always start with an = equal sign. If the one you enter does not, and you receive this error message, double check your formula.

  1. Can I use Zapier, AppFlow, and Webhooks if I am using single sign-on (SSO)?

At this time, we do not support the use of Zapier, AppFlow, and Webhooks if you are using SSO.

Was this article helpful?
  • Yes
  • No

0 voters

4 Likes