Skip to main content

Supported syncing

Connect to OpenSearch

Go to the Destinations overview page and click the Add destination button. Select OpenSearch and click Continue. You can then authenticate Hightouch to OpenSearch by entering your:
  • Host: The hostname or IP address of your OpenSearch server. Don’t include https:// as part of the hostname.
  • Port: The port number of your OpenSearch server’s HTTP API. The default is 3306, but yours may be different.
  • Username: This can be your personal OpenSearch login or a dedicated user for Hightouch.
  • Password: The password for the user specified above.
Once you’ve entered these fields, click Continue. Give your destination a descriptive name and Finish the destination connection setup.

Sync configuration

Once you’ve set up your OpenSearch destination and have a model to pull data from, you can set up your sync configuration to begin syncing data. Go to the Syncs overview page and click the Add sync button to begin. Then, select the relevant model and the OpenSearch destination you want to sync to.

Syncing to an index

An OpenSearch index is the place where the data used by a search engine is stored. You can use Hightouch to update individual documents in an index. You can also sync your document data via index aliases. Index aliases will only be displayed if the is_write_index option is configured.

Record matching

To match rows from your model to documents in OpenSearch, you need to select a model column and corresponding OpenSearch field. You can match on any OpenSearch field.

Field mapping

You can sync data to both existing fields and fields that don’t yet exist in OpenSearch. If you send data to a field that doesn’t exist yet, Hightouch adds the field and automatically detects its type.

Delete behavior

The delete behavior you select dictates what to do when a row no longer appears in your model’s query results. You have the following options:

Advanced configuration

You can configure how many rows you’d like to send per batch and how many batches you’d like to send in parallel.
If your sync is rejecting all or most rows in your model with vague error messages, try decreasing the batch size.

Tips and troubleshooting

To see the exact API requests and responses from each sync run, use the live debugger. To get notified by Slack, PagerDuty, SMS, or email when a sync fails, set up sync alerts. If you run into an issue this page doesn’t cover, .

Common errors

Failed to connect to your OpenSearch client. Check your credentials.

This error can occur if your credentials are incorrect. Ensure your hostname doesn’t include https:// and that your port is correct.
Last modified on August 17, 2023