Universal API Connector: Custom Data Ingestion

The Universal API Connector lets you bring data from any REST API into BEEM, even if there is no pre-built connector available. This is ideal for proprietary systems, internal APIs, or niche tools.

Availability

The Universal API Connector is available on Pro and Enterprise plans.

Identify Your API Requirements

Gather the API documentation for the system you want to connect
Note the following:
- Base URL of the API
- Authentication method (API key, OAuth 2.0, Basic Auth, Bearer token)
- Endpoints you want to pull data from
- Pagination method (offset, cursor, page number)
- Rate limits if applicable

Contact BEEM to Configure

Send your API details to [email protected] or your BEEM account manager
The BEEM Advanced Data Services team will:
- Review the API documentation
- Configure the connector with proper authentication
- Set up endpoint mappings and data extraction rules
- Handle pagination and rate limiting
A custom connector is built and deployed to your environment

Verify the Connection

Go to Connections in the left sidebar
Find your new Universal API connection
Check that the status shows Active
Navigate to the Datalake to confirm source tables are appearing
Preview the data to verify it matches expectations

Set Up Refresh Schedules

The connection syncs on a configurable schedule
Work with the BEEM team to set the appropriate refresh frequency
Monitor initial syncs in the Monitor section

Common Use Cases

Internal APIs: Pull data from proprietary systems built in-house
Niche SaaS tools: Connect to specialized industry software without a standard connector
Government or open data APIs: Ingest public datasets
Custom webhooks: Receive event-driven data

Key Details

Each Universal API Connector is custom-configured by the BEEM team
Supports REST APIs with JSON responses
Authentication, pagination, and error handling are managed automatically
Data is ingested into your Datalake like any other connection