Logs

Fivetran generates and logs several types of data related to your account and destinations:

Log events - point-in-time records of connection syncs, dashboard user actions, and Fivetran API calls
Account and destination metadata - continuously synced snapshots of your account's configuration, including role and membership information, data flow, and granular consumption information

You can use this data for the following purposes:

Monitoring and troubleshooting of connections
Tracking your usage
Conducting audits

Log events are available through both of the following:

Our free Fivetran Platform Connector. We automatically add a Fivetran Platform connection to every destination you create.
External log services

Account and destination metadata is available exclusively through the Fivetran Platform Connector.

Fivetran Platform connector

Fivetran Platform Connector is a free connector that delivers your logs and account metadata to a schema in your destination. We automatically add a Fivetran Platform connection to every destination you create. The Fivetran Platform Connector is available on all plans. Learn more in our Fivetran Platform Connector documentation.

The MAR that Fivetran Platform connections generate is free, though you may incur costs in your destination. Learn more in our pricing documentation.

External log services

As an alternative to the Fivetran Platform Connector, you can use any of the following external log services:

You can connect one external logging service per destination. Fivetran will write log events for all connections in the destination to the connected service. If there is a logging service that you would like but that is not yet supported, let us know.

You must be on an Enterprise or Business Critical plan to use an external logging service.

Log event format

The log events are in a standardized JSON format:

{
    "event": <Event name>,
    "data": {
        // Event-specific data. This section is optional and varies for each relevant event.
    },
    "created": <Event creation timestamp in UTC>,
    "connector_type": <Connector type>,
    "connection_id": <Connection ID>,
    "connection_name": <Connection name>,
    "sync_id": <Sync identifier as UUID>,
    "exception_id": <Fivetran error identifier> 
}

Field	Description
event	Event name
data	Optional object that contains event type-specific data. Its contents vary depending on log event type
created	Event creation timestamp in UTC
connector_type	Connector type
connection_id	Connection ID
connection_name	Connection name. It is either schema name, schema prefix name, or schema table prefix name
sync_id	Sync identifier as UUID. This optional field is only present in sync-related events generated by Fivetran connections
exception_id	Optional field that is only present if Fivetran encountered an unexpected problem

See our Log event details documentation to learn about event-specific data.

Some events may not be defined in the Log event details documentation as they are either connector type-specific or don't have the data object.

Log event list

All log events listed in this section are available in both the Fivetran Platform Connector and external logging services. In external logging services, all event types appear in the same log stream. In the Fivetran Platform Connector, events are stored in one of two tables depending on their type:

Audit Trail events are stored in the AUDIT_TRAIL table.
All other events - connector, dashboard activity, REST API, and transformation events - are stored in the LOG table.

The generate_api_secret event is an exception. It appears in the Audit Trail section below but it's stored in the LOG table, not the AUDIT_TRAIL table. Unlike Audit Trail events, which require an Enterprise or Business Critical plan, generate_api_secret is available to all account tiers.

Connector log events

Fivetran connectors generate the following events:

Connector Event Name	Description
alter_table	Table columns added to, modified in or dropped from destination table
change_schema_config_via_sync	Schema configuration updated during a sync
connection_failure	Failed to establish connection with source system
connection_successful	Successfully established connection with source system
copy_rows	Data copied to staging table
create_schema	Schema created in destination
create_table	Table created in destination
delete_rows	Stale rows deleted from main table
diagnostic_access_ended	Data access was removed because the related Zendesk ticket was resolved or deleted
diagnostic_access_expired	Data access expired
diagnostic_access_granted	Data accessed by Fivetran support for diagnostic purposes
drop_table	Table dropped from destination
error	Error during data sync
extract_summary	Summary of data extracted, including the number of API requests for API-based connectors and SQL queries for database connectors.
forced_resync_connector	Forced re-sync of a connector
forced_resync_table	Forced re-sync of a table
import_progress	Rough estimate of import progress
info	Information during data sync
insert_rows	Updated rows inserted in main table
json_value_too_long	A JSON value was too long for your destination and had to be truncated
processed_records	Number of records read from source system
read_end	Data reading ended
read_start	Data reading started
records_modified	Number of records upserted, updated, or deleted in table within single operation during a sync
schema_migration_end	Schema migration ended
schema_migration_start	Schema migration started
sync_end	Data sync completed
sync_start	Connection started syncing data
sync_stats	Current sync metadata. This event is only displayed for a successful sync for the following connectors: PostgreSQL Oracle MySQL SQL Server
update_rows	Existing rows in main table updated with new values
update_state	Connector-specific data you provided
warning	Warning during data sync
write_to_table_end	Finished writing records to destination table
write_to_table_start	Started writing records to destination table

Dashboard activity log events

Dashboard activities generate the following events:

Dashboard Activity Event Name	Description
change_schema_config	Schema configuration updated
connect_logger	Logging service is connected
create_connector	New connection is created
create_warehouse	New destination is created
delete_connector	Connection is deleted
delete_warehouse	Destination is deleted
diagnostic_access_approved	Data access granted for 21 days
diagnostic_access_denied	Data access denied
diagnostic_access_revoked	Data access revoked
disconnect_logger	Logging service is disconnected
edit_connector	Connection's credential, sync period, daily sync time, delay notification period, or data type locking state is edited
force_update_connector	Trigger manual update for connection
pause_connector	Connection is paused
pause_logging	Logging service is paused
resume_connector	Connection is resumed