Warehouse Observability Enhancements

Improved event discard reasons for enhanced observability.
Available Plans
  • free
  • starter
  • growth
  • enterprise

  •   less than a minute  

RudderStack’s latest warehouse observability enhancements give you detailed insights into why the data going to a warehouse destination was discarded, especially in cases where there is a data type mismatch and the event data does not conform to the Warehouse Schema.

How the feature works

RudderStack discards any event data going into a warehouse destination that does not strictly conform to the Warehouse Schema spec and cannot be fixed.

In such cases, RudderStack puts the discarded records into a rudder_discards table along with a reason. With the latest observability enhancements, the reasons will give more insights on exactly why the data was discarded.

Some examples are shown below:

  • incompatible schema conversion from string to boolean
  • incompatible schema conversion from string to int
  • incompatible schema conversion from datetime to string
  • incompatible schema conversion from bigint to float

Questions? Contact us by email or on Slack