Premium platforms bill by volume, so an estate that sends everything everywhere pays full price for data nobody queries. The obvious remedy is to collect less, which trades a cost problem for a blind spot. The better one is to decide what each destination actually needs before the data gets there.

One source, several destinations

This is the part that tends to be missed. A source is collected once, and what leaves the pipeline is not one copy going to one place.

The same log stream can arrive at a SIEM as security-relevant events only, at an observability platform as aggregated metrics, and in archive at full fidelity. Each destination gets the subset it is good at answering questions about, and pays for that subset rather than for everything. Adding a fourth destination later is a routing rule, not another collection project.

How the volume comes down

Filtering. Debug logging left on in production, health checks, duplicated events already captured elsewhere. Removing them costs nothing, because nothing was asking them a question.

Sampling. Head sampling suits high-volume logs where the population matters more than any individual line. Tail sampling suits distributed traces, where the interesting trace is the slow one and you cannot know that until it finishes. Adaptive sampling moves between them as conditions change.

Aggregation. Ten thousand identical messages become a count and a handful of preserved examples. The number is what gets queried; the examples are there when someone needs to read one.

Archive and rehydration. Full-fidelity data goes to storage priced for keeping rather than for querying. When an investigation needs the detail, it is pulled back.

None of this is decided in the abstract. We start by measuring what is being sent, what it costs and what anyone actually queries, because the gap between the second and the third is where the savings are.

What changes

  • Licensing follows volume, and volume is decided before the data lands rather than after it has been billed for.
  • Premium destinations receive less, because what they receive is chosen rather than defaulted.
  • Production systems carry less, since shaping happens in the pipeline and not on the machines being observed.
  • A new source is onboarded against one layer, not against every destination it feeds.
  • Visibility is unchanged. Anything removed is either duplicated elsewhere or retrievable from archive; nothing that answers a question is dropped.