Sources

A source is an input component that specifies how a Data Prepper pipeline ingests events. Each pipeline has a single source that either receives events over HTTP(S) or reads from external endpoints, such as OpenTelemetry Collector or Amazon Simple Storage Service (Amazon S3). Sources have configurable options based on the event format (string, JSON, Amazon CloudWatch logs, OpenTelemtry traces). The source consumes events and passes them to the buffer component.

Related articles

• documentdb
• dynamodb
• http
• kafka
• opensearch
• otel_logs_source
• otel_metrics_source
• otel_trace_source
• pipeline
• s3 source